a  dX@sddlmZmZmZmZmZmZddlZddlmZm Z ddl m Z m Z m Z ddlmZddlmZddlmZmZes~dgZGd d d eZdS) )AnyListOptionalSequenceTupleUnionN)Tensortensor) _ter_compute _ter_update_TercomTokenizer)Metric)_MATPLOTLIB_AVAILABLE)_AX_TYPE_PLOT_OUT_TYPETranslationEditRate.plotc s eZdZUdZdZeed<dZeed<dZeed<dZ e ed<dZ e ed <e ed <e ed <d Z eee ed <deeeeeed dfdd Zeeeefeeeeefd dddZee ee e ffdddZdeee ee feeedddZZS)TranslationEditRateatCalculate Translation edit rate (`TER`_) of machine translated text with one or more references. This implementation follows the one from `SacreBleu_ter`_, which is a near-exact reimplementation of the Tercom algorithm, produces identical results on all "sane" outputs. As input to ``forward`` and ``update`` the metric accepts the following input: - ``preds`` (:class:`~Sequence`): An iterable of hypothesis corpus - ``target`` (:class:`~Sequence`): An iterable of iterables of reference corpus As output of ``forward`` and ``compute`` the metric returns the following output: - ``ter`` (:class:`~torch.Tensor`): if ``return_sentence_level_score=True`` return a corpus-level translation edit rate with a list of sentence-level translation_edit_rate, else return a corpus-level translation edit rate Args: normalize: An indication whether a general tokenization to be applied. no_punctuation: An indication whteher a punctuation to be removed from the sentences. lowercase: An indication whether to enable case-insesitivity. asian_support: An indication whether asian characters to be processed. return_sentence_level_score: An indication whether a sentence-level TER to be returned. kwargs: Additional keyword arguments, see :ref:`Metric kwargs` for more info. Example: >>> from torchmetrics.text import TranslationEditRate >>> preds = ['the cat is on the mat'] >>> target = [['there is a cat on the mat', 'a cat is on the mat']] >>> ter = TranslationEditRate() >>> ter(preds, target) tensor(0.1538) Fis_differentiablehigher_is_betterfull_state_updateplot_lower_boundg?plot_upper_boundtotal_num_edits total_tgt_lenN sentence_terT) normalizeno_punctuation lowercase asian_supportreturn_sentence_level_scorekwargsreturnc stjfi|t|ts,td|dt|tsFtd|dt|ts`td|dt|tsztd|dt|||||_||_|jdt ddd |jd t ddd |jr|jd gd d dS) Nz>> # Example plotting a single value >>> from torchmetrics.text import TranslationEditRate >>> metric = TranslationEditRate() >>> preds = ['the cat is on the mat'] >>> target = [['there is a cat on the mat', 'a cat is on the mat']] >>> metric.update(preds, target) >>> fig_, ax_ = metric.plot() .. plot:: :scale: 75 >>> # Example plotting multiple values >>> from torchmetrics.text import TranslationEditRate >>> metric = TranslationEditRate() >>> preds = ['the cat is on the mat'] >>> target = [['there is a cat on the mat', 'a cat is on the mat']] >>> values = [ ] >>> for _ in range(10): ... values.append(metric(preds, target)) >>> fig_, ax_ = metric.plot(values) )Z_plot)r,r6r7r/r/r0plotvs*r)FFTFF)NN)__name__ __module__ __qualname____doc__rr)__annotations__rrrfloatrrrrrrr'rstrrr3rr5rrr8 __classcell__r/r/r-r0rs< !     . r)typingrrrrrrr4rr Z torchmetrics.functional.text.terr r r Ztorchmetrics.metricr Ztorchmetrics.utilities.importsrZtorchmetrics.utilities.plotrrZ__doctest_skip__rr/r/r/r0s