iwddlmZddlmZmZmZmZmZmZddl Z ddl m Z ddl m Z ddl mZmZddlmZddlmZdd lmZdd lmZmZesd gZGd d eZy))log)AnyListOptionalSequenceUnioncastN)Tensor)Literal) _jsd_compute _jsd_update)Metric) dim_zero_cat)_MATPLOTLIB_AVAILABLE)_AX_TYPE_PLOT_OUT_TYPEzJensenShannonDivergence.plotc eZdZUdZdZeed<dZeed<dZeed<dZ e ed<e d Z e ed <e eeefed <eed < dd ededdeddffd ZdededdfdZdefdZ ddee eeefdeedefdZxZS)JensenShannonDivergenceaaCompute the `Jensen-Shannon divergence`_. .. math:: D_{JS}(P||Q) = \frac{1}{2} D_{KL}(P||M) + \frac{1}{2} D_{KL}(Q||M) Where :math:`P` and :math:`Q` are probability distributions where :math:`P` usually represents a distribution over data and :math:`Q` is often a prior or approximation of :math:`P`. :math:`D_{KL}` is the `KL divergence`_ and :math:`M` is the average of the two distributions. It should be noted that the Jensen-Shannon divergence is a symmetrical metric i.e. :math:`D_{JS}(P||Q) = D_{JS}(Q||P)`. As input to ``forward`` and ``update`` the metric accepts the following input: - ``p`` (:class:`~torch.Tensor`): a data distribution with shape ``(N, d)`` - ``q`` (:class:`~torch.Tensor`): prior or approximate distribution with shape ``(N, d)`` As output of ``forward`` and ``compute`` the metric returns the following output: - ``js_divergence`` (:class:`~torch.Tensor`): A tensor with the Jensen-Shannon divergence Args: log_prob: bool indicating if input is log-probabilities or probabilities. If given as probabilities, will normalize to make sure the distributes sum to 1. reduction: Determines how to reduce over the ``N``/batch dimension: - ``'mean'`` [default]: Averages score across samples - ``'sum'``: Sum score across samples - ``'none'`` or ``None``: Returns score per sample kwargs: Additional keyword arguments, see :ref:`Metric kwargs` for more info. Raises: TypeError: If ``log_prob`` is not an ``bool``. ValueError: If ``reduction`` is not one of ``'mean'``, ``'sum'``, ``'none'`` or ``None``. .. attention:: Half precision is only support on GPU for this metric. Example: >>> from torch import tensor >>> from torchmetrics.regression import JensenShannonDivergence >>> p = tensor([[0.1, 0.9], [0.2, 0.8], [0.3, 0.7]]) >>> q = tensor([[0.3, 0.7], [0.4, 0.6], [0.5, 0.5]]) >>> js_div = JensenShannonDivergence() >>> js_div(p, q) tensor(0.0259) Tis_differentiableFhigher_is_betterfull_state_updateplot_lower_boundplot_upper_boundmeasurestotallog_prob reductionmeansumnoneNkwargsreturnNc t|d i|t|tst d|||_gd}||vrt d|d|||_|jdvr(|jdtjdd n|jdgd |jd tjd d y)Nz0Expected argument `log_prob` to be bool but got r z+Expected argument `reduction` to be one of z but got )r!r"rrr")dist_reduce_fxcatrr) super__init__ isinstancebool TypeErrorr ValueErrorr add_statetorchtensor)selfrrr$allowed_reduction __class__s z/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/torchmetrics/regression/js_divergence.pyr+z JensenShannonDivergence.__init__\s "6"(D)NxjYZ Z  9 - -JK\J]]fgpfqrs s" >>_ , NN:u||C'8N O NN:r%N @ w QFpqcZt|||j\}}|j|jdk(r1ttt |j j|ytt |j |jz|_|xj|z c_ y)zUpdate the metric state.Nr#) r rrr rr rappendr"r)r3r8r9rrs r6updatezJensenShannonDivergence.updatersu%aDMM:% >> !T^^v%= ft}} - 4 4X > 7(,,.HDM JJ% Jr7c|jdvr*tttt|j ntt|j }t ||j|jS)zCompute metric.)r#N)rrr rr rr r)r3rs r6computezJensenShannonDivergence.compute{sU~~/ d6lDMM: ;fdmm,  Hdjj$..AAr7valaxc&|j||S)aoPlot a single or multiple values from the metric. Args: val: Either a single result from calling `metric.forward` or `metric.compute` or a list of these results. If no value is provided, will automatically call `metric.compute` and plot that result. ax: An matplotlib axis object. If provided will add plot to that axis Returns: Figure and Axes object Raises: ModuleNotFoundError: If `matplotlib` is not installed .. plot:: :scale: 75 >>> from torch import randn >>> # Example plotting a single value >>> from torchmetrics.regression import JensenShannonDivergence >>> metric = JensenShannonDivergence() >>> metric.update(randn(10,3).softmax(dim=-1), randn(10,3).softmax(dim=-1)) >>> fig_, ax_ = metric.plot() .. plot:: :scale: 75 >>> from torch import randn >>> # Example plotting multiple values >>> from torchmetrics.regression import JensenShannonDivergence >>> metric = JensenShannonDivergence() >>> values = [] >>> for _ in range(10): ... values.append(metric(randn(10,3).softmax(dim=-1), randn(10,3).softmax(dim=-1))) >>> fig, ax = metric.plot(values) )_plot)r3r?r@s r6plotzJensenShannonDivergence.plotsPzz#r""r7)Fr!)NN)__name__ __module__ __qualname____doc__rr-__annotations__rrrfloatrrrr rr rr+r<r>rrrrrC __classcell__)r5s@r6rrs1f#t""d"#t#!e!!!fe$FDL()) M:@GG67G G  G,  6 d BB_c(#E&(6*:":;<(#IQRZI[(# (#r7r)mathrtypingrrrrrr r1r typing_extensionsr 0torchmetrics.functional.regression.js_divergencer r torchmetrics.metricrtorchmetrics.utilities.datartorchmetrics.utilities.importsrtorchmetrics.utilities.plotrr__doctest_skip__rr)r7r6rTsB== %V&4@@67M#fM#r7