i1&ddlZddlZddlZddlmZddlmZddlmZddl m Z m Z m Z m Z mZmZmZddlZddlZddlmZddlmZddlmZdd lmZmZmZesesd d gZ d5d eeeefd eeeefdee de e ddffde!ddf dZ"dedefdZ# d6dee de e ddffde e ddffdZ$de dde e%e%effdZ&GddZ'de(ddfdZ) d7dee dee ddffdede e(d e'd!eee fd"e!de eeee ffd#Z*d$e ed%e ede e(fd&Z+d e'd%e ed'e ed(e ed)e ed*e ed$e ed+e ed,e ed-e edee dee ddffd.e d/d0e e,d1e e,de e(d2e!d3e!de eeff$d4Z-y)8N)Sequence)version) ModuleType)AnyDictListLiteralOptionalTupleUnion)apply_to_collection)Tensor)rank_zero_warn)_FASTER_COCO_EVAL_AVAILABLE_PYCOCOTOOLS_AVAILABLE _PYCOCOTOOLS_GREATER_EQUAL_2_0_9zCocoBackend.tm_to_cocozCocoBackend.coco_to_tmpredstargetsiou_typebboxsegm. ignore_scorereturnc t|tr|f}ddd t fd|Drtd|d|Dcgc]} | }}t|tst d|t|tst d|t |t |k7r#t d t |d t |g|d |sd gngzD]% t fd |Dst d dg|d D]% t fd|Dst d d|D]%tfd|Drt dd|std|Ds t dtd|Ds t d|D]%tfd|Drt ddtd|Ds t dt|D]q\}}|D]g|jd|d jdk7s-t dd|d |jdd!|d jdd" s|ry#t|D]\}}|D]|jd|d jdcxk(r|d jdk(rEnt dd$|d%|jdd&|d jdd'|d jdd" y#cc}w)(z9Ensure the correct input format of `preds` and `targets`.boxesmasksrc3&K|]}|v ywN).0tpname_maps s/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/torchmetrics/detection/helpers.py z#_input_validator..4s 1"2X z IOU type z is not supportedz:Expected argument `preds` to be of type Sequence, but got z;Expected argument `target` to be of type Sequence, but got zHExpected argument `preds` and `target` to have the same length, but got z and labelsscoresc3&K|]}|v ywrr r!pks r$r%z#_input_validator..Bs)5aqz5r&z.Expected all dicts in `preds` to contain the `z` keyc3&K|]}|v ywrr r*s r$r%z#_input_validator..Fs+7aqz7r&z/Expected all dicts in `target` to contain the `c3DK|]}t|tywr isinstancer)r!predivns r$r%z#_input_validator..JsCUT:d3i0U z Expected all z in `preds` to be of type Tensorc3BK|]}t|dtyw)r(Nr/r!r1s r$r%z#_input_validator..Ls#YSX4JtH~v$FSXz3Expected all scores in `preds` to be of type Tensorc3BK|]}t|dtywr'Nr/r5s r$r%z#_input_validator..NsDedz$x.&1er6z3Expected all labels in `preds` to be of type Tensorc3DK|]}t|tywrr/)r!targetr2s r$r%z#_input_validator..QsIv:fSk62r3z! in `target` to be of type Tensorc3BK|]}t|dtywr8r/)r!r:s r$r%z#_input_validator..SsJ'z&*F3'r6z4Expected all labels in `target` to be of type TensorrzInput 'z' and labels of sample z. in targets have a different length (expected z labels, got )Nz', labels and scores of sample z2 in predictions have a different length (expected z labels and scores, got z labels and ) r0strany Exceptionr ValueErrorlenall enumeratesize) rrrrr" item_val_nameiitemr2r,r#s @@@r$_input_validatorrH)sr(C ;1H 1 11)H:->?@@,45HbXb\HM5 eX &UV[U\]^^ gx (VW^V_`aa 5zS\!VWZ[`WaVbbghklshtgu v  (} 'h '\H:r R )5) )MaSPUVW WS(} 'h ' +7+ +NqcQVWX X(CUCC}SE1QRS S #YSX#Y YNOO DeD DNOOIII}SE1RST T J'J JOPPW%4 CCy~~a DN$7$7$:: cU"9!=3379>>!3D2E]SWX`SaSfSfghSiRjjkm!&U#4 CINN1%h)<)CVCVWXCYY cU"A!E3379>>!3D2EF N//23<X@S@STU@V?WWXZ!$S6s L rcl|jdk(r |jdk(r|jdS|S)zIEmpty tensors can cause problems in DDP mode, this methods corrects them.r)numelndim unsqueeze)rs r$_fix_empty_tensorsrNis. {{}ejjAoq!! Lc|dt|tr|f}tfd|Drtdd||S)z+Validate that iou type argument is correct.)rrc3&K|]}|v ywrr )r!r"allowed_iou_typess r$r%z)_validate_iou_type_arg..ws :22& &r&z*Expected argument `iou_type` to be one of z or a tuple of, but got )r0r=r>r@)rrRs @r$_validate_iou_type_argrSpsS)(C ; : ::89J8KKcdlcm n   OrObackend pycocotoolsfaster_coco_evalc|dk(r(ts tdddlm}ddlm}ddlm}|||fSts tdddl m}ddl m }dd l m}|||fS) z-Load the backend tools for the given backend.rVzBackend `pycocotools` in metric `MeanAveragePrecision` metric requires that `pycocotools` is installed. Please install with `pip install pycocotools` or `pip install torchmetrics[detection]`rN)COCO)COCOevalzBackend `faster_coco_eval` in metric `MeanAveragePrecision` metric requires that `faster-coco-eval` is installed. Please install with `pip install faster-coco-eval`.)COCOeval_faster)mask) rModuleNotFoundErrorpycocotools.maskr\pycocotools.cocorYpycocotools.cocoevalrZrrWr[faster_coco_eval.core)rT mask_utilsrYrZs r$_load_coco_backend_toolsrc~sf-%%u  .)1Xz)) &! N  &<8 : %%rOceZdZdZdedddfdZedefdZedefdZ edefd Z d*d e e d e e d e e d e e de e de e de e de e de e de edeeddffdeddeeeffdZdeededeedeee ffdZe d+dedede edeeddffdeddeeeee feeee fff dZ d,d e e d e e d e e d e e de e de e de e de e de e d ede edeeddffdedddfd!Z d-d"e e d#e e d$ee e d%ee e d&ee e d'ee e d(ee e de edeeddffdeddefd)Zy). CocoBackendaIBackend implementation for COCO-style Mean Average Precision (mAP) calculation. This class provides the core functionality for evaluating object detection and instance segmentation predictions using the Common Objects in Context (COCO) evaluation protocol. It supports both the standard 'pycocotools' and optimized 'faster_coco_eval' backends. It's used for calculation of mAP in MeanAveragePrecision class. It's a backend that abstracts away the mAP calculation with coco package Args: backend (str): Either 'pycocotools' or 'faster_coco_eval' rTrUrNc6|dvrtd|||_y)NrUzUExpected argument `backend` to be one of ('pycocotools', 'faster_coco_eval') but got )r@rT)selfrTs r$__init__zCocoBackend.__init__s- = =ghogpq  rOc8t|j\}}}|S)z.Returns the coco module for the given backend.rcrT)rgcoco_s r$rkzCocoBackend.cocos.dll; a rOc8t|j\}}}|S)z3Returns the coco eval module for the given backend.rj)rgrlcocoevals r$rnzCocoBackend.cocoevals2$,,?8QrOc8t|j\}}}|S)z4Returns the mask utils object for the given backend.rj)rgrlrbs r$rbzCocoBackend.mask_utilss4DLLA1jrOgroundtruth_labelsgroundtruth_boxgroundtruth_maskgroundtruth_crowdsgroundtruth_areadetection_labels detection_boxdetection_maskdetection_scoresrr.averagemacromicroc | dk(r$t|td}t|td}|j|j} } t|dkDst|dkDrBt j ||zj jjng}|j|t|dkDr|ndt|dkDr|nd||| || | _ |j|t|dkDr|ndt|dkDr|nd| | || | _ tjtj5| j| jddd| | fS#1swY| | fSxYw)z=Returns the coco datasets for the target and the predictions.r|c,tj|Srtorch zeros_likexs r$z0CocoBackend._get_coco_datasets..s[`[k[klm[nrOc,tj|Srrrs r$rz0CocoBackend._get_coco_datasets..sW\WgWghiWjrOrN)r'rrcrowdsarear all_labelsry)r'rrr(rrry)r rrkrArcatuniquecputolist_get_coco_formatdataset contextlibredirect_stdoutioStringIO createIndex)rgrprqrrrsrtrurvrwrxrry coco_target coco_predsrs r$_get_coco_datasetszCocoBackend._get_coco_datasetss g !45GQn!o 23CVMjk "&))+tyy{Z #$q(C0B,Ca,G II&);; < C C E I I K R R T  #33%%(%9A%=/4&)*:&;a&?"T%!!4  "22##&}#5#9-t$'$7!$;.#!3  ' ' 6  # # %  " " $7;&& 7;&&s !E99Fstatsprefixmax_detection_thresholdscH|}|dtj|dgtj|dtj|dgtj|dtj|dgtj|dtj|d gtj|d tj|d gtj|d tj|d gtj|d|dtj|dgtj|d|dtj|dgtj|d|dtj|dgtj|dtj|dgtj|dtj|dgtj|dtj|dgtji S)z;Converts the output of COCOeval.stats to a dict of tensors.maprdtypemap_50rJmap_75 map_small map_medium map_largemar_ mar_small mar_medium mar_large rtensorfloat32)rgrrrmdts r$_coco_stats_to_tensor_dictz&CocoBackend._coco_stats_to_tensor_dicts'hcNELL%(5==Ihf u||U1XJemmLhf u||U1XJemmLhi %,,az"Ohj !5<<q %--#Phi %,,az"Ohd3q6( #U\\58*EMM%Rhd3q6( #U\\58*EMM%Rhd3q6( #U\\58*EMM%Rhi %,,az"Ohj !5<<r 5==#Qhi %,,b {%--"P  rOrrct|}t|\}}}tjt j 5||}|j |}dddjd}jd} i} |D]} | d| vr*gggd| | d<d|vr g| | dd<d|vr g| | dd<d|vr| | ddj| dd|vr)| | ddj|j| | | dd j| d | | dd j| d | | dd j| d i} | D]} | d| vr)ggd | | d<d|vr g| | dd<d|vr g| | dd<d|vr| | ddj| dd|vr)| | ddj|j| | | ddj| d| | dd j| d | D](}|| vsggd | |<d|vrg| |d<d|vs!g| |d<*gg}}| D]}tj| |dtjtj| |d tjd }d|vrAtjtj| |dtj|d<d|vrAtjtj| |dtj |d<|j|tj| |d tjtj| |d tjtj| |d tjd}d|vr.tj| |dtj|d<d|vrAtjtj| |dtj |d<|j|||fS#1swYxYw)aUtility function for converting .json coco format files to the input format of the mAP metric. The function accepts a file for the predictions and a file for the target in coco format and converts them to a list of dictionaries containing the boxes, labels and scores in the input format of mAP metric. Args: coco_preds: Path to the json file containing the predictions in coco format coco_target: Path to the json file containing the targets in coco format iou_type: Type of input, either `bbox` for bounding boxes or `segm` for segmentation masks backend: Backend to use for the conversion. Either `pycocotools` or `faster_coco_eval`. Returns: A tuple containing the predictions and targets in the input format of mAP metric. Each element of the tuple is a list of dictionaries containing the boxes, labels and scores. Example: >>> # File formats are defined at https://cocodataset.org/#format-data >>> # Example files can be found at >>> # https://github.com/cocodataset/cocoapi/tree/master/results >>> from torchmetrics.detection import MeanAveragePrecision >>> preds, target = MeanAveragePrecision().coco_to_tm( ... "instances_val2014_fakebbox100_results.json", ... "val2014_fake_eval_res.txt.json" ... iou_type="bbox" ... ) # doctest: +SKIP N annotationsimage_id)r'iscrowdrrrrrr' category_idrr)r(r'r(scorer)rSrcrrrrloadResrappend annToMaskrrrint32nparrayuint8)rrrrTrkrlgtdt gt_dataset dt_datasetr:trr+r, batched_predsbatched_targetkeybpbts r$ coco_to_tmzCocoBackend.coco_to_tm sD*(3-g6 a  ' ' 6k"BJ'B7ZZ . ZZ . A}F* !)q}% X%57F1Z=)'2X%57F1Z=)'2!q}%g.55ai@!q}%g.55bll1oF 1Z= !( + 2 21]3C D 1Z= !) , 3 3AiL A 1Z= !& ) 0 06 ;%(A}E)24'Ca m$X%46E!J-(1X%46E!J-(1!a m$W-44QvY?!a m$W-44R\\!_E !J-  * 1 1!G* = !J-  * 1 1!M2B CA~&(B7aX%(*E!HW%X%(*E!HW% )+B~ C,,uSz(';5==Q,,uSz(';5;;OB!#ll288E#Jw4G+HPUP]P]^7 !#ll288E#Jw4G+HPUP[P[\7   $ ,,vc{8'ekkR VC[%8 NB !#ll6#;w+?u}}U7 !#ll288F3K4H+IQVQ\Q\]7  ! !" %),n,,S7 6s QQ%namec t|dkDst|dkDrBtj||zjj j ng} |j |t|dkDr|ndt|dkDr|nd||| | | }|j |t|dkDr|ndt|dkDr|nd| | | | }d| vrt|dtd|d<t|dtjtjfd |d<t|td }t|tjtjfd }tj|dd }tj|d }t| dd5}|j|dddt| dd5}|j|dddy#1swY3xYw#1swYyxYw)aUtility function for converting the input for mAP metric to coco format and saving it to a json file. This function should be used after calling `.update(...)` or `.forward(...)` on all data that should be written to the file, as the input is then internally cached. The function then converts to information to coco format and writes it to json files. Args: groundtruth_labels: List of tensors containing the ground truth labels groundtruth_box: List of tensors containing the ground truth bounding boxes groundtruth_mask: List of tensors containing the ground truth segmentation masks groundtruth_crowds: List of tensors indicating whether ground truth annotations are crowd annotations groundtruth_area: List of tensors containing the area of ground truth annotations detection_labels: List of tensors containing the predicted labels detection_box: List of tensors containing the predicted bounding boxes detection_mask: List of tensors containing the predicted segmentation masks detection_scores: List of tensors containing the confidence scores for predictions name: Name of the output file, which will be appended with "_preds.json" and "_target.json" iou_type: Type of IoU calculation to use. Can be either "bbox" for bounding box or "segm" for segmentation average: Type of averaging to use. Can be either "macro" or "micro" Example: >>> from torch import tensor >>> from torchmetrics.detection import MeanAveragePrecision >>> preds = [ ... dict( ... boxes=tensor([[258.0, 41.0, 606.0, 285.0]]), ... scores=tensor([0.536]), ... labels=tensor([0]), ... ) ... ] >>> target = [ ... dict( ... boxes=tensor([[214.0, 41.0, 562.0, 285.0]]), ... labels=tensor([0]), ... ) ... ] >>> metric = MeanAveragePrecision(iou_type="bbox") >>> metric.update(preds, target) >>> metric.tm_to_coco("tm_map_input") rN)r'rrrrrrry)r'rrr(rrryrrc$|jdSNzutf-8decoders r$rz(CocoBackend.tm_to_coco..sahhW^N_rO)rfunctionct|Srintrs r$rz(CocoBackend.tm_to_coco..s3q6rOc$|jdSrrrs r$rz(CocoBackend.tm_to_coco..sabaiaijqarrOct|Srrrs r$rz(CocoBackend.tm_to_coco..s QTUVQWrOr)indentz _preds.jsonwz _target.json)rArrrrrrr bytesruint32uint64jsondumpsopenwrite)rgrprqrrrsrtrurvrwrxrrryrtarget_dataset preds_dataset preds_json target_jsonfs r$ tm_to_cocozCocoBackend.tm_to_cocozst#$q(C0B,Ca,G II&);; < C C E I I K R R T  ..%%(%9A%=/4&)*:&;a&?"T%!!/  --##&}#5#9-t$'$7!$;.#!.  X +>m,ED_,M- (,?m,yy")),),M- ( 1uWrsN0ryy"))& > @IDJhDV 4 4Z @\efg\hktuvkw\wI8}q((1! y|(C )-)=)=j)I( (%#.EKEWvh/2668??A]^  !,.;J{+.E%eU3(K m-m-m-/w~7NPS7S1TTUm-:; m- tDf%&T#v+->(?? @ m-m-t#Xa-4f! Lf!ff!v, f! !L f! v, f!v,f!F|f!V f!v,f!f!/w~7NPS7S1TTUf!)*f! f!X)-(,)-)-'+Xa-4eV eLeV % e V % e f& ef&etF|$e/w~7NPS7S1TTUe)*e erOrelimitc,td|dty)NzEncountered more than aY detections in a single image. This means that certain detections with the lowest scores will be ignored, that may have an undesirable impact on performance. Please consider adjusting the `max_detection_threshold` to suit your use case. To disable this warning, set attribute class `warn_on_many_detections=False`, after initializing the metric.)r UserWarning)rs r$_warning_on_too_many_detectionsrJs" (K K  rO box_formatr coco_backendrGwarnc ddlm}ddg d|vr1t|d}|jdkDr |||d}| d<d|vrg}|d j j D]R} |j jtj| } |jt| d | d fTt| d <d tdtf fd } |r| ds| d rtd S)a.Convert and return the boxes or masks from the item depending on the iou_type. Args: iou_type: Type of input to process. Supported types are: - "bbox": Process bounding boxes - "segm": Process segmentation masks box_format: Input format of given boxes. Supported formats are: - 'xyxy': boxes are represented via corners, x1, y1 being top left and x2, y2 being bottom right. - 'xywh': boxes are represented via corner, width and height, x1, y2 being top left, w, h being width and height. - 'cxcywh': boxes are represented via centre, width and height, cx, cy being center of box, w, h being width and height. max_detection_thresholds: List of thresholds on maximum detections per image. Used to determine if warnings should be raised when the number of detections exceeds these thresholds. coco_backend: The COCO evaluation backend class type to use for processing the items. item: Input dictionary containing the boxes or masks to be processed, along with other detection information. warn: Whether to warn if the number of boxes or masks exceeds the max_detection_thresholds. Default is False. Returns: A tuple containing processed boxes or masks depending on the iou_type. The first element is the tensor representation, and the second element contains additional metadata if applicable. r) box_convertNrrxywh)in_fmtout_fmtrrrDrrJidxrc6|}|yt|dkDS)NFr)rA)rvalroutputs r$_valid_output_lenz0_get_safe_item_values.._valid_output_lens)Sk ;3x22666rOr)torchvision.opsrrNrKrnumpyrbencoderasfortranarrayrrrboolr) rrrrrGrrrrrFrler"r!s ` @r$_get_safe_item_valuesr)TsL,D\F "4=1 ;;=1 j&IEq  g""$**,A))001B1B11EFC LL%F ,c(m< =-%Lq 7s7t7  "1%):1)='(@(DE MrOrurpct|dkDst|dkDrBtj||zjj j SgS)Nr)rArrrrrrurps r$ _get_classesr,sS q C(:$;a$?yy),>>?FFHLLNUUWW IrOrqrrrsrtrvrwrxryrziou_thresholdsrec_thresholds class_metricsextended_summaryc |j||||||||| | |  \}}i}tjtj5| D]}t | dk(rdn|d}t | dkDr|j dD] }|d||d<t |jdk(st |jdk(r(|j|jd d gz|| |j||| }tj| tj |j_tj| tj |j_||j_|j%|j'|j)|j*}|j|j||| i}|r|dt-|j.tj0d|dt3j4|j6d|dt3j4|j6d|dt3j4|j6di}|j||r|j||||||||| | d \}}|j||| }tj| tj |j_tj| tj |j_||j_g}g}t9||D]}|g|j_tjtj5|j%|j'|j)|j*}ddd|j=t3j4dg|j=t3j4|dgt3j4|t2j> }t3j4|t2j> }nLt3j4dgt2j> }t3j4dgt2j> }t | dk(rdn|d}|j|d||d|dd|i ddd|jdt3j4t9||t2j@ i|S#1swYxxYw#1swYYxYw)N)ryrJrlrarea_rr g)rr)iouTyperiouscLtj|tjS)Nrrrs r$rz*_calculate_map_with_coco..s%,,qX]XeXeBfrO precisionrecallr(r{r+rr map_per_classr _per_classr)!rrrrrrArimgsupdaterrnrrfloat64paramsiouThrsrecThrsmaxDetsevaluate accumulate summarizerr r6ndarrayrrevalr,catIdsrrr) rrprqrrrsrtrurvrwrxrryr-r.rr/r0rr result_dicti_typeranno coco_evalrsummarymap_per_class_listmar_per_class_listclass_id class_statsmap_per_class_valuesmar_per_class_valuess r$_calculate_map_with_cocorTs&+==> J K  # #BKKM 2Fx=A-RfXQ:??#q(C 0@0@,AQ,F"" ;;dV FMe< )11+zSY1Z +-88N"**+U   (+-88N"**+U   (+C   (""$$$&##%!"" ;;fG_< #!($)<%NNBJJ8f*"(),ell9>>+;V.W!(&)5<< x8P+Q!(&)5<< x8P+Q G""7+!/;.M.M*'(*((%&( '/N /+J !- 5 5k:W] 5 ^I/1xxbjj/YI$$,/1xxbjj/YI$$,/GI$$,)+&)+&$0)9N`%4<* ((/'77 F%..0%002%//1*3//K G +11%,, A?O2PQ*11%,, A?O2PQ%,1<<8JRWR_R_+`(+0<<8JRWR_R_+`(+0<<EMM+R(+0<<EMM+R("8}1&|""!(-02F!($'?'C&DJOQek 3x5<< *:Oa bjojuju  5GFO 3 2s& L8U=T4 >D*U4T> 9UU )rFr)F).rrrcollections.abcrimportlib.metadatartypesrtypingrrrr r r r r$rrlightning_utilitiesr rtorchmetrics.utilitiesrtorchmetrics.utilities.importsrrr__doctest_skip__rr=rr'rHrNrSr rcrerrr)r,rrTr rOr$r]sF $&CCC 31 "=  U[ = Df% &= d3;' (=GN+U7>3JC3O-PPQ= =  =@fU[ GN+U7>3JC3O-PPQ  7> "C '( &g.O&P&UZ[aciku[uUv&4ood 34  =GN+U7>3JC3O-PPQ==#3i= = sCx. =  = 8F Xe_ ,-=@4<T&\VZ[^V_ CCV C&\C6l C V C 6l C6lC<CLC6lCGN+U7>3JC3O-PPQC% &CKCKC#3iC !C"#C$ #v+%CrO