iz=dZddlmZddlZddlmZddlmZddl Z ddl m Z ddl m Z mZmZmZmZddlZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZmZedDcic]}|j@|c}Z!de dedeegeffdZ"dZ#dededefdZ$de de de dededef dZ%dedede&fdZ' d*d e d!e d"e d#ededef d$Z( d*d e d!e d"e d#ededef d%Z)d&Z*d e d!e d"e fd'Z+d e d!e d"e d(ededee,dff d)Z-ycc}w)+zCustom protocols Protocols: MyDatabase: Collection: MyProtocol: train: uris: xxx.lst annotation: xxx.rttm annotated: xxx.uem )PathN)protocol ProtocolFile)Number)TextDictCallableAnyUnion)Subset)SegmentationProtocol)SpeakerDiarizationProtocol) entry_points) get_annotated)load_lst load_trialzpyannote.database.loader)grouptemplate database_ymlreturnct}|jtvrd|jd}t|t|jj dt ffd }|S)afGet data loader based on template Parameters ---------- template : str Path format template (e.g. "/path/to/{uri}.csv"). Extension (here ".csv") determined which data loader to use. database_yml : Path Path to YAML configuration file, to which `template` is relative. Defaults to assume that `template` is absolute or relative to current working directory. Returns ------- data_loader : Callable[[ProtocolFile], Any] Callable that takes a ProtocolFile and returns some data. See also -------- pyannote.database.loader zNo loader for files with '' suffix current_filec ttjdit|}|j sd|dd}t ||}||S)NNo such file or directory: 'z' (via 'z ' template).) resolve_pathrformatabsis_fileFileNotFoundError)rpathmsgloaderLoaderrrs m/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/pyannote/database/custom.pyloadzTemplate..loadjseD!E3|3D!EF U||~0hxj UC#C( (l##)rsuffixLOADERS ValueErrorr)r)rrr$r%r)r's`` @r(Templater.Ls`. >D {{'!*4;;-x@o T[[ ! & & (F $< $ Kr*c dtffd }|S)NrcSNr)rvalues r(r)zNumericValue..loadys r*r)r2r)s` r( NumericValuer3xs< Kr*r$c|j}|jr|S|j|z }|jr|Sd|d}t|)aVResolve path Parameters ---------- path : `Path` Path. Can be either absolute, relative to current working directory, or relative to `database_yml` parent directory. database_yml : `Path` Path to YAML configuration file. Returns ------- resolved_path: `Path` Resolved path. zCould not find file "z".) expanduserr"parentr#)r$r relative_pathr%s r(rr~s[" ?? D ||~ %++d2  " !$r *C C  r* meta_database meta_task meta_protocol meta_subsetsubset_entriesc#Kddlm}|jD]<\}}|j|} |D]!} | d} t | | D]} | #>yw)a8Meta-protocol method that iterates over a subset Parameters ---------- meta_database : str "X" meta_task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) meta_protocol : str Protocol name (e.g. MyProtocol) meta_subset : {"train", "development", "test"} Subset subset_entries : dict Subset entries. Etape.SpeakerDiarization.TV: [train] REPERE.SpeakerDiarization.Phase1: [train, development] REPERE.SpeakerDiarization.Phase2: [train, development] r)registry_iterN)r>items get_protocolgetattr) r8r9r:r;r<rr>rsubsetspartial_protocolsubset method_namefiles r(meta_subset_iterrIsg8+113'#00:F#HE*K> 0+>@ A4sAAentriesct}|jD]P\}}|dk(s|dk(rt|trt |||<1t t jj|\}}}}tt|tdgz dkD}|r=|jdrd}tj||dd}t||||<tt!||} | j#sd| d }t%|| j&t(vrd | j&d }t+|t(| j&j-} | | ||<S|S) aLoads all Loaders for data type specified in 'entries' into a dict. Parameters ---------- entries : Dict, optional Subset entries (eg 'uri', 'annotated', 'annotation', ...) database_yml : Path, optional Path to the 'database.yml' file Returns ------- dict A dictionary mapping each key of entry (except 'uri' and 'trial') to a function that given a ProtocolFile returns the data type related to this entry. uritrialNr_zSince version 4.1, pyannote.database is smart enough to know when paths defined in 'database.yml' contains placeholders. Remove the underscore (_) prefix to get rid of this warning.rr'zNo loader for file with 'r)dictrA isinstancerr3zipstring Formatterparselenset startswithwarningswarnr.rrr"r#r+r, TypeErrorr)) rJr lazy_loaderkeyr2rN placeholders is_templater%r$r's r(gather_loadersr`sn(&Kmmo U %<3'>  eV $+E2K  !$V%5%5%7%=%=e%D E<A#l+c4&k9:Q> $S  c"ab '|4TF!<',,{{')1$++hGn$T[[)..0F &d|K k&l r*databasetaskrrFc +LKd|vr|d}nOd|vr2|d}d|d|d|d|d|d } tj| tnd|d|d|d|} t| t t t ||} t||} | D]}t|||d || y w) a  Parameters ---------- database : str Database name (e.g. MyDatabase) task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) protocol : str Protocol name (e.g. MyProtocol) subset : {"train", "development", "test"} Subset entries : dict Subset entries. database_yml : `Path` Path to the 'database.yml' file metadata : dict Additional metadata to be added to each ProtocolFile (such as "scope" or "classes") rLurisz!Found deprecated 'uris' entry in .z+. Please use 'uri' (singular) instead, in 'z'.z!Missing mandatory 'uri' entry in rJrrLrarFlazyN) rYrZDeprecationWarningr-rrrr`r) selfrarbrrFrJrmetadatarLr%rdr\s r( subset_iterrms> en 7 fo/z4&(1VHU88D~R I   c-.2(1TF!H:QvhWo LcL9 :D |LKX L8 LS^  sB"B$c #jKt||}t|d<t}tt t |d|D]k} | d| d} } | |vr#|j t| ||d||| <| |vr#|j t| ||d||| <| d|| || d my w) a Parameters ---------- database : str Database name (e.g. MyDatabase) task : str Task name (e.g. SpeakerDiarization, SpeakerVerification) protocol : str Protocol name (e.g. MyProtocol) subset : {"train", "development", "test"} Subset entries : dict Subset entries. database_yml : `Path` Path to the 'database.yml' file rftry_withrMuri1uri2rgrh reference)rrfile1file2N)r`rrPrrr preprocessr) rkrarbrrFrJrr\filesrMrprqs r( subset_trialrwIs6!|LK+K '+fELgg.>)?NO6]E&Md u // h&I$E$K u // h&I$E$K{+4[4[  %PsB1B3cfd}|S)Ncbt|j| D]}|j|yr1)super __class____init__register_protocol)rkr protocolss r(initzget_init..inits. dnnd,.!H "D " "H -"r*r)r~rs` r(get_initrs. Kr*c|d|d|S)N__r)rarbrs r(get_custom_protocol_class_namersZr$r( ,,r*protocol_entriesc tt|dk(rdn|d}|dk(rd |i}t }t |t rd |vr|jd |d <t |tr>|jd d}|%|d k7r d |d|d|d|d }t|d|d <n||d <t } |jD]\} } | dvr+d|d|d|d| d|d| d }tj|5| d} |d k(r#tjt|||| | || | <btjt f|||| | |d|| | <d| j#vstjt$|||| | || | d<t'|||} t)| |f| }|t+| <|S#t$rd|d|d|d|d }t|YywxYw)zCreate new protocol class Parameters ---------- database : str task : str protocol : str protocol_entries : dict Returns ------- CustomProtocol : type or None Protocolz Ignoring 'rez' protocols found in z because 'z' tasks are not supported yet.N CollectionrvclassesscopeXrOz ' found in za does not define the 'scope' of speaker labels (file, database, or global). Setting it to 'file'.rH)rvtrain developmenttest train_trialdevelopment_trial test_trialz ' entries are not supported yet.r?)rarbrrFrJrrM_trial)rCprotocol_moduleAttributeErrorprintrP issubclassrpoprrArYrZ functoolspartialrI partialmethodrmkeysrwrtypeglobals)rarbrrr base_classr%rlrmethodsrFr<rGcustom_protocol_class_nameCustomProtocolClasss r(create_protocolrs.  4:+=ZdV8CT , |#%56vH*23 ( ("2"6"6y"AHY *89 $$Wd3 =X_H:QtfAhZ{<.Icd  #J &HW !&HW fG"2"8"8":   XJavQxj&\N["8#CE  MM#  & s?#,#4#4 $GK $-#:#: $!!&) $ $GK .--//-6-D-D %%!*!-.6(&)*W#;l"@$"9J='R,?GI() M  !D6)>|nMv; =  c  sF**#GG)NNNNNN).__doc__pathlibrrSr@rr#pyannote.database.protocol.protocolrrYnumbersrtypingr r r r r rprotocol.protocolrprotocol.segmentationrprotocol.speaker_diarizationrimportlib.metadatarutilrr&rrnamer,r.r3rrIrPr`rmrwrrrr)eps0r(rs-B  *<33%7D+( !;< <GGRK<  )t)4)Hl^S=P4Q)X !t!4!D!>#### #  #  #LL LL Lb5 5  5  5  5  5 5 r8 8  8  8  8  8 8 v-T---BB BB B  B  4: BW  s&D