iE bddlmZddlZddlmZddlmZmZmZm Z m Z m Z m Z m Z ddlZddlmZmZddlmZmZddlmZddlZGd d eZGd d Zd eefdZd eefdZdee e e fe fdee e e fe fdededef dZeZeD]ZejAey))EnumN)Path)DictListSetOptionalTextTupleTypeUnion) PreprocessorsProtocol)create_protocolget_init)DatabaseceZdZdZdZdZy) LoadingModerrN)__name__ __module__ __qualname__OVERRIDEKEEPERRORo/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/pyannote/database/registry.pyrr,sH D ErrceZdZdZddZej fdeee fdefdZ eje fdeee fded e e fd Zdefd Z dd eedefd ZdZdej fdedeee fdefdZdZy)RegistryzDatabase and experimental protocols registry Usage ----- >>> from pyannote.database import registry >>> registry.load_database("/path/to/first/database.yml") >>> registry.load_database("/path/to/second/database.yml") returnNc^t|_t|_t|_yN)dictconfigssources databases)selfs r__init__zRegistry.__init__qs$B*. 04v ,06rpathmodec\|j||t|jy)aLoad YAML configuration file into the registry Parameters ---------- path : str or Path Path to YAML configuration file. mode : LoadingMode, optional Controls how to handle conflicts in protocol names. Defaults to overriding the existing protocol. Usage ----- >>> from pyannote.database import registry >>> registry.load_database("/path/to/database.yml") r+loadingN)_load_database_helperset_reload_meta_protocols)r(r*r+s r load_databasezRegistry.load_databases'* ""4dCE"B ##%r database_ymlr.c2t|jj}||vry|j|t |d5}t j |t j}dddjdt}t|ts|g}|D]@}t|}|js|j|z }|j|||B|jdt}|jdd} | | |d<|j!D]\} } |j#| | |||jd t} | j!D]\} } t| ts| g} t}| D]F}t|}|js|j|z }|j%t'|H||j(t'| <||j*|<y#1swYxYw) aBHelper function for recursive loading Parameters ---------- database_yml : Union[Text, Path] Path to the database.yml mode : LoadingMode, optional Controls how to handle conflicts in protocol names. Defaults to overriding the existing protocol. Nr)Loader Requirementsr- ProtocolsXr+ Databases)r expanduserresolveaddopenyamlload SafeLoaderpoplist isinstance is_absoluteparentr/getr$items_load_protocolsappendstrr&r%)r(r3r+r.fconfig requirementsrequirement_yaml protocolsxdb_name db_entriesr'value path_listpr*s rr/zRegistry._load_database_helpers$L)446>>@  7 "   L!, $YYq9F%zz.$&9 ,-(>L , #$45 #//1#/#6#69I#I  & &'7dG & T !-JJ{DF3  MM#t $ =IcN$-??#4 GZ  *l N$5JJ{DF3 'oo/NGUeT*#'6IAw'')'..5D  T+  *3DLLW &0&, \"U% $s &H  Hc |j|}|di|S#t$r2|dk(r d}t|d}|j|}t|wxYw)zGet database by name Parameters ---------- database_name : str Database name. Returns ------- database : Database Database instance r9zCould not find any meta-protocol. Please refer to pyannote.database documentation to learn how to define them: https://github.com/pyannote/pyannote-databasezCould not find any protocol for "{name}" database. Please refer to pyannote.database documentation to learn how to define them: https://github.com/pyannote/pyannote-database)namer)r'KeyErrorformat ValueError)r( database_namekwargsdatabasemsgs r get_databasezRegistry.get_database s| "~~m4H$!&!!! "#DS/ ! Q jjmj4S/ ! "s ;A preprocessorsc|jd\}}}|j|}|j|||}||_|S)a]Get protocol by full name Parameters ---------- name : str Protocol full name (e.g. "Etape.SpeakerDiarization.TV") preprocessors : dict or (key, preprocessor) iterable When provided, each protocol item (dictionary) are preprocessed, such that item[key] = preprocessor(item). In case 'preprocessor' is not callable, it should be a string containing placeholder for item keys (e.g. {'audio': '/path/to/{uri}.wav'}) Returns ------- protocol : Protocol Protocol instance .)rb)splitra get_protocolrY)r(rYrbr] task_name protocol_namer_protocols rrfzRegistry.get_protocol-sR*37**S// y-$$]3(( }M)  rc#K|jD]J}|j|}|jD]$}|j|D]}|d|d|&Lyw)Nrd)r'ra get_tasks get_protocols)r(r]r_rgrhs r__iter__zRegistry.__iter__Ksd!^^M((7H%//1 %-%;%;I%FM*O1YKqHH&G2,sAArTc t|}t}|jD]A\}}|jD])\}} t|}t|||| |} | #| |||f<+C||jvr(|j|j } t || ||||jD cgc] \\} } }| | |f}} } }t|tft||d|j|<ycc}} } w)aLoad all protocols from this database into the registry. Parameters ---------- db_name : _type_ Name of the database db_entries : dict Dict of all entries under this database (this should be tasks) database_yml : Union[Text, Path], optional Path to the database.yml file. Not required for X protocols, by default None N)r) _protocols) rLr$rIrr'ro_merge_protocols_inplacetyperr)r(rSrTr3r+rQrg task_entriesriprotocol_entriesCustomProtocol old_protocolstaskp_namep_type protocol_lists rrJzRegistry._load_protocolsRs&g,486 '1'7'7'9 #I|.:.@.@.B**x=!0Y2BL"")3A 9h/0/C(: dnn $ NN73>>M $=$  BKAR AR'=~fvT66 "AR  #'  K!-0 J# w s4C6c |jjdd|jjD]J\}}|j dt }d|vs%|j d|d|tjLy)z>Reloads all meta protocols from all database.yml files loaded.r9Nr8r:) r'rCr%rIrHr$rJrr)r(db_ymlrNr's rr1zRegistry._reload_meta_protocolsss 3%"ll002NFF ;7Ii$$3k6J6J%3r)r!Nr#)rrr__doc__r)rrr r rr2rr0rr/rrarr rrfrmr$rJr1rrrr r gs62v(00&D$J&&6(,, U G,D$J'G,G,T G,R!"x!"H>B#+M#: <I+/'00 2 2 D$J' 2  2 h rr r!ctjjdd}g}|jdD]=}t |j }|j s-|j|?|S)zParse PYANNOTE_DATABASE_CONFIG environment variable PYANNOTE_DATABASE_CONFIG may contain multiple paths separation by ";". Returns ------- paths : list of Path List of all YAML database file defined in PYANNOTE_DATABASE_CONF PYANNOTE_DATABASE_CONFIG;)osenvironrHrerr<is_filerK)contentpathsr*s r_env_config_pathsrs_jjnn7 LL # Lrcg}tdj}|jr|j|tjdz }|jr|j||t z }|S)aGet paths to default YAML configuration files * $HOME/.pyannote/database.yml * $CWD/database.yml * PYANNOTE_DATABASE_CONFIG environment variable Returns ------- paths : list of Path List of existing default YAML configuration files z~/.pyannote/database.ymlz database.yml)rr<rrKcwdr)r home_db_yml cwd_db_ymls r_find_default_ymlsrspE12==?K [!n,J Z    E Lr new_protocolsrur+rSr3cz|jD]\}}||vr|\}}|d|d|} |tjk(rtd| d|d|tjk(rt j d| d|dn|tjk(st j d| d |d|||<|||<y ) aMerge new and old protocols inplace into the passed new_protocol. Warning, merging order might be counterintuitive : "KEEP" strategy keeps element from the OLD protocol and MODIFIES the new protocol. TODO: make it intuitive :) Parameters ---------- new_protocols : Dict[Tuple[Text, Text], Type] New protocol dict Maps (task,protocol) tuples to custom protocol classes old_protocols : Dict[Tuple[Text, Text], Type] Old protocols dict Maps (task,protocol) tuples to custom protocol classes. mode : LoadingMode How to handle override db_name : _type_ Name of the database (for logging/warning purposes) database_yml : str Path of the database.yml file (for logging/warning purposes) rdz Cannot load z protocol from 'z' as it already exists.zReplacing existing z! protocol by the one defined in 'z'.z Skipping z protocol defined in 'N)rIrr RuntimeErrorrwarningswarnr) rrur+rSr3p_idold_pt_namerwrealnames rrprps>%**, e = !NFF!!F81VH5H{(((""8*,<\NJab --- )(3TUaTbbde))) z)? ~Mde', d##(M$ 9-r)!enumrrpathlibrtypingrrrrr r r r r#pyannote.database.protocol.protocolr rcustomrrr_rr@rr rrrLrpregistryymlr2rrrrs> FFFG- $vkk\ 4:*DJ8;(dDj)4/0;(dDj)4/0;( ;( ;(  ;(~ :  C 3 r