+ LV-jF;^RIHt^RIt^RIHt^RIHt^RIHt^RI Ht ^RI H t H t HtHtHtHtHt^RIHt^RIHt^R IHtHtHtHtHtR R ltR R lt]!4RRl4t]!4RRl4t ]!]R7RRl4t!R"RRllt"RRlt#RRlt$RRlt%RRlt&]!RR7R#R R!ll4t'R#)$) annotationsN)IncrementalDecoder)Counter) lru_cache) FREQUENCIESKO_NAMESLANGUAGE_SUPPORTED_COUNTTOO_SMALL_SEQUENCEZH_NAMES_FREQUENCIES_SET_FREQUENCIES_RANK) is_suspiciously_successive_range)CoherenceMatches)is_accentuatedis_latinis_multi_byte_encodingis_unicode_range_secondary unicode_rangec V^8dQhRRRR/# iana_namestrreturn list[str])formats"f/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/charset_normalizer/cd.py __annotate__rs$$c$i$c\V4'd \R4h\P!RV 24PpV!RR7p/p^p\ ^@^4FqpVP \V.44pV'gK(\V4pVfK9\V4RJgKJWs9d^W7&W7;;,^, uu&V^, pKs \VUu.uFpW7,V, R8gKVNK up4#uupi)z> Return associated unicode ranges in a single byte code page. z.Function not supported on multi-byte code pagez encodings.ignore)errorsFg333333?) rOSError importlib import_modulerrangedecodebytesrrsorted)rdecoderp seen_rangescharacter_countichunkcharacter_ranges& rencoding_unicode_ranger2si(( <  %% 9+&>?RRG#84A"$KO 4 XXeQCj) 5*7*>O&)/:eC"534K0,1,1$ $/ #.+o=E O#.   s C?2C?c V^8dQhRRRR/#)r primary_rangerrrr)rs"rrrDs  3 9 r c.p\P!4F2wr#VF'p\V4V8XgKVPV4K0 K4 V#)z6 Return inferred languages used with a unicode range. )ritemsrappend)r4 languageslanguage characters characters& runicode_range_languagesr<DsOI + 1 1 3#IY'=8  *$!4 r c V^8dQhRRRR/#rr)rs"rrrTs22#2)2r ch\V4pRpVFpRV9gK TpM VfR.#\V4#)z Single-byte encoding language association. Some code page are heavily linked to particular language(s). This function does the correspondence. NLatin Latin Based)r2r<)runicode_rangesr4specified_ranges& rencoding_languagesrCSsH !7y AN $M) / )+M *  "= 11r c V^8dQhRRRR/#rr)rs"rrrhsSYr c8VPR4'g6VPR4'gVPR4'gVR8XdR.#VPR4'g V\9dR.#VPR4'g V\9dR .#.#) z Multi-byte encoding language association. Some code page are heavily linked to particular language(s). This function does the correspondence. shift_ iso2022_jpeuc_jcp932JapanesegbChinese iso2022_krKorean) startswithr r)rs&rmb_encoding_languagesrPgs X&&    - -    ( (  |D!!Y(%:{L))Y(-Bz Ir )maxsizec V^8dQhRRRR/#)rr9rrztuple[bool, bool]r)rs"rrr}s 2 2# 2*; 2r cRpRp\V,F;pV'g\V4'dRpV'gK(\V4RJgK9RpK= W3#)z_ Determine main aspects from a supported language if it contains accents and if is pure Latin. FT)rrr)r9target_have_accentstarget_pure_latinr;s& rget_target_featuresrV|sX !&" ** "~i'@'@"&   )!4!= %  +  11r c$V^8dQhRRRRRR/#)rr:rignore_non_latinboolrr)rs"rrrs)III-1IIr c.p\V4p\;QJdRV4F 'gK RM RM !RV44p\P!4F}wrV\ V4wrxV'd VRJdK"VRJd V'dK2\ V4p \ \ V,V,4p W, p V R8gKkVPW[34K \VRRR7pVU u.uF q^,NK up #uup i)z= Return associated languages associated to given characters. c38"TFp\V4xK R#5i)N)r).0r;s& r %alphabet_languages..sTInY77sTFg?cV^,#rxs&r$alphabet_languages..s!r keyreverse) frozensetanyrr6rVlenr r7r*) r:rXr8characters_setsource_have_accentsr9language_charactersrTrUr.character_match_countratiocompatible_languages && ralphabet_languagesrrs *,I%.z%:N#TT###TTT)4):):)<%1DX1N.  1U :  % ',? "#67%()9()Cn)T%U,> C<   h. /!*=$yndCI>G Hi': " "i HH Hs+C?c$V^8dQhRRRRRR/#)rr9rordered_charactersrrfloatr)rs"rrrs)b>b>b>'0b> b>r cV\9d\V R24h^p\V,p\V,p\ V4p\ \V,4pV^8pWe, p\ V4U U u/uFwrWbK p p p VP 4U U u.uFwrW9gK WV ,3NK pp p \ V4pVUu.uF pV^,NK ppVUu.uF pV^,NK pp\V\^V44EFCwppVV9dKVV,p\VV,4pVRJd\VV, 4^8dKJVRJd*\VV, 4V^, 8d V^, pKy^p^p\V4FBpVV,pVV,pVV8dVV8d V^, pK.K0VV8gK9V^, pKD VV, pV^8XdV^8:d V^, pKV^8XdV^8:d V^, pEK V^8dVV, R8gV^8gEK)VV, R8gEK:V^, pEKF V\ V4, #uup p iuup p iuupiuupi)a> Determine if a ordered characters list (by occurrence from most appearance to rarest) match a particular language. The result is a ratio between 0. (absolutely no correspondence) and 1. (near perfect fit). Beware that is function is not strict on the match in order to ease the detection. (Meaning close match is 1.) z not availableFTg?) r ValueErrorr r rk enumerater6zipr'intabs)r9rtcharacter_approved_countfrequencies_language_set lang_rankordered_characters_count target_language_characters_countlarge_alphabetexpected_projection_ratiorankchar ordered_rankclr common_chars common_countr, common_lr common_orrr;character_rankcharacter_rank_in_languagecharacter_rank_projectionbefore_match_countafter_match_countr/lr_iorr_i after_lens&& rcharacters_popularity_comparers{"H:^455$%/?/I 1( ;I$'(:$;,/ H0E,F$;b@N )C &//A%B$%Bzt %B$,5??+<++<%!@Q!_+<+L)L*67,QAaDD,I7+78&! > 4 4 *3I*>"),^>W-W)X! e #-0JJKaO  d "-0JJK.23 % ) $  #$!"|$A!! D#AE00>)&!+&*N*%*%%:/14 $ ) $  ' *"%??3F!m 1I = D $ ) $ m&p $c*<&= ==S$ +88s2 I  I&$I&I,I1c V^8dQhRRRR/#)rdecoded_sequencerrrr)rs"rrrs"GAGA#GA)GAr cJ/pRpRpRpRpVFpVP4RJdK\V4pV^8dRpM \V4pVfK?W8XdVeW,PV4KbRp V'dVFp \ W4RJgKT p M MVe\ W(4RJdTp V fTp W9d.W&VfT pMRpW,PV4TpT pK VP 4U u.uF"p RP V 4P4NK$ up #uup i)z Given a decoded text sequence, return a list of str. Unicode range / alphabet separation. Ex. a text containing English/Latin with a bit a Hebrew will return two items in the resulting list; One containing the latin letters and the other hebrew. NFz Basic LatinT)isalphaordrr7rvaluesjoinlower) rlayerssingle_layer_key multi_layerprev_character_rangeprev_layer_targetr; character_ordr1layer_target_rangediscovered_rangecharss & ralpha_unicode_splitrs] $&F$(K(,$(%    % ' !^ 3 *7O+I6O  "   2 ,)00; )- $* 45EW*:& %+ )01AS&6"  %!0   +)+F &'#5 " ")))4 /.i&l17  @uBGGEN " @@ @s5(D c V^8dQhRRRR/#)rresultszlist[CoherenceMatches]rrr)rs"rrr^s;;$:;?O;r c &/pVF4pVF+pVwrEWA9dV.W&KW,PV4K- K6 VUu.uF6pV\\W,4\W,4, ^43NK8 pp\ VRRR7#uupi)z This function merge results previously given by the function coherence_ratio. The return type is the same as coherence_ratio. cV^,#r`rrbs&rrd(merge_coherence_ratios..wsqtr Trf)r7roundsumrkr*)rper_language_ratiosresult sub_resultr9rpmerges& rmerge_coherence_ratiosr^s 35 J(OH216#-  ) 0 0 7 ! , ,H  '12S9L9V5WW  ,  %^T :: s.s .sQqTr rf) splitremoverr most_commonrkr rrrr7rr*r)rrrrrXsufficient_match_countlg_inclusion_listlayersequence_frequenciesrr.ropopular_character_orderedr9rps&&& rcoherence_ratiors2(*G""#3?3K **3/QS))  /$%5618*668 "5z 0 0 >I/Jkdak!/J)  -? %.  H9E #&!+& NNHeE1o6 7%* 78 $W->4 '0Ks> D)F)g?N)( __future__rr%codecsr collectionsr functoolsrtyping TypeCounterconstantrrr r r r r mdrmodelsrutilsrrrrrr2r<rCrPrVrrrrrrrrr rrs"%)1$$N  2 2&  ( +, 2- 2 IDb>JGAT;86 400r