+ LV-j`a0t$^RIHt^RIt^RIHt^RIHt^RIH t H t H t H t ^RI HtHtHtHtHt^RIHt^RIHtHt^R IHtHtHtHtHtHt]P>!R 4t ]PB!4t"]"PG]PH!R 44.t%R ]&R &.t'R ]&R&]F6t(]!](4'd]%PS](4K%]'PS](4K8 ]%]',t+R ]&R&RRRllt,RRRllt-RRRllt.RRRllt/R# ]*d]'PS](4Ki;i)) annotationsN)PathLike)BinaryIO)coherence_ratioencoding_languagesmb_encoding_languagesmerge_coherence_ratios)IANA_SUPPORTEDIANA_SUPPORTED_SIMILARTOO_BIG_SEQUENCETOO_SMALL_SEQUENCETRACE) mess_ratio) CharsetMatchCharsetMatches)any_specified_encodingcut_sequence_chunks iana_nameidentify_sig_or_bomis_multi_byte_encodingshould_strip_sig_or_bomcharset_normalizerz)%(asctime)s | %(levelname)s | %(message)sz list[str] _mb_supported _sb_supportedIANA_SUPPORTED_MB_FIRSTcDV^8dQhRRRRRRRRRR R R R R R R RRRR RR/ #) sequenceszbytes | bytearraystepsint chunk_size thresholdfloat cp_isolationlist[str] | None cp_exclusionpreemptive_behaviourboolexplainlanguage_thresholdenable_fallbackreturnr)formats"g/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/charset_normalizer/api.py __annotate__r09sd d  d  d d  d  # d  # d d d d d d c #\V\\34'g$\RP \ V444hV'dC\ Pp \ P\4\ P\4\V4p V ^8Xdf\ PR4V'd/\ P\4\ PX 4\\!VRRR.R4.4#VeG\ P#\RR P%V44VU u.uFp \'V R4NK pp M.pVeG\ P#\R R P%V44VU u.uFp \'V R4NK pp M.pWV,8:d"\ P#\R VVV 4^pT pV^8dW, V8d\)W, 4p\V4\*8p \V4\,8pV 'd+\ P#\R P V 44M1V'd*\ P#\R P V 44.pV'd \/V4MRpVe-VP1V4\ P#\RV4\34p.p.p\34p\34p/pRp\34p^p^pRpRpRpRp\4p\4p \5V4wp!p"V!e7VP1V!4\ P#\R\V"4V!4VP1R4RV9dVP1R4V\6,E F~p#V'd V#V9dKV'd V#V9dK&V#V9dK/VP9V#4Rp$V!V#8Hp%T%;'d \;V#4p&V#RA9d&V%'g\ P#\RV#4KV#RB9d&V%'g\ P#\RV#4KV#V9d\ P#\RV#4KV#V9d\ P#\RV#4K\=V#4p'T'diT''g\3\CT#44p(M\3\ET#44p(T(PGT4'g!\ P#\RT#T(T4EKxT'd0T''g(TT8d!\ P#\RT#TT4EKT'd'T''g\ P#\RT#4EKT'd>T'RJd8\IT&RJdTR\)R4MT\T"4\)R4T#R7M^T#R8Xd6T%'d.\ITT#R7p$T$'dT$^,R8Xd T$R,p$M"\IT&RJdTM T\T"4RT#R7p$\OT%'g^M \T"4T \)Y, 44p*T';'dT$RJ;'d\T$4T 8p+T+'d\ P#\R!T#4T$EeGT''Eg>\QT$4p,TPST,4p-T-EeT-wp.p/p0T0'Ed\!TT#T.T%T/TRJg T#TRR39dT$MRTR"7p1TP1T14TP9T#4\ P#\R#T#\UT.^d,^R$74T#TRR39dT.R%8d}T.R8Xde\ PR&T1PV4T'd/\ P\4\ PX 4\T1.4u#T P1T14\T 4'dTeTT9dRT9d|RT9duT PY4p2\ PR&T2PV4T'd/\ P\4\ PX 4\T2.4u#EKTP1T#4\ P#\R'T#4T 'd5T#RRTRR39d)\!TT#TT%.T$TR"7p3T#T8XdT3pM T#R8XdT3pMT3pEKB\)\T*4^, 4p4\[T4^4p4^p5Rp6.p7.p8\]TT#T*TT%T&T"T'T$4 Fp9T7P1T94T8P1\_T9TTR(J;'d ^\T4u;8*;'d^8*Mu44T8RC,T8d T5^, p5T5T48gT%'gKT&RJgKM T6'g1T'd)T''g!T\)R*4RPaT#R+R,7T8'd\cT84\T84, MRp:T:T8gT5T48dTP1T#4T#\d9dTPg\dT#,4T$e'T''gTPi\QT$4T:.R34\ P#\R.T#T5\UT:^d,^R$74T 'd=T#RRTRR39d1T6'g)\!TT#TT%.T$TR"7p3T#T8XdT3pM T#R8XdT3pMT3pEKV\ P#\R/T#\UT:^d,^R$74T''g \CT#4p;M \ET#4p;T;'d4\ P#\R0P T#\IT;444.pM \mT<4p>T>'d+\ P#\R2P T>T#44\!TT#T:T%T>TRJg T#TRR39dT$MRTR"7p?TP1T?4T$e'T''gTPi\QT$4T:T>R(34T'dT''gT:R38d T^, pT#TRR39dT:R%8d}T:R8Xde\ PR&T?PV4T'd/\ P\4\ PX 4\T?.4u#T P1T?4\T 4'dTeTT9dRT9d|RT9duT PY4p2\ PR&T2PV4T'd/\ P\4\ PX 4\T2.4u#T'glT''gdT>'d\[R4T>4RR57MRp@T@R68d?RT9d8RT9d1R(pTPgT;4\ P#\R7T#T:X@4T'gT''dzT+'drT$en\T$4T R8,8dWT#RD9dPRT9dIRT9dBR(p\ P#\R9T#T:\T$4T \T$4T , ^d,4T#T!8XgE K \ PR:T#4T'd/\ P\4\ PX 4\TT#,.4u# \V4^8XdV'gV'g V'd\ P#\R;4V'd3\ PR4VP1V4V'dA\ PR?VPY4PV\V4^, 4M\ PR@4V'd/\ P\4\ PX 4V#uup iuup i \>\@3d!\ P#\RT#4E K^i;i \J\L3dYp)\T)\L4'g&\ P#\R T#\IT)44TP1T#4Rp)?)E KRp)?)ii;i \Jd5p)\ P#\R)T#\IT)44T4p5R(p6Rp)?)ELRp)?)ii;i \JdCp)\ P#\R-T#\IT)44TP1T#4Rp)?)EKXRp)?)ii;i)Ea2 Given a raw bytes sequence, return the best possibles charset usable to render str objects. If there is no results, it is a strong indicator that the source is binary/not text. By default, the process will extract 5 blocks of 512o each to assess the mess and coherence of a given sequence. And will give up a particular code page after 20% of measured mess. Those criteria are customizable at will. The preemptive behavior DOES NOT replace the traditional detection workflow, it prioritize a particular code page but never take it for granted. Can improve the performance. You may want to focus your attention to some code page or/and not others, use cp_isolation and cp_exclusion for that purpose. This function will strip the SIG in the payload/sequence every time except on UTF-16, UTF-32. By default the library does not setup any handler other than the NullHandler, if you choose to set the 'explain' toggle to True it will alter the logger configuration to add a StreamHandler that is suitable for debugging. Custom logging format and handler can be set manually. z3Expected object of type bytes or bytearray, got: {}zTrying to detect encoding from a tiny portion of ({}) byte(s).zIUsing lazy str decoding because the payload is quite large, ({}) byte(s).z@Detected declarative mark in sequence. Priority +1 given for %s.zIDetected a SIG or BOM mark on first %i byte(s). Priority +1 given for %s.asciiutf_16utf_32z\Encoding %s won't be tested as-is because it require a BOM. Will try some sub-encoder LE/BE.utf_7zREncoding %s won't be tested as-is because detection is unreliable without BOM/SIG.zY%s is deemed too similar to a code page that was already considered unsuited. Continuing!zESkipping %s: already fast-tracked from a similar successful encoding.z2Encoding %s does not provide an IncrementalDecoderzbSkipping %s: definitive match already found, this encoding targets different languages (%s vs %s).zXSkipping %s: already accumulated %d same-family results after definitive match (cap=%d).zCSkipping single-byte %s: multi-byte definitive match already found.gA)encodingu:NNz9Code page %s does not fit given bytes sequence at ALL. %szpCode page %s is a multi byte encoding table and it appear that at least one character was encoded using n-bytes.)preemptive_declarationzM%s fast-tracked (identical decoded payload to a prior encoding, chaos=%f %%).)ndigits皙?z.Encoding detection: %s is most likely the one.zZ%s fast-skipped (identical decoded payload to a prior encoding that failed chaos probing).TzaLazyStr Loading: After MD chunk decode, code page %s does not fit given bytes sequence at ALL. %sgj@strict)errorsz^LazyStr Loading: After final lookup, code page %s does not fit given bytes sequence at ALL. %szc%s was excluded because of initial chaos probing. Gave up %i time(s). Computed mean chaos is %f %%.z=%s passed initial chaos probing. Mean measured chaos is %f %%z&{} should target any language(s) of {},z We detected language {} using {}g{Gz?c3*"TF wrVxK R#5i)Nr-).0_vs& r/ from_bytes..s4#341Q#3s)defaultg?zyDefinitive match found: %s (chaos=%.3f, coherence=%.2f). Encodings targeting different language families will be skipped.g\(\?zjMulti-byte definitive match: %s (chaos=%.3f, decoded=%d/%d=%.1f%%). Single-byte encodings will be skipped.zoEncoding detection: %s is most likely the one as we detected a BOM or SIG within the beginning of the sequence.zONothing got out of the detection process. Using ASCII/UTF-8/Specified fallback.z7Encoding detection: %s will be used as a fallback matchz:Encoding detection: utf_8 will be used as a fallback matchz:Encoding detection: ascii will be used as a fallback matchz]Encoding detection: Found %s as plausible (best-candidate) for content. With %i alternatives.z=Encoding detection: Unable to determine any suitable charset.>r6r7>r8> r8r3r6r7 utf_16_be utf_16_le utf_32_be utf_32_le utf_8_sig)8 isinstance bytearraybytes TypeErrorr.typeloggerlevel addHandlerexplain_handlersetLevelrlendebug removeHandlerrrlogjoinrr r r rappendsetrraddrrModuleNotFoundError ImportErrorrr intersectionstrUnicodeDecodeError LookupErrorrangehashgetroundr9bestmaxrrdecodesumr update setdefaultrr fingerprint)Arrr!r"r$r&r'r)r*r+previous_logger_levellengthcpis_too_small_sequenceis_too_large_sequenceprioritized_encodingsspecified_encodingtestedtested_but_hard_failuretested_but_soft_failuresoft_failure_skipsuccess_fast_trackedpayload_result_cachedefinitive_match_founddefinitive_target_languages post_definitive_sb_success_countPOST_DEFINITIVE_SB_CAPmb_definitive_match_foundfallback_ascii fallback_u8fallback_specifiedresultsearly_stop_results sig_encoding sig_payload encoding_ianadecoded_payloadbom_or_sig_availablestrip_sig_or_bomis_multi_byte_decoder enc_languageser_multi_byte_bonus payload_hashcached cached_mess cached_cd cached_passed fast_matchprobable_resultfallback_entrymax_chunk_gave_upearly_stop_countlazy_str_hard_failure md_chunks md_ratioschunkmean_mess_ratiotarget_languages cd_ratioschunk_languagescd_ratios_merged current_matchbest_coherencesA&&&&&&&&&& r/ from_bytesr9sb< i)U!3 4 4 A H HY   %+\\/*i.F { ST    1 OO1 2|IwUBPRSTUU  5 IIl #  8DD| "e,| D    6 IIl #  8DD| "e,| D   u$%  l       qyV^j0( "%i.3E"E"%i.4D"D  L S S    W ^ ^  (*.By)t%$$%78  N  uF)+)+"%%%(U TV$),/E -.$"#',*.N'+K.2,.G)7)9 3I >L+$$\2  W       )++$$W-.1HHH M=  M\9  F "  =!&*%1]%B!5" " :Q ;  0 09M JJn   I %.B JJd   - - JJk   0 0 JJW   *@*O ! "( #$6}$E F #$9-$H I  --.IJJ x!!/  #)04JJ JJj0&    %-B JJU  * $)>%)G,u4"+CI.&s;'7#d)D* !G+0D&)!!.'O'?1+=+I*9"*=&) 058&!*3{+;+=!>!. 'O&)As;/?     " . .t+ . .O$v-   JJ-    &/D/D $_ 5L)--l;F!8>5 Y  =!-!%#,!!6 >#0$6#I$J, "&/A"J"NN:.(,,];JJg%kC/; &*>1?.*g5-;N*8K!$SWq[!1 115 ! %!  ' ),$ %   '  !4GGA\1B,G,Ga,GR=I-$)$$(99((-=-F7 V&%) #d)+&--mH-MENY#i.!@SV i '+;?P+P # * *= 9 66!(()? )NO*3H$//)OR+G JJ0 o+Q7   !W&8(HMN-!-!(#+="!$66)7&"g-%3N"0K   K  /C' 3  %*<]*K 4]C   JJ8??!3'7#8   G ##"1&2BCHH-.#   1# 6i@ 5i@   JJ299$m %    *U2$);Wg(NN #5 " }%  &/D + +_% "2D9  #)$& , 1 , 0'7C C#%#% D!**((9OO$9:%}o66  % %m 4 " # ##+/AV/K6!6!0557O LL@(( $$_5 56!?"34 4&.C$4#34cB  $F):w&?P)-&+223CD P!#" *% +O$v}4  6!6!(, % JJ|O$O$v-3  L ( LL1  $$_5 56!7=#9":; ;IIL 7|q .,> JJa   LLI"++  NN- . ^3"++~/I/II' LLU V NN; '  LLU V NN> * k LLN # # L1   TU_--. NUEEL$[1  JJD    t#K0 a-- O!F  $ * *= 9  X  ) JJsA   1 $( ! )*&  t!F  (..}= s3AB,?AB1 AB6&AC*.A AEAEAEAE4AFB6,AC'C&AC'C*AEC;A AEEAEE AFE!)AFFAFF AG%F#6AG G AG%cDV^8dQhRRRRRRRRRR R R R R R R RRRR RR/ #)rfprrr r!r"r#r$r%r&r'r(r)r*r+r,rr-)r.s"r/r0r0`sv   #  # r1c F\VP4VVVVVVVVV 4 #)zz Same thing than the function from_bytes but using a file pointer that is already ready. Will not close the file pointer. )rread) rrr!r"r$r&r'r)r*r+s &&&&&&&&&&r/from_fpr`s5      r1cDV^8dQhRRRRRRRRRR R R R R R R RRRR RR/ #)rpathzstr | bytes | PathLikerr r!r"r#r$r%r&r'r(r)r*r+r,rr-)r.s"r/r0r0~sv       #  #       r1c \VR4;_uu_4p \V VVVVVVVVV 4 uuRRR4# +'giR#;i)z Same thing than the function from_bytes but with one extra step. Opening and reading given file path in binary mode. Can raise IOError. rbN)openr) rrr!r"r$r&r'r)r*r+rs &&&&&&&&&& r/ from_pathr~sH dD  R               s 4 A cDV^8dQhRRRRRRRRRR R R R R R R RRRR RR / #)rfp_or_path_or_payloadz!PathLike | str | BinaryIO | bytesrr r!r"r#r$r%r&r'r(r)r*r+r,r-)r.s"r/r0r0sv??<? ?? ? # ? # ????? ?r1c \V\\34'd\VVVVVVVVVV R7 p V '*#\V\\ 34'd\ VVVVVVVVVV R7 p V '*#\VVVVVVVVVV R7 p V '*#)a Detect if the given input (file, bytes, or path) points to a binary file. aka. not a string. Based on the same main heuristic algorithms and default kwargs at the sole exception that fallbacks match are disabled to be stricter around ASCII-compatible but unlikely to be a string. ) rr!r"r$r&r'r)r*r+)rNrcrrrPrOrr) rrr!r"r$r&r'r)r*r+guessess &&&&&&&&&& r/ is_binaryrs"'#x99 !!%%!51+  Z;C       !!%%!51+  4; !!%%!51+  ;r1) 皙?NNTFr=T) rrrNNTFr=F)0__conditional_annotations__ __future__rloggingosrtypingrcdrrrr constantr r r r rmdrmodelsrrutilsrrrrrr getLoggerrS StreamHandlerrV setFormatter Formatterr__annotations__r_supported_encr]rarrrrr)rs@r/rs"" 0   / 0'') AB y y$N- !. 1 1   0   0 %&3]%BBd N< >??U -^,-s+D DD-,D-