+ QV-j :X^RIt^RIHt^RIHt^RIHtHtHtH t H t H t H t H t HtHtHtHtHtHtHtHtHtHtHtHtHtHtHtHtHt^RIH t ^RI!H"t"^RI#H$t$^RI%H&t&^R I'H(t(^R I)H*t*^R I+H,t,^R I-H.t.^R I/H0t0^RI1H2t2^RI3H4t4^RI5H6t6^RI7H8t8^RI9H:t:^RI;Ht>^RI?H@t@^RIAHBtB^RICHDtD^RIEHFtF^RIGHHtH^RIIHJtJ^RIKHLtL^RIMHNtN^RIOHPtP/R]&bR]*bR ],bR!]bR)]@bR*].bR+]2bR,]NbR-](bR.]PbR/]LR0]4R1]4R2]$R3]DR4]BR5]JR6]:/CtQ/R]bR] bR ] bR'] bR!]bR"]bR#]bR$]bR%]bR&]bR)]bR*] bR+] bR(]bR,]bR-] bR.]bR/]R0]R1]R2]R3]R4]R5]R6]/CtR]]]] ] ]]]3tS]P!]U4tV!R7R84tW!R9R:4tXR;R<ltYR=R>ltZR?t[R#)@N) AutoConfig)logging) AqlmConfigAutoRoundConfig AwqConfigBitNetQuantConfigBitsAndBytesConfigCompressedTensorsConfig EetqConfigFbgemmFp8ConfigFineGrainedFP8ConfigFourOverSixConfig FPQuantConfigGemmaQuantizationConfig GPTQConfig HiggsConfig HqqConfig MetalConfig Mxfp4ConfigQuantizationConfigMixinQuantizationMethod QuantoConfig QuarkConfig SinqConfig SpQRConfig TorchAoConfig VptqConfig) HfQuantizer)AqlmHfQuantizer)AutoRoundQuantizer) AwqQuantizer)BitNetHfQuantizer)Bnb4BitHfQuantizer)Bnb8BitHfQuantizer)CompressedTensorsHfQuantizer)EetqHfQuantizer)FbgemmFp8HfQuantizer)FineGrainedFP8HfQuantizer)FourOverSixHfQuantizer)FPQuantHfQuantizer)GemmaQuantizer)GptqHfQuantizer)HiggsHfQuantizer)HqqHfQuantizer)MetalHfQuantizer)Mxfp4HfQuantizer)QuantoHfQuantizer)QuarkHfQuantizer)SinqHfQuantizer)SpQRHfQuantizer)TorchAoHfQuantizer)VptqHfQuantizerawqbitsandbytes_4bitbitsandbytes_8bitgptqaqlmquantoquark fouroversixfp_quanteetqhiggshqqzcompressed-tensors fbgemm_fp8torchaobitnetvptqspqrfp8mxfp8z auto-roundmxfp4metalsinqgemmacPa]tRt^toRt]V3RlRl4t]R4tRtVt R#)AutoQuantizationConfigz The Auto-HF quantization config class that takes care of automatically dispatching to the correct quantization config given a quantization config stored in a dictionary. c <V^8dQhRS[/#)quantization_config_dict)dict)format __classdict__s"m/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/transformers/quantizers/auto.py __annotate__#AutoQuantizationConfig.__annotate__s>>>c VPR4pVPRR4'gVPRR4'd5VPRR4'dRMRp\PV,pMVf \R4hV\9d-\RV R\ \ P44 24h\V,pVPV4#) quant_method load_in_8bitF load_in_4bit_4bit_8bitThe model's quantization config from the arguments has no `quant_method` attribute. Make sure that the model has been correctly quantizedUnknown quantization type, got  - supported types are: ) getrBITS_AND_BYTES ValueError AUTO_QUANTIZATION_CONFIG_MAPPINGlistAUTO_QUANTIZER_MAPPINGkeys from_dict)clsrRr[suffix target_clss&& rVrj AutoQuantizationConfig.from_dicts/33NC # ' ' > >BZB^B^_motBuBu 8 < <^U S SWY`F-<>( # #rYrOc|a]tRt^toRt]V3RlRl4t]R4t]V3RlRl4t] R4t Rt Vt R #) AutoHfQuantizerz The Auto-HF quantizer class that takes care of automatically instantiating to the correct `HfQuantizer` given the `QuantizationConfig`. c0<V^8dQhRS[S[,/#)rQrp)rrS)rTrUs"rVrWAutoHfQuantizer.__annotate__s99.E.L9rYc \V\4'd\PV4pVPpV\ P 8XdG\V\4'g \R4hVP'd VR, pM VR, pV\9d-\RV R\\P44 24h\V,pV!V3/VB#)zZFound `quant_method=bitsandbytes` but `quantization_config` is not a `BitsAndBytesConfig`.r_r^rarb) isinstancerSrOrjr[rrdr TypeErrorr\rhrergri)rkrprvr[rms&&, rV from_configAutoHfQuantizer.from_configs )4 0 0"8"B"BCV"W *77  -<< <13EFFp#///' ' 5 51,@/44678:  ,L9 -888rYc R\P!V3/VBpVPV4#)N)rOrrr)rkrurvrps&&, rVrrAutoHfQuantizer.from_pretraineds*4DDEbmflm233rYcD<V^8dQhRS[S[,RS[R,/#)rQrpquantization_config_from_argsN)rSr)rTrUs"rVrWrs*/#/#!$;;/#(?'E/#rYc fVeRpMRp\V\4'dC\V\4'd\P!V4pM\PV4pVejVP P VP P 8wd;\RVP P RVP P R24h\V\4'dx\V\4'dbVP4pVP4FwrV\WV4K V'd%VR\VP44 R2, pVR8wd:\V\\\ 34'g\"P$!V4V#\&P)V4V#)zt handles situations where both quantization_config from args and quantization_config from model config are present. zYou passed `quantization_config` or equivalent parameters to `from_pretrained` but the model you're loading already has a `quantization_config` attribute. The `quantization_config` from the model will be used.zThe model is quantized with z but you are passing a z| config. Please make sure to pass the same quantization config class to `from_pretrained` with different loading attributes.z"However, loading attributes (e.g. z]) will be overwritten with the one you passed to `from_pretrained`. The rest will be ignored.)rrSrrjrO __class__ryreLOADING_ATTRIBUTES_CONFIG_TYPESget_loading_attributesitemssetattrrgrirrr warningswarnloggerinfo)rkrpr warning_msgloading_attr_dictattrvals&&& rVmerge_quantization_configs*AutoHfQuantizer.merge_quantization_configss ) 4y  K )4 0 07II&5&?&?@S&T#&<&F&FGZ&[# * 5#--66:W:a:a:j:jj./B/L/L/U/U.VVmoLoVoVo_o_n``FF  )+J K KPZ )+JQ Q !> T T V .446 +377!!CDIZI_I_IaDbCcdA BB " Z0CkS^`tEu%v%v MM+ &#" KK $""rYc VPRR4pVPRR4'gVPRR4'd5VPRR4'dRMRp\PV,pMVf \R4hV\9d:\ P RV R \\P44 R 24R#R #) r[Nr\Fr]r^r_r`rarbz~. Hence, we will skip the quantization. To remove the warning, you can delete the quantization_config attribute in config.jsonT) rcrrdrerfrwarningrgrhri)rRr[rls& rVsupports_quant_method%AutoHfQuantizer.supports_quant_methods/33NDI # ' ' > >BZB^B^_motBuBu 8 < <^U S SWY`F-<.register_config_fn-sK 5 5xx/CDE E#677HI I36(0 rYrq)rrsf rVregister_quantization_configr*s rYc$V^8dQhR\/#)rQnamer)rTs"rVrWrW:s ! !S !rYcaV3RlpV#)zRegister a custom quantizer.c<S\9d\RS R24h\V\4'g \ R4hV\S&V#)z Quantizer 'rz!Quantizer must extend HfQuantizer)rhrerrr)rkrs&rVregister_quantizer_fn1register_quantizer..register_quantizer_fn=sJ ) ){4&0DEF F#{++?@ @'*t$ rYrq)rrsf rVregister_quantizerr:s ! rYch\VRR4RJpV'd(\PVP4'gRpV'gVeWV'd'\P VPV4VnMWn\P VPVR7pMRpVeVP VVR7VPV4pVPV4pVPV4p\VPRR4'g'VPPp\VRV4VR&W`V3#)rpNF) pre_quantized) device_map weights_only dequantizevaluequant) rsrrrprrvalidate_environmentupdate_device_mapupdate_tp_planupdate_ep_planr[)configrprr user_agentr hf_quantizerr[s&&&&& rVget_hf_quantizerrJs&F$94@LM_BB6C]C]^^ +7 )8)S)S**,?*F &*= &&22  & &'3  ))!% * "33J? ,,V4,,V4|77uMM';;HHL"),"NJw   ++rY)\rmodels.auto.configuration_autorutilsrutils.quantization_configrrrrr r r r r rrrrrrrrrrrrrrrrbaserquantizer_aqlmrquantizer_auto_roundr quantizer_awqr!quantizer_bitnetr"quantizer_bnb_4bitr#quantizer_bnb_8bitr$quantizer_compressed_tensorsr%quantizer_eetqr&quantizer_fbgemm_fp8r'quantizer_finegrained_fp8r(quantizer_fouroversixr)quantizer_fp_quantr*quantizer_gemmar+quantizer_gptqr,quantizer_higgsr- quantizer_hqqr.quantizer_metalr/quantizer_mxfp4r0quantizer_quantor1quantizer_quarkr2quantizer_sinqr3quantizer_spqrr4quantizer_torchaor5quantizer_vptqr6rhrfr get_loggerryrrOrrrrrqrYrVrs76+4'/22F+6@92++-)--/-++1+ <++ O   O     )" O  >6&!  !" O#$ O $ &$   O ^9>$ 9$+$+$ J $  J $  J $ l$ [$$$ $ 9$1$/$ [$}$  !$" J#$$ J  !/ [ [ J $3$ :  #   H %&#&#Rll^  ! !,rY