+ QV-jÁãóÆ€^RIHt^RIHt^RIHt]'d^RIHt^RIH t H t H t H t ^RI Ht] !4'd^RIt] P !]4t!RR ]4tR#) é)Ú TYPE_CHECKING)Ú HfQuantizer)Úget_module_from_name)ÚPreTrainedModel)Úis_accelerate_availableÚis_optimum_quanto_availableÚis_torch_availableÚlogging©Ú QuantoConfigNcóÎaa€]tRt^&toRtRtV3RlV3RlltRtV3RlRltV3RlR lt V3R lV3R llt V3R lR lt ] V3RlRl4t RtRtV3RltRtVtV;t#)ÚQuantoHfQuantizerz" Quantizer for the quanto library Fcó <€V^8„dQhRS[/#)éÚquantization_configr )ÚformatÚ __classdict__s"€Úy/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/transformers/quantizers/quantizer_quanto.pyÚ __annotate__ÚQuantoHfQuantizer.__annotate__.sø€÷bñb©Lñbóc ó”<€\SV`!V3/VBR^R^RRRR/pVPVPPR4VnR#)Úint8Úfloat8Úint4gà?Úint2gÐ?N)ÚsuperÚ__init__ÚgetrÚweightsÚquantized_param_size)ÚselfrÚkwargsÚmap_to_param_sizeÚ __class__s&&, €rrÚQuantoHfQuantizer.__init__.sVø€Ü ‰ÒÐ,Ñ7°Ò7à AØ aØ CØ Dð  Ðð %6×$9Ñ$9¸$×:RÑ:R×:ZÑ:ZÐ\`Ó$aˆÖ!rcó€\4'g \R4h\4'g \R4hVPR4p\ V\ 4'dF\ V4^8”dRVP49gRVP49d \R4hVPPe \R4hR#)zhLoading an optimum-quanto quantized model requires optimum-quanto library (`pip install optimum-quanto`)z`Loading an optimum-quanto quantized model requires accelerate library (`pip install accelerate`)Ú device_mapÚcpuÚdiskzÜYou are attempting to load an model with a device_map that contains a CPU or disk device.This is not supported with quanto when the model is quantized on the fly. Please remove the CPU or disk device from the device_map.NzÂWe don't support quantizing the activations with transformers library.Use quanto library for more complex use cases such as activations quantization, calibration and quantization aware training.) rÚ ImportErrorrrÚ isinstanceÚdictÚlenÚvaluesÚ ValueErrorrÚ activations)r"Úargsr#r(s&*, rÚvalidate_environmentÚ&QuantoHfQuantizer.validate_environment8s¿€Ü*×,Ò,ÜØzóð ô'×(Ò(ÜØróð ð—Z‘Z  Ó-ˆ Ü j¤$× 'Ò 'Ü:‹ Ô" u° ×0AÑ0AÓ0CÔ'CÀvÐQ[×QbÑQbÓQdÔGdÜ ðPóðð × #Ñ #× /Ñ /Ò ;ÜðOóð ñ rsSðõ!åÝ2÷Ý0÷óõ 5ñ×ÒÛà × Ò ˜HÓ %€ôT$˜ öT$r