+ QV-j^RIHt^RIHtHt^RIHtHt]!4'd ^RIt^RI H t ]P!] 4t !RR]4tR RRlltR#) ) ConversionOps)get_module_from_nameshould_convert_module)is_torch_availableloggingNc<a]tRt^toRtRV3RlRlltRtVtR#)QuantoQuantizecWnR#)N hf_quantizer)selfr s&&q/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/transformers/integrations/quanto.py__init__QuantoQuantize.__init__s(Nc <V^8dQhRS[S[S[S[P,3,RS[P P R,RS[R,RS[S[,R,RS[S[S[P3,/#)r input_dictmodelNfull_layer_name missing_keysreturn)dictstrlisttorchTensornnModule)format __classdict__s"r __annotate__QuantoQuantize.__annotate__sxd5<<001xx%t  3i$&  c5<< rc J\VP44^,wrgV^,p^RIHpV!W#V4\ W#4wr\ P !V PP4V n\ P !V PP4V n V P4RV Pn RV n VPR^4^,p VPV R24VPV R24VPV R24/#))_load_parameter_into_modelFT.z.weightz .input_scalez .output_scale)tupleitemsmodeling_utilsr%rrones input_scaleshape output_scalefreezeweight requires_grad_is_hf_initializedrsplitdiscard) r rrrrkwargs_valuer%module module_names &&&&&, rconvertQuantoQuantize.converts))+,Q/a?"55A(@ "ZZ(:(:(@(@A#jj)<)<)B)BC &+ #$(!&,,S!4Q7  }G45 }L9: }M:; rr )NNN)__name__ __module__ __qualname____firstlineno__rr9__static_attributes____classdictcell__)r s@rr r s)rr cHV^8dQhR\\,R,/#)rmodules_to_not_convertN)rr)rs"rr!r!>s99!I,9rc ^RIHpHpHpHpHpHpRVRVRVRV/p RRRVRV/p Rp VP4EF[wr\W4'gK\P!R4;_uu_4Rp\V \P4'ddV!V PV PV P RJV P"P$WP&,WP(,R 7pM\V \PP*4'dVVP(eHV!V P,V P.V P0V P RJWP(,R 7pVeR p VP3W4RRR4EK^ V 'g\4P7R 4V# +'giEK;i) a Public method that recursively replaces the Linear layers of the given model with Quanto quantized layers. Returns the converted model and a boolean that indicates if the conversion has been successful or not. Args: model (`torch.nn.Module`): The model to convert, can be any `torch.nn.Module` instance. quantization_config (`QuantoConfig`, defaults to `None`): The quantization config object that contains the quantization parameters. modules_to_not_convert (`list`, *optional*, defaults to `None`): A list of modules to not convert. If a module name is in the list (e.g. `lm_head`), it will not be converted. ) QLayerNormQLinearqfloat8qint2qint4qint8float8int8int4int2NFmeta) in_features out_featuresbiasdtypeweights activations)rTTzYou are loading your model using quanto but no linear modules were found in your model. Please double check your model architecture, or submit an issue on github if you think this is a bug.)optimum.quantorDrErFrGrHrI named_modulesrrdevice isinstancerLinearrOrPrQr/rRrSrT LayerNormnormalized_shapeepselementwise_affine set_submoduleloggerwarning)rquantization_configrBrDrErFrGrHrI w_mapping a_mappinghas_been_replacedr8r7 new_modules&&& rreplace_with_quanto_layersrf>s|$QP7FE65&%PItXw>I$224 $[II  \\& ! !J&")),,$ & 2 2!'!4!4D0 ----%&A&AB )*I*I J  FEHH$6$677rmsH/U/   H % ] F99r