+ QV-j ^RIHt^RIt^RIt^RIHt^RIHtHt^RI H t ]'d^RI H t RRlt R tR tR tR#) ) annotationsN) TYPE_CHECKING)is_torch_available strtobool)QuantizationMethod)nnc V^8dQhRRRR/#)modulez nn.Modulereturnbool)formats"o/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/transformers/integrations/fsdp.py __annotate__rs  9  c\4'gR#^RIpVPP4'gR#^RIp\ WPP P4;'g\VRR4#)FN_is_fsdp_managed_module) rtorch distributed is_availabletorch.distributed.fsdp isinstancefsdpFullyShardedDataParallelgetattr)r rs& ris_fsdp_managed_modulersf       ) ) + +! f//44MM N  RY)5Srcv\4'd^RIpVPP4;'dVPP 4;'da\ \ PPRR44^8H;'d-\ \ PPRR44^8H#R#)rNACCELERATE_USE_FSDPFalseFSDP_CPU_RAM_EFFICIENT_LOADINGF) rrrris_initializedrosenvironget)rs ris_fsdp_enabledr&,s    * * , Z Z!!002 Z Z"**..)>HIQN Z Z"**..)I7STXYY   rcv^RIHpR\\P!V4P 49dRR/#/#)z Returns checkpoint kwargs for FSDP model saving. Checks if the `adapter_only` parameter is supported by `save_fsdp_model` from accelerate and returns the appropriate kwargs. save_fsdp_model adapter_onlyT)accelerate.utilsr)listinspect signature parametersr(s rget_fsdp_ckpt_kwargsr0:s51g//@KKLL%% rc^RIHp^RIHp\ VP V4'd"V!V4VP Pn\VRR4\P8XdzVPPPP'dHVP PP!VPPPRR7R#R#R#)a3 Updates the FSDP plugin for PEFT LoRA/QLoRA compatibility. When using FSDP with PEFT LoRA, the auto wrap policy needs to be updated to additionally wrap LoRA trainable layers separately. When using FSDP with QLoRA, the mixed precision policy needs to be updated to use the quantization storage data type. ) PeftConfig)fsdp_auto_wrap_policyquantization_methodNT)override)peftr2peft.utils.otherr3ractive_peft_configstate fsdp_pluginauto_wrap_policyrrBITS_AND_BYTES hf_quantizerquantization_configbnb_4bit_quant_storageis_floating_pointset_mixed_precision)model acceleratorr2r3s&& rupdate_fsdp_plugin_peftrDIs 6%**J779Nu9U %%6,d37I7X7XX    2 2 I I [ [ [%%99    2 2 I ITX :  \ Yr) __future__rr-r#typingrutilsrrutils.quantization_configrrrrr&r0rDrrrrIs5# 1:    r