+ QV-jV)zaRt'0tRt^RIt^RIt^RIHt^RIHtHt^RI t ^RI H t ^RI H t H t ^RIHtHtHtHt^RIHt^RIHt]'d ^R IHt^R IHt]P6!]4t/t]^k!R R 4t!R R4t !RR]4t!RRlt"RRlt#R]!!4/t$]^kRRlt%RRRllt&R#)zrFusion registration helpers. See `docs/source/en/fusion_mapping.md` for the design overview and extension guide. N)Mapping) TYPE_CHECKINGAny)nn)!get_checkpoint_conversion_mapping®ister_checkpoint_conversion_mapping)Conv3dToLinearWeightConverterWeightRenamingWeightTransform)register_patch_mapping)logging)PretrainedConfig)PreTrainedModelc|a]tRt^,toRtR tV3RlRltV3RlRltV3RlRltV3RlR lt V3R lt R t Vt R #) ModuleFusionSpeczBase recipe for a fusion family. A fusion spec decides which modules are eligible for a fusion, how to build the runtime replacement class, and which weight transforms are needed to map checkpoints between the original and fused layouts. c&<V^8dQhRS[RS[/#) model_namereturn)str)format __classdict__s"l/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/transformers/fusion_mapping.py __annotate__ModuleFusionSpec.__annotate__6s]]]]c 8R\V4P RV 2#)zDReturn the log message emitted when no compatible modules are found.zNo compatible z classes found to fuse for )type__name__)selfrs&&r get_empty_logModuleFusionSpec.get_empty_log6s"T 3 344OPZ|\\rc:<V^8dQhRS[PRS[/#rmodulerrModulebool)rrs"rrr:s"""t"rc \h)z>Return whether `module` is compatible with this fusion family.NotImplementedError)r r%s&&r is_fusableModuleFusionSpec.is_fusable:!!rcn<V^8dQhRS[S[P,RS[S[P,/#r original_clsrrrr')rrs"rrr>s+""T"))_"bii"rc \h)zBBuild the runtime replacement class for a compatible module class.r*)r r1s&&rmake_fused_class!ModuleFusionSpec.make_fused_class>r.rc4<V^8dQhRRRS[S[,/#rconfigrrlistr )rrs"rrrBs!""&8"T/=R"rc \h)zMBuild the weight transforms needed to load and save the fused runtime layout.r*)r r8s&&rmake_transforms ModuleFusionSpec.make_transformsBr.rc:<V^8dQh/S[S[R3,;R&#)r.target_modules_patterns)tupler)rrs"rrr,s#38_1rN) r __module__ __qualname____firstlineno____doc__r?r!r,r4r<__annotate_func____static_attributes____classdictcell__rs@rrr,sC02]]""""""-rrcDaa]tRt^GtoV3RltV3RlRltRtVtV;t#)_FusedPatchEmbeddingMixinc<\SV`!V/VBVPP\P !VPP 4,Vn\P!VPVPPVPPRJVPPPVPPPR7VnV=R#)N)biasdevicedtype)super__init__proj in_channelsmathprod kernel_size patch_volumerLinear out_channelsrMweightrNrO linear_proj)r argskwargs __class__s&*,rrQ"_FusedPatchEmbeddingMixin.__init__Hs $)&) II11DIIdii>S>S4TT99    II " "t+99##**))""((   IrcN<V^8dQhRS[PRS[P/#)r hidden_statesr)torchTensor)rrs"rr&_FusedPatchEmbeddingMixin.__annotate__Ws#66U\\6ell6rcVPPPpVPRVP4pVPVP VR74pVPRVP 4#))rO)r[rZrOviewrWto embed_dim)r ra target_dtypes&& rforward!_FusedPatchEmbeddingMixin.forwardWsf''..44 %**2t/@/@A (()9)9 )9)MN !!"dnn55r)r[rW) rrBrCrDrQrlrGrH __classcell__)r^rs@@rrKrKGs 666rrKc^a]tRt^^toRtR tV3RlRltV3RlRltV3RlRltRt Vt R #) PatchEmbeddingsFusionSpeczJFuse compatible Conv3d patch embeddings into flattened Linear projections.c:<V^8dQhRS[PRS[/#r$r&)rrs"rr&PatchEmbeddingsFusionSpec.__annotate__cs     t  rc\\VRR4;p\P4'gR#VPVP 8H;'d>VP R8H;'d'VPR8H;'dVP^8H#)rRNF)rtrt)rfrfrf) isinstancegetattrrConv3dstriderVpaddingdilationgroups)r r%rRs&& rr,$PatchEmbeddingsFusionSpec.is_fusablecs'&&$"??$KK KK4++ + ! ! ) ! ! * ! ! q  rcn<V^8dQhRS[S[P,RS[S[P,/#r0r2)rrs"rrrros+T"))_biircn\RVP 2\V3/4pRVP 2VnV#)Fused)rrrKrC)r r1 fused_clss&& rr4*PatchEmbeddingsFusionSpec.make_fused_classosB5!6!6 78;TVb:cegh #()B)B(C!D rc4<V^8dQhRRRS[S[,/#r7r9)rrs"rrrrts!  &8 T/=R rc \VRV4pVPp\V\4'dW33pVP.\ V4O5pVP p\RR\VVR7.R7\RRR7.#) vision_configzpatch_embed\.proj\.weight$z!patch_embed\.linear_proj\.weight$)rSrV)source_patternstarget_patterns operationszpatch_embed\.proj\.bias$zpatch_embed\.linear_proj\.bias$)rr) rv patch_sizeruinttemporal_patch_sizer@rSr rr )r r8rrrVrSs&& rr<)PatchEmbeddingsFusionSpec.make_transformsts@ "-- j# & &$1J$88M5;LM #//   = D"$/$/   ; B   rrAN)z(^|\.)patch_embed$) rrBrCrDrEr?r,r4r<rGrHrIs@rrprp^s,T6      rrpc V^8dQhRRRRR\R\R\\\\P ,3,/#)rclstype[PreTrainedModel]r8r fusion_namespecr)rrdictrrr')rs"rrrsL-- - --  -  #tBII  -rc\PV/4pW9d W@,#\P!R4;_uu_4V!V4pRRR4\ 4p/pVP 'd0\ P!RPVP 44MRpXP4Fxwr\V 4p W9dKVeVPV 4fK1VPV 4'gKJVPV 4VPV 4W{P&Kz WtV&V# +'giL;i)aJDiscover compatible module classes for one fusion family on a meta-initialized model. This function: - instantiates `cls(config)` on the meta device - scans `named_modules()` for candidate modules - optionally pre-filters them with `target_modules_patterns` - uses `is_fusable(...)` as the final structural check - builds the class-level patch mapping used by monkey patching Results are cached per `(fusion_name, cls)` to avoid repeated meta-initialization. This matches the current class-level fusion behavior, where one compatible module class maps to one fused replacement class. metaN|)_FUSION_DISCOVERY_CACHE setdefaultrbrNsetr?recompilejoin named_modulesrsearchr,addr4r) rr8rrcachemodel seen_classes patch_mappingtarget_module_pattern module_namer% module_clss &&&& r_discover_fusable_modulesrs( $ . .{B ?E |z f  F  5LM>B>Z>Z>Z 388D889:`d %224 &\  %  ,1F1M1Mk1Z1b v&& $-1-B-B:-N ))* 5#J +  s  D55 E c <V^8dQhRRRRR\R\RR/#) rrrr8rrrrN)rr)rs"rrrs;*S*S *S*<*SKN*SVf*S *Src \WW#R7pV'g1\PVPVP44R#\ VRR7\ VR4'd\ VPR4'g\RVP R24hVPPpVPV4p\V4pVevVUu/uFp\VP4VbK p pVFBp \V P4p V PV 4p V fK/\R V R V R V R 24h Wv,p\WVRR7R#uupi) aqRegister one fusion family for `cls`. This function updates the two global registries used by fused loading: - the monkey-patching registry, so compatible module classes are replaced before initialization - the checkpoint conversion mapping, so fused runtime modules still load from the original checkpoint layout Notes: - conflicting checkpoint transforms fail fast )rrNT) overwrite config_class model_typezModel z" has no config class or model typezFusion z for model type zC conflicts with an existing conversion mapping for source patterns .)rloggerinfor!rr hasattrr ValueErrorrr<rr@rgetr) rr8rrfusable_classesr convertersexisting_convertersexistingexisting_converter_sources converterrexisting_converters &&&& r_register_module_fusionrsJ0`O  D&&s||45?d; 3 ' 'ws7G7G/V/V6#,,/QRSS!!,,J%%f-J;JG&at%t`sT\eH,D,D&Ex&O`s"%t#I#I$=$=>O!;!?!?!P !- k]*::,G++:*;1> $)5 *:TR&usEpatch_embeddingscV^8dQhR\\\\\\3,,3,R\\,/#)r fusion_configr)rrr(rr:)rs"rrrs9dWS#X=N6N1N)OTXY\T]rc.pVP4Fbwr#V\9d\RV 24hVRJdK&VRJd&\V\4'g\RV R24hVP V4Kd V#)zQValidate `fusion_config` and return enabled fusion names in user-specified order.zUnknown fusion type: FTzInvalid fusion config for z4: expected `True`, `False`, or a mapping of options.)items_FUSION_REGISTRYrrurappend)renabled_fusionsrfusion_optionss& r_iter_enabled_fusionsrsO'4':':'<# . .4[MBC C U "   %j.Q.Q,[M9mn  {+(= rc V^8dQhRRR\\\\\\3,,3,R,RR/#)rrrrNr)rrr(r)rs"rrrsJYY Y9@dWUXZ]U]M^F^A^9_bf9fY YrcnV'gR#\V4Fp\WV\V,4K R#)zRegister requested runtime fusions for `cls`. This function: - validates `fusion_config` against `_FUSION_REGISTRY` - resolves the enabled fusion families in user order - registers monkey patches and checkpoint transforms before model instantiation N)rrr)rr8rrs&&& rregister_fusion_patchesrs+ ,]; [:J;:WXrs  #% i``35/   H %MOO""666.- 0- `-`*SZ2DE^E`0aa"YYr