+ G-jN^RIt^RIt]P!]4t!RR4tR#)Nca]tRt^toRt]RV3RlRll4t]R4t]R4t]V3RlRl4t ]RV3RlR ll4t ]RV3R lR ll4t R t Vt R #)PastKeyValuesHelperzEHelper functions to process past key values for encoder-decoder modelc <V^8dQhRS[/#)present)bool)format __classdict__s"u/Volumes/fast/ai/experiments/nudenet-smoke/.venv/lib/python3.14/site-packages/onnxruntime/transformers/past_helper.py __annotate__ PastKeyValuesHelper.__annotate__s22D2c.p.p\V4FYpTPV'd RV 2RV 2.M RV 2RV 2.4TPV'd RV 2RV 2.M RV 2RV 2.4K[ W#,#)present_key_self_present_value_self_past_key_self_past_value_self_present_key_cross_present_value_cross_past_key_cross_past_value_cross_)rangeextend) num_layersrpast_self_namespast_cross_namesis&& r get_past_names"PastKeyValuesHelper.get_past_namessz"A  " "%QC(,?s*CD&qc*.>qc,BC   # #&aS)-A!+EF's+/@-DE  #11rc .p.p\V4FSwr4\V4^8XgQR\V4 24hVwppppVPWV.4VPWx.4KU W3#)aSplit present state from grouped by layer to grouped by self/cross attention. Before: (past_key_self_0, past_value_self_0, past_key_cross_0, past_value_cross_0), (past_key_self_1, past_value_self_1, past_key_cross_1, past_value_cross_1), ... After: (past_key_self_0, past_value_self_0, past_key_self_1, past_value_self_1, ...), (past_key_cross_0, past_value_cross_0, past_key_cross_1, past_value_cross_1, ...) !Expected to have four items. Got  enumeratelenr) present_key_values present_self present_cross_ipresent_layer_ipresent_key_selfpresent_value_selfpresent_key_crosspresent_value_crosss & r group_by_self_or_cross*PastKeyValuesHelper.group_by_self_or_cross"s  #,-?#@ B'1, h0QRUVeRfQg.h h,    "!#   !1 F G  "3!I J$A**rc aa\S4^S,8XgQh\;QJd!.VV3Rl\S44FNK 5#!VV3Rl\S444#)aReorder past state from grouped by self/cross attention to grouped by layer. Before: past_key_self_0, past_value_self_0, past_key_self_1, past_value_self_1, ..., past_key_cross_0, past_value_cross_0, past_key_cross_1, past_value_cross_1, ... After: (past_key_self_0, past_value_self_0, past_key_cross_0, past_value_cross_0), (past_key_self_1, past_value_self_1, past_key_cross_1, past_value_cross_1), c3<"TFmpS^V,,S^V,^,,S^S,^V,,,S^S,^V,,^,,.xKo R#5i)rN).0rrpasts& r 5PastKeyValuesHelper.group_by_layer..>sg ' QU QUQYQ^a!e+,Q^a!e+a/0   'sA5A8)r$tupler)r4rsffr group_by_layer"PastKeyValuesHelper.group_by_layer7s[ 4yA N***u :& u u :&   rcT<V^8dQhRS[S[S[P,,/#rpast_key_valuesr7torchTensor)r r s"r r r Is"U53F-Grc Rp\V4^,p\\V4^,4FNp^V,pVW,W^,,WV,,WV,^,,33, pKP V#)aCategorize present_key_values from self and cross attention to layer by layer. Reorder past state from grouped by self/cross attention to grouped by layer. Before: past_key_self_0, past_value_self_0, past_key_self_1, past_value_self_1, ..., past_key_cross_0, past_value_cross_0, past_key_cross_1, past_value_cross_1, ... After: (past_key_self_0, past_value_self_0, past_key_cross_0, past_value_cross_0), (past_key_self_1, past_value_self_1, past_key_cross_1, past_value_cross_1), Args: present_key_values: From past_key_values of a model (group by self and cross attention) Returns: past_tuples: present key and values grouped by layer. r2)r$r)r< past_tupleshalf_idxridxs& r back_group_by_layer'PastKeyValuesHelper.back_group_by_layerHs  '1,s?+q01Aa%C #(#!G,#sN3#sNQ$67  K2rcJ<V^8dQhRS[S[P,RS[/#)rr%concat)r7r>r?r)r r s"r r r gs%//E%,,4G/QU/rc .p.p\V4FQwrE\V4^8XgQR\V4 24hVwrgrVPWg.4VPW.4KS V'd W#,#W#3#)a8Categorize present_key_values into self and cross attention. Split present state from grouped by layer to grouped by self/cross attention. Before: (past_key_self_0, past_value_self_0, past_key_cross_0, past_value_cross_0), (past_key_self_1, past_value_self_1, past_key_cross_1, past_value_cross_1), ... After: (past_key_self_0, past_value_self_0, past_key_self_1, past_value_self_1, ...), (past_key_cross_0, past_value_cross_0, past_key_cross_1, past_value_cross_1, ...) Args: present_key_values: From past_key_values of a model (group by layer) concat: If concat self attention with cross attention key/value to return Returns: present_self (Tuple[torch.Tensor]): present key and values from self attention present_cross (Tuple[torch.Tensor]): present key and values from cross attention r!r") r%rGr&r'_r)r*r+r,r-s && r group_by_self_and_cross+PastKeyValuesHelper.group_by_self_and_crossfs$,. ,. "+,>"? A'1, h0QRUVeRfQg.h h,[j X 2C   !1 F G  "3!I J #@ / /. .rcT<V^8dQhRS[S[S[P,,/#r;r=)r r s"r r r s"uU\\/B)Crc .pV'd\V4^,M \V4pV'gRMRp\V4F2pTPRV 2RV 23Uu.uF qdV,NK up4K4 \V4F2pTPRV 2RV 23Uu.uF qdV,NK up4K4 V#uupiuupi)zProcess input names of model wrapper. Args: past_key_values: Consider `self` and `cross` past_key_values Returns: names (List[string]): input names past_present_ key_self_ value_self_ key_cross_ value_cross_)r$rr)r<encodernamesrprefixrss&& r get_input_names#PastKeyValuesHelper.get_input_namess29S)Q.s??S 'Zz"A LL1#+aS@Q.RS.R1**.RS T#z"A LLA3/? getLoggerrZloggerrr2rr res)   8 $GGr