+ QV-j x^RIt^RIHtHt^RIHt]P !]4t]!4t RRlt RRRllt R#) N)_flash_attention_forward!flash_attn_supports_top_left_mask)loggingcV^8dQhR\PR\PPR\P/#)querymodulereturn)torchTensornnModuledtype)formats"z/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/transformers/integrations/flash_attention.py __annotate__r s1  ELL %((// ekk cVP\P8XdVPPp\P !V4'd\P !V4#\VPR4'dVPP#\RVP444PP#R#)ziIf the query is in float32, return a target dtype compatible with flash attention. Return None otherwise. _is_quantizedc3~"TF3p\V\PP4'gK/VxK5 R#5i)N) isinstancer r Linear).0layers& r #get_target_dtype..s*b+;%z%QVQYQYQ`Q`?a+;s,= =N) rr float32devicetypeis_autocast_enabledget_autocast_dtypehasattrconfignextmodulesweight)rr device_types&& rget_target_dtyper( s {{emm#ll''  $ $[ 1 1++K8 8 V]]O 4 4==&& &b6>>+;bbiioo o rcV^8dQhR\PPR\PR\PR\PR\PR,R\R\R,R \ R,R \R,R \ R,R \PR,R \\PR3,/ #)rr rkeyvalueattention_maskNdropoutscalingsliding_windowsoftcap is_causals_auxr )r r rr floatintbooltuple)rs"rrrsCC HHOOC <<C C << C LL4' C  CT\C$JCT\Cd{C <<$ C 5<< Crc  V PRR4'd\PR4VP^,p \;QJd&RVP4F 'gK RM RM!RVP44'd \ R4hVP ^^4pVP ^^4pVP ^^4p\W4p V eT M VPp \VVVV3RT RT R TR TR TR TR \RT RVPPR\VR4'd VPMRRV eV PVP 4MR/ V BpVR3#)output_attentionsFzFlash Attention does not support `output_attentions=True`. Please set your attention to `eager` if you want any of these features.c3*"TF q^8HxK R#5i)rN)rdims& rr*flash_attention_forward..1s +{!8{sTzTensor query has shape with a zero dimension. FlashAttention does not support inputs with dim=0. Please check your input shapes or use SDPA instead.N query_lengthr1r- softmax_scaler/r0use_top_left_mask target_dtypeattn_implementation layer_idxr2)getlogger warning_onceshapeany ValueError transposer(r1r_use_top_left_maskr#_attn_implementationr"rBtor)r rr*r+r,r-r.r/r0r1r2kwargsseq_lenr@ attn_outputs&&&&&&&&&&&, rflash_attention_forwardrPszz%u-- W kk!nG s +u{{ +sss +u{{ +++ B  OOAq !E --1 C OOAq !E$E2L'2 8H8HI*        &-"#MM>>'.fk&B&B&"""  HHU[[ !%( )K.  r)gNNNNN) r modeling_flash_attention_utilsrrutilsr get_logger__name__rDrJr(rPr:rrrUs: h   H %68 CCr