+ G-ji`^RIt^RIt^RIt^RIt^RIt^RIt^RIHtHtH t H t H t H t H t ^RIHtHt^RIHt]P&!]4tRtRRltRRltRt.ROtR ^.R ^^.R ^^./t!R R 4tRRltRRltR#)N)AttributeProto GraphProto ModelProto NodeProto TensorProtohelper numpy_helper) infer_shapesinfer_shapes_path)versionc VUu.uF=p\\VPR44R,P^4^4NK? up#uupi)zl Convert numpy float16 to python int. :param np_list: numpy float16 list :return int_list: python int list H:NN)intbinviewzfill)np_list_s& q/Volumes/fast/ai/experiments/nudenet-smoke/.venv/lib/python3.14/site-packages/onnxruntime/transformers/float16.py_npfloat16_to_intrsA=D DGqCAFF3K $**2. 2G DD DsAA c RpV\P!V^84,P^,^8dV\P!V^84,P4pV\P!V^84,P 4pWB8d\ P RV RV 24WQ8:d\ P RV RV 24V\P!V^84,P^,^8dV\P!V^84,P4pV\P!V^84,P 4pWr)8:d\ P RV RV) 24Wa)8d\ P RV RV) 24\P!V!^W4W4p\P!V!V)V^4V)V4p\P!V!W \R44W 4p\P!V!\R4W)4V)V4p\P!V4#)a+ Convert float32 numpy array to float16 without changing sign or finiteness. Positive values less than min_positive_val are mapped to min_positive_val. Positive finite values greater than max_finite_val are mapped to max_finite_val. Similar for negative values. NaN, 0, inf, and -inf are unchanged. c8\P!W8W84#N)np logical_and)abcs&&&rbetween&convert_np_to_float16..between/s~~aeQU++zthe float32 number z will be truncated to infz-inf) rwhereshapemaxminloggerdebugfloatfloat16)np_arraymin_positive_valmax_finite_valr positive_max positive_min negative_max negative_mins&&& rconvert_np_to_float16r3's,A&'--a014A 67;;= A 67;;=  ) LL.|n@P[Hxx!1 18Q?BRART\]Hxx%,GbHxxf xIN?\deH ::h r"c:\V\4'g\R\V4 24hVP\P 8Xd\P VnVP'dS\\P!VP4W4p\V4pW@PR&.VPR&VP'dD\P!VPRR7p\WQV4pVP4Vn V#)aaConvert tensor float to float16. Args: tensor (TensorProto): the tensor to convert. min_positive_val (float, optional): minimal positive value. Defaults to 1e-7. max_finite_val (float, optional): maximal finite value. Defaults to 1e4. Raises: ValueError: input type is not TensorProto. Returns: TensorProto: the converted tensor. 3Expected input type is an ONNX TensorProto but got :NNNfloat32dtype) isinstancer ValueErrortype data_typeFLOATFLOAT16 float_datar3rarrayr int32_dataraw_data frombuffertobytes)tensorr-r. float16_dataint_list float32_list float16_lists&&& rconvert_tensor_float_to_float16rJIs fk * *NtTZ|n]^^ ;,,,&..    0&:K:K1LN^oL(6H#+  a #%F  a ???== JL0Q_`L*224FO Mr"c\P!V4Pp\P!VP VP V4#r)r to_arrayr%rmake_tensor_value_infonamer<)rEr%s& rmake_value_info_from_tensorrOns7  ! !& ) / /E  ( (f6F6F NNr"Resize GroupNorm SkipGroupNormcHa]tRt^toRtV3RlRltV3RlRltRtVtR#)InitializerTrackerz'Class for keeping track of initializer.c <V^8dQhRS[/#)r initializer)r)format __classdict__s"r __annotate__InitializerTracker.__annotate__sKr"c.Wn.Vn.VnR#r)rV fp32_nodes fp16_nodes)selfrVs&&r__init__InitializerTracker.__init__s&r"c <V^8dQhRS[/#)rnode)r)rWrXs"rrYrZs))Y)r"cV'dVPPV4R#VPPV4R#r)r\appendr])r^rbis_node_blockeds&&&radd_nodeInitializerTracker.add_nodes)  OO " "4 ( OO " "4 (r")r]r\rVN) __name__ __module__ __qualname____firstlineno____doc__r_rf__static_attributes____classdictcell__)rXs@rrTrTs1 ))r"rTc "VR8gQR4hV\\P!\P4P48:gQR4hVf/MTp \ V\ 4'dTp \P!\P4\P!R48d~V'gv\P!\PPV 4R7;_uu_4p V P p \#W4\P$!V 4pRpRRR4M\P$!V 4p\ V\&4'g\)R\+V4 24hRpV'gF\P!\P4\P!R 48d \,pVf\.pVf.p\1V4p\1V4p\ R VP24^ R 7p\5\64pV^ 8:d^.VR &\8P;R V RV RV RV RV RV RV 24.p.p.p.pVe V!V4pVP=V4/p\14p\14pVP>P@Uu.uFDpVP*PBPD\FPH8XgK8VP NKF ppVP>PJUu.uFDpVP*PBPD\FPH8XgK8VP NKF pp\ V\L4'd6VUu.uFpVV9gK VNK ppVUu.uFpVV9gK VNK ppM V'g.p.p\OVP>P@4EFJwppVP V9gKR\ V4,pVVVP &VPQVP 4R\ V4,pVP>PRPQ4pVPUV4VVn\FPVVP*PBn"\XPZ!RVP .V.\FPVVR7.pVP>P\P_V4VP=V4VPQV4EKM \OVP>PJ4EF<wppVP V9gKR\ V4,p V VVP &VPQVP 4R\ V4,pVP>PRPQ4pVPUV4V Vn\FPVVP*PBn"\XPZ!RV .VP .^VR7.pVP>P\P_V4VP=V4VPQV4EK? /p!V'EdX.p"VEFIp#\ V#\&4'dV"P=V#P>4\ V#\`4'EdV#PbFOpVPd\FPH8XgK$VP V!9gQh\gV4V!VP &KQ V#P\EFFpVP V9dK\i\kVP@44FDpVP@V,V9gKVVP@V,,VP@V&KF \i\kVPJ44FDpVPJV,V9gKVVPJV,,VPJV&KF VPlV9;'gVP V9p$\OVP@4Fxwpp V V!9gKT$;'gGVVPoVPl.49;'d VV PoVPl.49p%V!V ,PqVV%4Kz V$'dVP=V4EKVPlR8Xd]VPrFLp&V&P R8XgKV&Pt\FPH8XgK7\FPVV&n:M VPlR#9dRp'VPrFNp&V&P R8XgKRp'V&Pt\FPH8XgK9\FPVV&n:KP VPlR$9dHV''g@VPrP_\XPv!R\FPV4.4VPlV9gVPlV 9d(VPrFp&V"P=V&4K EK5VP=V4EKI \ V#\x4'dV"P=V#Pz4V#P|FpV"P=V4K V#P~PU\V#P~W44V#PFp\VW4pK \ V#\`4'gEK\P!V#P@V#PJV#PR4EFPpVP*PBPD\FPH8XdLVP V9d;\FPVVP*PBn"VP=V4VP*PR4'gKVP*PPDPBPD\FPH8XgKVP V9gEK\FPVVP*PPDPBn"VP=V4EKS EKL T"pEK`V!P4Fp(V'gV(P'gK\V(PbW4V(n1VP=\V(Pb44V(P'gKrV'dK|\8PRV(P 24K VEFGp)\OV)P@4EF)wpp VVV)Pl,9g"VV PoV)Pl.49dKBVFp*V V*P 8XgKVP>PRPQ4pVPUV*4V R,pVVn\FPHVP*PBn"V R ,p\XPZ!RV .V.^VR7.pVP>P\P_V4VV)P@V&EK' EK, EKJ V 'd\FPM\FPHp+VEF$p)\i\kV)P@44FpV)P@V,p VFp*V V*P 8XgKVP>PRPQ4pVPUV*4V R,pVVnV+VP*PBn"V R ,p\XPZ!RV .V.V+VR7.pVP>P\P_V4VV)P@V&K K \i\kV)PJ44FpV)PJV,p,VFp*V,V*P 8XgKVP>PRPQ4pVPUV*4V,R!,p-V-VnV+VP*PBn"V,R",p\XPZ!RV-.V,.^ VR7.pVP>P\P_V4V-V)PJV&K K EK' V# +'giEL;i i;iuupiuupiuupiuupi)%aSConvert tensor float type in the input ONNX model to tensor float16. Args: model (ModelProto or str): The ONNX model or path of the model to convert. min_positive_val (float, optional): minimal positive value. Defaults to 5.96e-08. max_finite_val (float, optional): maximal finite value of float16. Defaults to 65504. keep_io_types (Union[bool, List[str]], optional): It could be boolean or a list of float32 input/output names. If True, model inputs/outputs should be left as float32. Defaults to False. disable_shape_infer (bool, optional): Skips running onnx shape/type inference. Useful if shape inference has been done. Defaults to False. op_block_list (List[str], optional): List of op types to leave as float32. Defaults to None, which will use `float16.DEFAULT_OP_BLOCK_LIST`. node_block_list (List[str], optional): List of node names to leave as float32. Defaults to None. force_fp16_initializers(bool): force converting all float initializers to float16. Default to false, which will convert only the one needed to avoid precision loss. force_fp16_inputs(Dict[str, List[int]]): Force the conversion of the inputs of some operators to float16, even if this script's preference it to keep them in float32. Raises: ValueError: input type is not ModelProto. Returns: ModelProto: converted model. "\o>zginvalid min_positive_val. smallest positive float16 value: subnormal 5.96e-08, and normalized 6.104e-05z4invalid max_finite_val. largest float16 value: 65504Nz1.8.0)dirTz$Expected an ONNX ModelProto but got z1.2.0c3^"TF#qPR9gKVPxK% R#5i)N)rszai.onnx)domainr ).0os& r +convert_float_to_float16..s![);Axx??Ziaii);s--)defaultrPz"fp16 parameters: min_positive_val=z max_finite_val=z keep_io_types=z disable_shape_infer=z op_block_list=z node_block_list=z force_fp16_initializers=graph_input_cast_graph_input_castCast)torNgraph_output_cast_graph_output_castr}Fr8 sequence_typezXinitializer is used by both fp32 and fp16 nodes. Consider add these nodes to block list: _cast_to_fp32_cast_to_fp32_node _cast_to_fp16_cast_to_fp16_node)EyeLike Multinomial RandomNormalRandomNormalLike RandomUniformRandomUniformLike SequenceEmpty Bernoulli)rrr)Lr*rfinfor+r&r9strr parseonnx __version__tempfileNamedTemporaryFileospathdirnamerNr loadrr:r;r DEFAULT_OP_BLOCK_LISTset opset_importdictALWAYS_FLOAT_INPUTSr(r)rdgraphinput tensor_type elem_typerr=outputlist enumerateadd value_infoCopyFromr>r make_noderbextendrrVr<rTrangelenop_typegetrf attributeimake_attributerggraphstrJtensors itertoolschainHasFieldrvaluesr]rOr\infoBFLOAT16).modelr-r. keep_io_typesdisable_shape_infer op_block_listnode_block_listforce_fp16_initializersforce_fp16_inputs#use_bfloat16_as_blocked_nodes_dtypeforce_fp16_inputs_dict model_pathtmpfileshape_infer_model_pathfunc_infer_shape onnx_opsetalways_float_inputsqueuevalue_info_list node_listmixed_float_type_node_list name_mappinggraph_io_to_skipio_castsn fp32_inputs fp32_outputsr output_name node_namenew_value_infonew_node input_namefp32_initializers next_levelqreuse_fp32_weightattr has_dtypevaluerbr accuracy_typeroutput_cast_names.&&&&&&&&&& rconvert_float_to_float16rs H x 'q ' U288BJJ#7#;#;< <t>tt <#4#>N~N^^mn{m|}RSfRggvwDvEEVWfVgg@AX@Y Z EOI "$# ' LLLuuH#(;;#4#4j#4a8J8J8T8TXcXiXi8i6166#4Kj$)KK$6$6l$6q!&&:L:L:V:VZeZkZk:kFAFF$6Ll-&&"-D+Qm1Cqq+ D#/F 2 LL #-"%++,,-1 66\ !-A6J#-L   (+c!f4I"[[33779N  # #A &",N 8C8K8KN   + + 5((*xAT]^_H KK   # #H -  " "> 2 LL #."8: % A!Z((!!!''*!Z((A{{k&7&77 vv->>>>4Fq4I)!&&1' Avv) "3qww<0771:5)5aggaj)AAGGAJ1#3qxx=188A;,6*6qxx{*CAHHQK2'(ii=&@&]&]AFFoD]O)2177); :%)::.=// !%8%<% > J J T / 6 6q 9Jk@"))+ "e&6&6&6 ?@Q@QSc tE   " "#>u?P?P#Q R(?(? notoooAB ,+&tzz2MAz+DLL99QBXB\B\]a]i]ikmBn=n- 0%*[[%;%;%?%?%AN"++J7",">K*5N'@K@Q@QN''33= *-A AI & 0 0* }YZaj klHKK$$++H5$/DJJqM.3+(-PK((U`UfUfMs4::'AAJ- 0%*[[%;%;%?%?%AN"++J7",">K*5N'@MN''33= *-A AI & 0 0* }Yfmv wxHKK$$++H5$/DJJqM.(&s4;;'(A[[^F- Z__,%*[[%;%;%?%?%AN"++J7'-'?$*:N'@MN''33= &)= =I & 0 0:J9KfXZ\cl mnHKK$$++H5%5DKKN.)/P LeNMM" PklDFsV30AD'7AD;5AEAE?5AE9AE% AE 3AE ? AE AED' AD8 D;AD=c@\V\4'g\R\V4 24hVP\P 8wd \R4hRpVP 'd!\P!VP 4pVP'd#\P!VPRR7pVf \R4h\W1V4p\P!\P!V\P!V4, 44#)zSMeasure the maximum absolute difference after converting a float tensor to float16.r5z#Expected tensor data type is float.Nr6r7zexternal data not loaded!)r9rr:r;r<r=r?rr@rBrC RuntimeErrorr3amaxabsr6)rEr-r. float32_datarFs&&& rfloat_to_float16_max_diffrs fk * *NtTZ|n]^^ ;,,,>??L xx 1 12  }}V__IF 677(XL 77266,L)AAB CCr")rp@)ArrayFeatureExtractor BinarizerCastMapCategoryMapperDictVectorizerFeatureVectorizerImputer LabelEncoderLinearClassifierLinearRegressor Normalizer OneHotEncoderr SVMClassifier SVMRegressorScalerTreeEnsembleClassifierTreeEnsembleRegressor TreeEnsembleZipMapNonMaxSuppressionTopKRoiAlignRangeCumSumMinMaxUpsample) rprFFNNFNF)rloggingrrnumpyrrrrrrrrr onnx.shape_inferencer r packagingr getLoggerrhr(rr3rJrOrrrTrrr"rr s  eee@   8 $E D"JO D !kAq6?QPQFS ) )AH Dr"