+ QV-jRt^RIHt^RIHtHt^RIHtHt^RI H t ]!R4t ]] .] 3,t ]] .]R,3,tRtRRR RR RR R/t] P"!]4t]!R R 44tRRR]/RRlltRRltR#)z.Contains helpers to split tensors into shards.)Callable) dataclassfield)AnyTypeVar)loggingTensorTN5GBTBGBMBKBcDa]tRt^'to]!RR7tRtV3RltRtVt R#)StateDictSplitF)initc@\VP4^8VnR#)N)lenfilename_to_tensors is_sharded)selfs&t/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/huggingface_hub/serialization/_base.py __post_init__StateDictSplit.__post_init__.sd667!;c<V^8dQh/S[;R&S[S[S[3,;R&S[S[S[S[,3,;R&S[S[S[3,;R&#)rmetadatartensor_to_filename)booldictstrrlist)format __classdict__s"r __annotate__StateDictSplit.__annotate__'sT(38nc49n--  S#X& r)rN) __name__ __module__ __qualname____firstlineno__rrr__annotate_func____static_attributes____classdictcell__)r$s@rrr's%(J <rrget_storage_idcR#)N)tensors&rr27s4rmax_shard_sizec V^8dQhR\\\3,R\R\R\R\ \,R\ /#)r state_dictget_storage_sizefilename_patternr.r3return)r r!rTensorSizeFn_T StorageIDFn_Tintr)r#s"rr%r%2s[}}S'\"}%} } " } #I }}rc /p.p/p^p^p \V\4'd \V4pVP4Fwr\V \4'd\P RV 4K3V!V 4p V e%W9dW\,P V 4K^V .W\&V!V 4p W8dW, p VP W/4KW,V8dVP V4/p^pWV &W, pW, p K \V4^8dVP V4\V4pVP4F3wrVF(pV^,V9gKVFp W ,VV &K K1 K5 V^8XdZVPRR7p\RV /V\VP44/VP4U u/uFqVbK up R7#/p/p\V4FQwppVPRV^,R RVR 2R7pVFp VVV &K \VP44VV&KS \RV /VVR7#uup i) a Split a model state dictionary in shards so that each shard is smaller than a given size. The shards are determined by iterating through the `state_dict` in the order of its keys. There is no optimization made to make each shard as close as possible to the maximum size passed. For example, if the limit is 10GB and we have tensors of sizes [6GB, 6GB, 2GB, 6GB, 2GB, 2GB] they will get sharded as [6GB], [6+2GB], [6+2+2GB] and not [6+2+2GB], [6+2GB], [6GB]. > [!WARNING] > If one of the model's tensor is bigger than `max_shard_size`, it will end up in its own shard which will have a > size greater than `max_shard_size`. Args: state_dict (`dict[str, Tensor]`): The state dictionary to save. get_storage_size (`Callable[[Tensor], int]`): A function that returns the size of a tensor when saved on disk in bytes. get_storage_id (`Callable[[Tensor], Optional[Any]]`, *optional*): A function that returns a unique identifier to a tensor storage. Multiple different tensors can share the same underlying storage. This identifier is guaranteed to be unique and constant for this tensor's storage during its lifetime. Two tensor storages with non-overlapping lifetimes may have the same id. filename_pattern (`str`, *optional*): The pattern to generate the files names in which the model will be saved. Pattern must be a string that can be formatted with `filename_pattern.format(suffix=...)` and must contain the keyword `suffix` max_shard_size (`int` or `str`, *optional*): The maximum size of each shard, in bytes. Defaults to 5GB. Returns: [`StateDictSplit`]: A `StateDictSplit` object containing the shards and the index to retrieve them. z8Skipping tensor %s as it is a string (bnb serialization))suffix total_size)rrr-05dz-of-) isinstancer!parse_size_to_intitemsloggerinfoappendrr#rr"keys enumerate)r5r6r7r.r3storage_id_to_tensors shard_list current_shardcurrent_shard_sizer?keyr1 storage_id tensor_size nb_shardsrHshardfilenametensor_name_to_filenameridxs&$$$$ r$split_state_dict_into_shards_factoryrV2sL35+-J(*MJ.#&&*>:!'')  fc " " KKRTW X $F+  !2%188=69E%1'v.   '  %J   sm ,   +n <   m ,M!" $c)! M*R =A-(JI2779 EAw%C!+E#J   :A~#**"*5"J/!)4 0A+B C9C9JK9J#X 9JK  ! + U#**AcAgc]$yQTo2V*WC+3 #C ((,UZZ\(:H% ,  +/2  Ls I c0V^8dQhR\R\/#)r size_as_strr8)r!r;)r#s"rr%r%s##3#3#rcBVP4pVRRP4pV\9d\RV RV R24h\V,p\ VRRP44p\ Y2,4# \dp\RT RT 24ThRp?ii;i)a% Parse a size expressed as a string with digits and unit (like `"5MB"`) to an integer (in bytes). Supported units are "TB", "GB", "MB", "KB". Args: size_as_str (`str`): The size to convert. Will be directly returned if an `int`. Example: ```py >>> parse_size_to_int("5MB") 5000000 ``` NzUnit 'z:' not supported. Supported units are TB, GB, MB, KB. Got 'z'.z%Could not parse the size value from 'z': )stripupper SIZE_UNITS ValueErrorfloatr;)rXunit multipliervaluees& rrCrCs ##%K rs  ! ! #D :6$'abmannpqrrD!J]k#2&,,./ u! "" ]@ SQRPSTU[\\]sA<< BBBlJ)iʚ;i@Bi)__doc__collections.abcr dataclassesrrtypingrrr=rrr;r9r:MAX_SHARD_SIZEr] get_logger__file__rErrVrCr0rrrks5$( ) 7)S.)'C$J./ &%%%     H % << <} %8 } !/ }@#r