+ QV-jQ Rt^RIt^RIt^RIt^RIt^RIHt^RIHtH t ^RI H t ^RI H t Ht^RIHt^RIHtHt^RIHtHtHtHtHtHt^R IHt^R IHt^R IH t ^R I!H"t"^R I#H$t$H%t%H&t&^RI'H(t(H)t)H*t*H+t+H,t,H-t-H.t.H/t/H0t0H1t1^RI'H2t3^RI4H5t5]'d^RI6H7t7].Pp!]94t:]R2,t;Rt] !RR44t?] !RR44t@] !RR44tARRltB]]A]@]?3,tCRRltD]1RRR^R RR!R/R"R#ll4tE]1RRR^/R$R%ll4tF]1RRR RR!R/R&R'll4tGR(R)ltH]1R3R*R+ll4tI!R,R-]4tJ]1R4R.R/ll4tKR5R0R1lltLR#)6z< Type definitions and utilities for the `create_commit` API N) defaultdict)IterableIterator)contextmanager) dataclassfield)groupby)Path PurePosixPath) TYPE_CHECKINGAnyBinaryIOLiteral NamedTupleUnion) thread_map) constants)EntryNotFoundError) hf_hub_url) UploadInfo lfs_uploadpost_lfs_batch_info) FORBIDDEN_FOLDERSare_progress_bars_disabledchunk_iterable get_sessionhf_raise_for_status http_backoffloggingshatqdm_stream_filevalidate_hf_hub_args)tqdm)is_xet_available)RepoFileic:a]tRt^:toRtRtRtV3RltRtVt R#)CommitOperationDeletea{ Data structure holding necessary info to delete a file or a folder from a repository on the Hub. Args: path_in_repo (`str`): Relative filepath in the repo, for example: `"checkpoints/1fec34a/weights.bin"` for a file or `"checkpoints/1fec34a/"` for a folder. is_folder (`bool` or `Literal["auto"]`, *optional*) Whether the Delete Operation applies to a folder or not. If "auto", the path type (file or folder) is guessed automatically by looking if path ends with a "/" (folder) or not (file). To explicitly set the path type, you can set `is_folder=True` or `is_folder=False`. autoc\VP4VnVPR8Xd!VPPR4Vn\ VP\ 4'g\ RVP R24hR#)r(/zNWrong value for `is_folder`. Must be one of [`True`, `False`, `'auto'`]. Got 'z'.N)_validate_path_in_repo path_in_repo is_folderendswith isinstancebool ValueErrorselfs&l/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/huggingface_hub/_commit_api.py __post_init__#CommitOperationDelete.__post_init__Nsq243D3DE >>V #!..77,>,FUV V    )d.>.>.FUV V/G )r7c<V^8dQh/S[;R&S[;R&S[R,;R&S[R,;R&S[R,;R&S[R,;R&S[R,;R&S[;R &#) r9rKr,N src_revisionrLrM_src_oid _dest_oid_is_duplicated)r:r0)r;r<s"r4r= CommitOperationCopy.__annotate__Ys>?@AB*#CDt"EF:$GLDjMRTz SV Wr7)r,rK)r?r@rArBrCrPrLrMrQrRrSr5rDrErFrGs@r4rIrIYs<> $L"K $M H!I NW[r7rIca]tRt^toRt]!RRR7t]!RRRR7t]!RRRR7t]!RRRR7t ]!RRRR7t ]!RRRR7t V3RlRlt ] RV3RlR ll4tV3R lR lt]V3R lR l4tV3RltRtVtR#)CommitOperationAddas Data structure holding necessary info to upload a file to a repository on the Hub. Args: path_in_repo (`str`): Relative filepath in the repo, for example: `"checkpoints/1fec34a/weights.bin"` path_or_fileobj (`str`, `Path`, `bytes`, or `BinaryIO`): Either: - a path to a local file (as `str` or `pathlib.Path`) to upload - a buffer of bytes (`bytes`) holding the content of the file to upload - a "file object" (subclass of `io.BufferedIOBase`), typically obtained with `open(path, "rb")`. It must support `seek()` and `tell()` methods. Raises: [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If `path_or_fileobj` is not one of `str`, `Path`, `bytes` or `io.BufferedIOBase`. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If `path_or_fileobj` is a `str` or `Path` but not a path to an existing file. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If `path_or_fileobj` is a `io.BufferedIOBase` but it doesn't support both `seek()` and `tell()`. F)initreprN)rWrXdefaultc<V^8dQhRR/#r9returnN)r;r<s"r4r=CommitOperationAdd.__annotate__s!M!Mt!Mr7c \VP4Vn\VP\4'd\ VP4Vn\VP\ 4'd|\ PP\ PPVP44p\ PPV4'g\RV R24hM;\VP\P\34'g \R4h\VP\P4'dFVPP4VPP!^\ P"4\VP\ 4'd(\(P*!VP4VnR#\VP\4'd(\(P.!VP4VnR#\(P0!VP4VnR# \$\&3dp\R4ThRp?ii;i)z6Validates `path_or_fileobj` and compute `upload_info`.zProvided path: 'z(' is not a file on the local file systemzpath_or_fileobj must be either an instance of str, bytes or io.BufferedIOBase. If you passed a file-like object, make sure it is in binary mode.zNpath_or_fileobj is a file-like object but does not implement seek() and tell()N)r+r,r/path_or_fileobjr r:ospathnormpath expanduserisfiler1ioBufferedIOBasebytestellseekSEEK_CUROSErrorAttributeErrorr from_path upload_info from_bytes from_fileobj)r3r`excs& r4r5 CommitOperationAdd.__post_init__s243D3DE d**D 1 1#&t';';#>/22 #3O3DDl!mnn3D0023D3De2LMM#  d**B,=,= > > $$))+$$))!R[[9 d**C 0 0)33D4H4HID  ,,e 4 4)44T5I5IJD )66t7K7KLD ^,  d sAII1 I,,I1c6<V^8dQhRS[RS[S[,/#)r9 with_tqdmr\)r0rr )r;r<s"r4r=r^s /=/=/=(82D/=r7c# $"\VP\4'g!\VP\4'dbV'd-\ VP4;_uu_4pVxRRR4R#\ VPR4;_uu_4pVxRRR4R#\VP\ 4'd%\P!VP4xR#\VP\P4'dUVPP4pVPxVPPV\P4R#R# +'giR#;i +'giR#;i5i)u A context manager that yields a file-like object allowing to read the underlying data behind `path_or_fileobj`. Args: with_tqdm (`bool`, *optional*, defaults to `False`): If True, iterating over the file object will display a progress bar. Only works if the file-like object is a path to a file. Pure bytes and buffers are not supported. Example: ```python >>> operation = CommitOperationAdd( ... path_in_repo="remote/dir/weights.h5", ... path_or_fileobj="./local/weights.h5", ... ) CommitOperationAdd(path_in_repo='remote/dir/weights.h5', path_or_fileobj='./local/weights.h5') >>> with operation.as_file() as file: ... content = file.read() >>> with operation.as_file(with_tqdm=True) as file: ... while True: ... data = file.read(1024) ... if not data: ... break config.json: 100%|█████████████████████████| 8.19k/8.19k [00:02<00:00, 3.72kB/s] >>> with operation.as_file(with_tqdm=True) as file: ... httpx.put(..., data=file) config.json: 100%|█████████████████████████| 8.19k/8.19k [00:02<00:00, 3.72kB/s] ``` Nrb) r/r`r:r r openrhrfBytesIOrgrirjSEEK_SET)r3rufileprev_poss&& r4as_fileCommitOperationAdd.as_files H d**C 0 0Jt?S?SUY4Z4Z%d&:&:;;tJ<;$..55J65 ,,e 4 4**T112 2 ,,b.?.? @ @++002H&& &  % %h <A<;;655s=AF F(E(-(FE<CF( E9 3 F< F  Fc <V^8dQhRS[/#)r9r\)rh)r;r<s"r4r=r^s11E1r7c VP4;_uu_4p\P!VP44uuRRR4# +'giR#;i)zC The base64-encoded content of `path_or_fileobj` Returns: `bytes` N)r}base64 b64encodereadr3r{s& r4 b64contentCommitOperationAdd.b64contents1 \\^^t##DIIK0^^^s $A A c.<V^8dQhRS[R,/#r[r:)r;r<s"r4r=r^s11C$J1r7c BVPfR#VPR8Xd%VPPP4#VP 4;_uu_4p\ P !VP44uuRRR4# +'giR#;i)aReturn the OID of the local file. This OID is then compared to `self._remote_oid` to check if the file has changed compared to the remote one. If the file did not change, we won't upload it again to prevent empty commits. For LFS files, the OID corresponds to the SHA256 of the file content (used a LFS ref). For regular files, the OID corresponds to the SHA1 of the file content. Note: this is slightly different to git OID computation since the oid of an LFS file is usually the git-SHA1 of the pointer file content (not the actual file content). However, using the SHA256 is enough to detect changes and more convenient client-side. Nlfs) _upload_moderosha256hexr}rgit_hashrrs& r4 _local_oidCommitOperationAdd._local_oidsi    $   % '##**..0 04||DIIK0 s $B  B c<V^8dQh/S[;R&S[S[,S[,S[,;R&S[;R&S[R,;R&S[R,;R&S[R,;R&S[;R&S[;R &#) r9r,r`roNr_should_ignore _remote_oid _is_uploaded _is_committed)r:r rhr r UploadModer0)r;r<s"r4r=r^s2344Z%'(2256;7@t#QAH4KMIPtIQVEW\F]r7)r,r`ro)F)r?r@rArBrCrrorrrrrr5rr}rpropertyrrDrErFrGs@r4rVrVs2$U;K ',UD&QL#(U"MN$UDIKEuEL UFM!M!MF/=/=/=b1111_r7rVc0V^8dQhR\R\/#)r9r,r\r)r;s"r4r=r=5sr7caVPR4'd VR,pVR8XgVR8XgVPR4'd\RV R24hVPR4'd VR,p\Fso\;QJd.V3R lVP R44F 'gK R M# R M!V3R lVP R444'gKc\R S R V R24h V#)r*:NN.z..z../z,Invalid `path_in_repo` in CommitOperation: ''z./:r9NNc3,<"TF qS8HxK R#5iNr]).0part forbiddens& r4 )_validate_path_in_repo..>sE-DTy -DsTFzHInvalid `path_in_repo` in CommitOperation: cannot update files under a 'z/' folder (path: 'z').) startswithr1ranysplit)r,rs&@r4r+r+5ss###B' sld2l6M6Me6T6TG ~UVWXXt$$#B' & 3E\-?-?-DE333E\-?-?-DE E EZ[dZef!N#' ' r7c>V^8dQhR\\,RR/#)r9 operationsr\N)listCommitOperation)r;s"r4r=r=Is++_0E+$+r7cn\\4pVEFpVPp\V\4'dvW,^8d\ P !RV R24W;;,^, uu&\V4PF!pV\V4;;,^, uu&K# \V\4'gKV\\V44,^8gKVP'd\ P !RV R24EK\ P !RV R24EK! R#)ab Warn user when a list of operations is expected to overwrite itself in a single commit. Rules: - If a filepath is updated by multiple `CommitOperationAdd` operations, a warning message is triggered. - If a filepath is updated at least once by a `CommitOperationAdd` and then deleted by a `CommitOperationDelete`, a warning is triggered. - If a `CommitOperationDelete` deletes a filepath that is then updated by a `CommitOperationAdd`, no warning is triggered. This is usually useless (no need to delete before upload) but can happen if a user deletes an entire folder and then add new files to it. zBAbout to update multiple times the same file in the same commit: 'z9'. This can cause undesired inconsistencies in your repo.z_About to delete a folder containing files that have just been updated within the same commit: 'zLAbout to delete a file that have just been updated within the same commit: 'N) rintr,r/rVwarningswarnr parentsr:r'r-)rnb_additions_per_path operationr,parents& r4_warn_on_overwriting_operationsrIs-8,<  -- i!3 4 4$2Q6 %'"" " /1 4 /' 5==&c&k2a72> i!6 7 7$S|)D%EFJ&&&MM==INKII MM**6899/ r7endpoint num_threadsrevision create_prcV^8dQhR\\,R\R\R\\\3,R\R,R\R\R,R \ R,/#) r9 additions repo_typerepo_idheadersrNrrr)rrVr:dictrr0)r;s"r4r=r=xs~N N &'N N  N #s(^ N Dj N N DjN d{N r7c .p.p /p \V\R7EFp V U u.uFqNK p p RR.p\;QJdRV 4F 'gK RM RM !RV 44p\4'd0V'gVP R4M\ P R4\V U u.uFqPNK up VVVVVR VR 7wpppV'ddR PVUu.uF9pR VPR 4 RVPR/4PR4 2NK; up4p\RV 24hVR8XdRV9dVPV 4EKHV PV4V F)p WV PPP4&K+ EK \V 4^8d\!V V VVVR7\V4^8d\#VVVVVVVR7R #R #uup iuup iuupi)zC Negotiates per-file transfer (LFS vs Xet) and uploads in batches. ) chunk_sizebasic multipartc3j"TF)p\VP\P4xK+ R#5ir)r/r`rfrg)rops& r4r _upload_files..s)"j_iY[:b.@.@"BSBS#T#T_is13TFxetzcUploading files as a binary IO buffer is not supported by Xet Storage. Falling back to HTTP upload.N) upload_infosrrrrrtoken transfers z$Encountered error for file with OID oidz: `errormessagezLFS batch API returned errors: )actions oid2addoprrr)rrrrrrr)rUPLOAD_BATCH_MAX_NUM_FILESrr#appendloggerwarningrrojoingetr1extendrrlen_upload_lfs_files_upload_xet_files)rrrrrrrr xet_additions lfs_actions lfs_oid2addopchunkr chunk_listrhas_buffered_io_data actions_chunk errors_chunkchosen_transfererrrs$$$$$$$$ r4 _upload_filesrws/1M(*K35M 6PQQ#()5Rb5 ) '5 "s"j_i"jsss"j_i"jj   '  '3 8K3=>:R..:> 8 4 |_ ii ,+;3775>:J#cggV]_aNbNfNfgpNqMrs+G ?yIJ J e #));   ,   } - =?bnn33779:!ORT ;!##   =A# e*?s G+,G0 *?G5 c V^8dQhR\\\\3,,R\\\3,R\\\3,R\R,R\ /#)r9rrrrNr)rrr:r rVr)r;s"r4r=r=sgP P $sCx. !P C++,P #s(^ P Dj P  P r7caaa.pVFZpVPR4f4\PRSVR,,P R24KIVP V4K\ RVVV3Rllp\ V4^8Xd'\PR4V!V^,4R#\PR \ V4 R V R 24\ VVR \ V4 R 2V\R7R#)aS Uploads the content of `additions` to the Hub using the large file storage protocol. Relevant external documentation: - LFS Batch API: https://github.com/git-lfs/git-lfs/blob/main/docs/api/batch.md Args: actions (`list[dict[str, Any]]`): LFS batch actions returned by the server. oid2addop (`dict[str, CommitOperationAdd]`): A dictionary mapping the OID of the file to the corresponding `CommitOperationAdd` object. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. endpoint (`str`, *optional*): The endpoint to use for the request. Defaults to `constants.ENDPOINT`. num_threads (`int`, *optional*): The number of concurrent threads to use when uploading. Defaults to 5. Raises: [`EnvironmentError`](https://docs.python.org/3/library/exceptions.html#EnvironmentError) If an upload failed for any reason [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) Type of the repo to upload to: `"model"`, `"dataset"` or `"space"`. repo_id (`str`): A namespace (user or an organization) and a repo name separated by a `/`. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. num_threads (`int`, *optional*): The number of concurrent threads to use when uploading. Defaults to 5. revision (`str`, *optional*): The git revision to upload to. Raises: [`EnvironmentError`](https://docs.python.org/3/library/exceptions.html#EnvironmentError) If an upload failed for any reason [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the server returns malformed responses [`HfHubHTTPError`] If the LFS batch endpoint returned an HTTP error. rNzContent of file rz/ is already present upstream - skipping upload.cV^8dQhRR/#r[r])r;s"r4r='_upload_lfs_files..__annotate__siiTir7c<SVR,,p\WSSR7R# \d p\RXP R24ThRp?ii;i)r)rlfs_batch_actionrrzError while uploading 'z ' to the Hub.N)r Exception RuntimeErrorr,) batch_actionrrrrrrs& r4_wrapped_lfs_upload._upload_lfs_files.._wrapped_lfs_uploadsX i!,u"56I SZem n i!89O9O8PP]^_eh h is# A AA zUploading 1 LFS file to the Hubz Uploading z" LFS files to the Hub using up to z threads concurrentlyzUpload z LFS files)desc max_workers tqdm_class)rrdebugr,rrrhf_tqdm)rrrrrfiltered_actionsactionrs$ddd$ r4rrsf ::i ( LL"9VE]#;#H#H"IIxy   # #F + ii ! 67,Q/0 -.//QR]Q^^s t    3/01<#  r7cV^8dQhR\\,R\R\R\\\3,R\R,R\R,R\R,/#) r9rrrrrNrr)rrVr:rr0)r;s"r4r=r=ssuu&'uu u #s(^ u Dj uDjud{ur7c0\V4^8XdR#^RIHpHpHp Hp Hp ^RIHp V !VPVVVVR7p V'd V R, p V !V4pV !4pRp\4'gV !4pVPpMRpVUu.uF'p\VP\4'gK%VNK) ppVUu.uF-p\VP\\ 34'gK+VNK/ ppVP#V VVVR7;_uu_4pVFKpVP%\VP4VP&P(P+4R7KM VFBpVP-VPVP&P(P+4R7KD RRR4TeTP14R#R#uupiuupi +'giL2;i \.d T!4hi;i TeTP14ii;i)a Uploads the content of `additions` to the Hub using the xet storage protocol. This chunks the files and deduplicates the chunks before uploading them to xetcas storage. Args: additions (`` of `CommitOperationAdd`): The files to be uploaded. repo_type (`str`): Type of the repo (e.g. `"model"`, `"dataset"`, `"space"`). repo_id (`str`): A namespace (user or an organization) and a repo name separated by a `/`. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. endpoint: (`str`, *optional*): The endpoint to use for the xetcas service. Defaults to `constants.ENDPOINT`. revision (`str`, *optional*): The git revision to upload to. create_pr (`bool`, *optional*): Whether or not to create a Pull Request with that commit. Raises: [`EnvironmentError`](https://docs.python.org/3/library/exceptions.html#EnvironmentError) If an upload failed for any reason. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the server returns malformed responses or if the user is unauthorized to upload to xet storage. [`HfHubHTTPError`] If the LFS batch endpoint returned an HTTP error. **How it works:** The file upload system uses Xet storage, which is a content-addressable storage system that breaks files into chunks for efficient storage and transfer. ``session.new_upload_commit()`` manages uploading files by: - Registering upload tasks and starting upload immediately in the background - Breaking files into smaller chunks for efficient storage - Avoiding duplicate storage by recognizing identical chunks across files - Connecting to a storage server (CAS server) that manages these chunks Authentication works transparently: the upload commit accepts a ``token_refresh_url`` that is used to refresh the short-lived xet write token as needed. The upload process works like this: 1. Upload tasks run in parallel: 1.1. Read the file content from a path, bytes array, or a stream. 1.2. Split the file content into smaller chunks based on content patterns: each chunk gets a unique ID based on what's in it. 1.3. For each chunk: - Check if it already exists in storage. - Skip uploading chunks that already exist. 1.4. Group chunks into larger blocks for efficient transfer. 1.5. Upload these blocks to the storage server. 1.6. Assemble the file manifest locally and send it to the server for validation. 2. Return reference files that contain information about the uploaded files, which can be used later to download them. N) XetTokenTypeabort_xet_sessionget_xet_sessionxet_connection_info_refresh_urlxet_headers_without_auth)XetProgressReporter) token_typerrrrz ?create_pr=1)token_refresh_urltoken_refresh_headerscustom_headersprogress_callback)r)r utils._xetrrrrrutils._xet_progress_reportingrWRITErupdate_progressr/r`rhr:r new_upload_commitstart_upload_filerorrstart_upload_bytesKeyboardInterruptclose)rrrrrrrrrrrrr refresh_url xet_headerssessionprogressrr all_bytes_ops all_paths_opscommits$$$$$$$ r4rrsB 9~C1%% K~% *73KGH)++*,H ( 8 8  $ &/Yi:b>P>PRW3Xi Y&/_i:b>P>PSVX\R]3^i _  & &)")&/ '  #((R-?-?)@I^I^IbIbId(e$#))"*<*(G+G1G'BG*G' G' G$ G'#G>$G''G;;G>>Hc$V^8dQhR\/#)r9preupload_info)r)r;s"r4r=r=s  T r7cnVPR4p\V\4'g \R4hVF|p\V\4'd[\VPR4\ 4'd6\VPR4\ 4'dVR,R9dKs\R4h V#)filesz&preupload_info is improperly formattedrb uploadModez'preupload_info is improperly formatted:rregular)rr/rr1rr:)rr file_infos& r4_validate_preupload_infors   w 'E eT " "ABB y$ ' '9==0#669==6<<<(,>>FG G r7cV^8dQhR\\,R\R\R\\\3,R\R\R,R\R \R,R R/ #) r9rrrrrrNrgitignore_contentr\)rrVr:rr0)r;s"r4r=r=sR.R.*+R.R.R.#s(^ R.  R. Dj R.R.TzR. R.r7c pVeTM\Pp/p/p /p \VR4EFvp RV U u.uF`p RV PR\P !V P P4PR4RV P P/NKb up /p VeW}R&\R V R V R V R V 2T TV'dR R/MRR7p\V4\VP44pVP!R/VR,Uu/uFpVR,VR,bK upBV P!R/VR,Uu/uFpVR,VR,bK upBV P!R/VR,Uu/uFpVR,VPR4bK upBEKy VFKpVVP,VnV VP,VnV VP,VnKM VF'pVP P^8XgK RVnK) R#uup iuupiuupiuupi)a Requests the Hub "preupload" endpoint to determine whether each input file should be uploaded as a regular git blob, as a git LFS blob, or as a XET file. Input `additions` are mutated in-place with the upload mode. Args: additions (`Iterable` of :class:`CommitOperationAdd`): Iterable of :class:`CommitOperationAdd` describing the files to upload to the Hub. repo_type (`str`): Type of the repo to upload to: `"model"`, `"dataset"` or `"space"`. repo_id (`str`): A namespace (user or an organization) and a repo name separated by a `/`. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. revision (`str`): The git revision to upload the files to. Can be any valid git revision. gitignore_content (`str`, *optional*): The content of the `.gitignore` file to know which files should be ignored. The order of priority is to first check if `gitignore_content` is passed, then check if the `.gitignore` file is present in the list of files to commit and finally default to the `.gitignore` file already hosted on the Hub (if any). Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. Nr%rrbsampleasciisize gitIgnorePOSTz/api/s/z /preupload/r1)jsonrparamsr shouldIgnorerrr])rENDPOINTrr,rrrordecoder!rrrr&updaterrrr)rrrrrrrr upload_modesshould_ignore_infooid_inforrpayloadresprr{additions&&&&&&&& r4_fetch_upload_modesr2s*N$/xY5G5GH+-L*,&(H 3/     B BOOf..r~~/D/DELLWUBNN//      (#4K  ji[7);xj I)2K%   D!1$))+>eN[bLcdLcDtF|T,-??Lcde!!mTbcjTk$lTkDT&\43G%GTk$lm^^T[E\]E\T4<%8E\]^308 ,X-B-B C"4X5J5J"K'(=(=>    $ $ )$-H !C*e$l]sA&H$H)H.8"H3c,a]tRtRtoV3RltRtVtR#) _CopySourceict<V^8dQh/S[R,;R&S[R,;R&S[;R&S[R,;R&#)r9NrLrMrbrr)r;r<s"r4r=_CopySource.__annotate__s@t: IDj r7r]N)r?r@rArBrDrErFrGs@r4r4r4sr7r4cV^8dQhR\\,R\R\R\\\3,R\R\R,R\\\ R \ 3,3,/#) r9copiesrrrrrNr\r$)rrIr:rr4rrh)r;s"r4r=r=s}nn ( )nnn#s(^ n  n Dj n +uZ./ /0nr7c ^RIHpHpV!WSR7p\V4p/p /p VU u.uFqPNK p p \ V \ 4FWp VPV\V 4VVR7pVF0p\W4'dKVPWPV3&K2 KY VPRR7\VRR7EFwwpppp\V4pVRJpT;'gTpT;'gTpT;'g V'dRMTpVU u.uFqPNK pp \ V\ 4FpVPV\V4VVR7pVFp\VV4'd \R 4h\VVVPV4pVP 'dVV V&MO\#VVVVVPR 7p\%4P'VVR 7p\)V4VP*V V&V'dKVPV VPV3&K K VFp \VVV PV4p!V!V 9d1V'd R V R V 2MRp"\-RV P RV V" R24hV P'V PV34V nV'dK~V P'V PV P034V nK EK V #uup iuup i)a Fetch information about the files to copy. For LFS files, we only need their metadata (file size and sha256) while for regular files we need to download the raw content from the Hub. Args: copies (`Iterable` of :class:`CommitOperationCopy`): Iterable of :class:`CommitOperationCopy` describing the files to copy on the Hub. repo_type (`str`): Type of the repo to upload to: `"model"`, `"dataset"` or `"space"`. repo_id (`str`): A namespace (user or an organization) and a repo name separated by a `/`. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. revision (`str`): The git revision to upload the files to. Can be any valid git revision. Returns: `dict[_CopySource, Union[RepoFile, bytes]]]` Key is `(src_repo_id, src_repo_type, path, revision)`. For intra-repo copies, `src_repo_id` and `src_repo_type` are `None`. Value is the raw content as bytes (for regular files) or the file information as a RepoFile (for LFS files). Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. )HfApi RepoFolder)rr)rpathsrrcVP;'gRVP;'gRVP;'gR3#)rLrMrPrs&r4&_fetch_files_to_copy..?s2 4 4"b6F6F6L6L"booNcNcacdr7)keycHVPVPVP3#rr?r@s&r4rArBAs0@0@"//Rr7Nmainz$Copying a folder is not implemented.)rrrrfilename)rz from r$r>z Cannot copy z at revision z: file is missing on repo.)hf_apir:r;rr,rFETCH_LFS_BATCH_SIZEget_paths_infor/blob_idrbsortrrKNotImplementedErrorr4rrrrrcontentrrRrPrQ)#r8rrrrrr:r;rG files_to_copyr.r dest_pathsbatchdest_repo_filesr{src_repo_id_keysrc_repo_type_keysrc_revision_keygroupr is_cross_repo eff_repo_id eff_repo_type eff_revision src_paths paths_batchsrc_repo_files src_repo_filesourceurlresponserrC source_descs#&&&&&& r4_fetch_files_to_copyrbsP* H 6F &\FACM9;H-33Fb//FJ3 ,@A //u+ 0  $Dd//26,,))X./$B KKdKeIPRJJE>+-=%[ 't3 %00 )66Y 'RRmF 3=>:R((: >))5IJK#22#;'%' 3N "0 mZ88-.TUU$_6GI[I[]mn $$$,9M&)$!)"/ +!-!.!3!3 C +}00g0FH'1,4,<,m#n[M1KM#+,, 0F0F/Q"RI  =%-\\93M3MyOeOe2f%g "$KJb 4.?s KK$cV^8dQhR\\,R\\\R\ 3,3,R\ R\ R,R\ R,R\\\ \3,,/#) r9rrNr$commit_messagecommit_descriptionN parent_commitr\)rrrr4rrhr:r )r;s"r4r=r=tsebeb)eb U:u+<%==>ebebd eb : eb d38n ebr7c #"VeTMRpRVRV/pVeWER&RRRV/x^pVEF~p\V\4'dAVP'd/\P R VP R 24V^, pKZ\V\4'dHVP R 8Xd7RR RR VP4P4RVP RR//xK\V\4'deVP R8XdTRRRRVP RRRVPPP4RVPP//xEK1\V\4'd,RVP'dRMRRRVP //xEKr\V\4'd\!VP"VP$VP&VP(4pW,p \V \*4'd>RR RR \,P.!V 4P4RVP RR//xEKV P0'd0RRRRVP RRRV P0P//xEKZ\3R4h\3RV R\5VRR4 24h V^8d\P7RV R24R#R#5i)a+ Builds the payload to POST to the `/commit` API of the Hub. Payload is returned as an iterator so that it can be streamed as a ndjson in the POST request. For more information, see: - https://github.com/huggingface/huggingface_hub/issues/1085#issuecomment-1265208073 - http://ndjson.org/ Nr>summary description parentCommitrCheadervaluezSkipping file 'z(' in commit (ignored by gitignore file).rr{rMrbencodingrrlfsFilealgorrr! deletedFolder deletedFilez_Malformed files_to_copy (should be raw file content as bytes or RepoFile objects with LFS info.z(Unknown operation to commit. Operation: z. Upload mode: rzSkipped z/ file(s) in commit (ignored by gitignore file).)r/rVrrrr,rrr*rorrr!r'r-rIr4rLrMrKrPrhrrrr1getattrinfo) rrNrdrerf header_valuenb_ignored_filesrr^ file_to_copys &&&&& r4_prepare_commit_payloadrwts"0B/M+SU~}>PQL '4^$ (G\ 22 i!3 4 49Q9Q9Q LL?9+A+A*BBjk l  !   i!3 4 49O9OS\9\vy335<<>I22  #5 6 69;Q;QUZ;ZyI22H90077;;=I1166   #8 9 9)*=*=*==&)"8"89   #6 7 7 %%''**&& F )0L,..6!6#3#3L#A#H#H#J 6 6"H!!!9 6 6|//66!u :9+FI~t<=? G P! h/00_`asAK D-K ?CK Arerrorsr file_downloadrrrrrutilsrrrrrrrrr r!r"rutils._runtimer#rGr$ get_loggerr?rrrHDUPLICATE_LFS_BATCH_SIZErr'rIrVr+rrrrrrr2r4rbrwr]r7r4rs #.%('KK.&%<<   #,    H %% &    < 2W2W 2Wj b1b1 b1J"*,?AVVW+\N  N N  N "N N bP  P  P P fu  u u"uup R.R.j*nnbebebr7