(tidnddlZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZmZmZmZmZddlmZmZddlmZddlmZmZmZmZmZmZddlm Z d d l!m"Z"d d l#m$Z$m%Z%m&Z&m'Z'd d l(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0d dl1m2Z2e2e3Z4ee5jldz Z7e jpZ9d:de:e;zdzde;fdZ< d;de;de;dzde=de=de;dzde;de;dzde;dzde>e:dzde=dzde=de=de fd Z?d:d!e d"e;e>e;zdzde fd#Z@d:d$e;dzd%e;dzfd&ZAd:d'e;d(e;dzde;fd)ZBeddddddddddd* d+e;ezd'e;d,e;dzd-e;dzd.e=d/e:dzd0e=de;dzde:e;zdzd1e;dzd%e;dzd2e:e;e fdzfd3ZC de;d(e;fd7ZEGd8d9ZFy)>N)Path)uuid4) DDUFEntry ModelCard ModelCardData create_repohf_hub_download model_infosnapshot_download upload_folder)HF_HUB_DISABLE_TELEMETRYHF_HUB_OFFLINE)REGEX_COMMIT_HASH)EntryNotFoundErrorHfHubHTTPErrorRepositoryNotFoundErrorRevisionNotFoundErroris_jinja_availablevalidate_hf_hub_args)version) __version__)DEPRECATED_REVISION_ARGSHUGGINGFACE_CO_RESOLVE_ENDPOINTSAFETENSORS_WEIGHTS_NAME WEIGHTS_NAME)ENV_VARS_TRUE_VALUES _flax_version _jax_version_onnxruntime_version_torch_versionis_flax_availableis_onnx_availableis_torch_available) get_loggerzmodel_card_template.md user_agentreturncFdtdtjjddt}t st r|dzStr |dtz }tr|dtz }|dtz }tr |d tz }tjj!d d j#t$vr|d z }t'|t(r.|d d j+d|j-Dzz }|St'|t.r|d |zz }|S)zF Formats a user-agent string with basic info about a request. z diffusers/z ; python/rz ; session_id/z; telemetry/offz; torch/z; jax/z; flax/z; onnxruntime/DIFFUSERS_IS_CIz ; is_ci/truez; c30K|]\}}|d|yw)/N).0kvs h/Volumes/fast/ai/experiments/MLX_z-image/.venv/lib/python3.12/site-packages/diffusers/utils/hub_utils.py z"http_user_agent..\s!I6Hda!AaSz6Hs)rsysrsplit SESSION_IDr rr%r"r#r rr$r!osenvirongetupperr isinstancedictjoinitemsstr)r'uas r2http_user_agentrAJs k])CKK,=,=,?,B+C=Q[P\ ]B>%%% ()) |n%%  '' 3455 zz~~',2248LL n*d# dTYYIj6F6F6HIIII I J $ dZ IFrepo_id_or_pathtoken is_pipeline from_trainingmodel_description base_modelpromptlicensewidget inference is_modularupdate_model_cardc ts td| r | s td tj||} | r"| r || j} t|} | | _| S#t t f$r||r.tjt|d| |||t|} Y| St}| r|t|} || _Y| S|rdnd}|d |d }tj|| } Y| SwxYw) a Loads or creates a model card. Args: repo_id_or_path (`str`): The repo id (e.g., "stable-diffusion-v1-5/stable-diffusion-v1-5") or local path where to look for the model card. token (`str`, *optional*): Authentication token. Will default to the stored token. See https://huggingface.co/settings/token for more details. is_pipeline (`bool`): Boolean to indicate if we're adding tag to a [`DiffusionPipeline`]. from_training: (`bool`): Boolean flag to denote if the model card is being created from a training script. model_description (`str`, *optional*): Model description to add to the model card. Helpful when using `load_or_create_model_card` from a training script. base_model (`str`): Base model identifier (e.g., "stabilityai/stable-diffusion-xl-base-1.0"). Useful for DreamBooth-like training. prompt (`str`, *optional*): Prompt used for training. Useful for DreamBooth-like training. license: (`str`, *optional*): License of the output artifact. Helpful when using `load_or_create_model_card` from a training script. widget (`list[dict]`, *optional*): Widget to accompany a gallery template. inference: (`bool`, optional): Whether to turn on inference widget. Helpful when using `load_or_create_model_card` from a training script. is_modular: (`bool`, optional): Boolean flag to denote if the model card is for a modular pipeline. When True, uses model_description as-is without additional template formatting. update_model_card: (`bool`, optional): When True, regenerates the model card content even if one already exists on the remote repo. Existing card metadata (tags, license, etc.) is preserved. Only supported for modular pipelines (i.e., `is_modular=True`). zModelcard rendering is based on Jinja templates. Please make sure to have `jinja` installed before using `load_or_create_model_card`. To install it, please run `pip install Jinja2`.zU`update_model_card=True` is only supported for modular pipelines (`is_modular=True`).rD diffusers)rJ library_namerLrHinstance_promptrK) card_data template_pathrGpipelinemodelu+This is the model card of a 🧨 diffusers zS that has been pushed on the Hub. This model card has been automatically generated.)rG) r ValueErrorrloaddatarr from_templaterMODEL_CARD_TEMPLATE_PATH)rCrDrErFrGrHrIrJrKrLrMrN model_card existing_datarT components r2load_or_create_model_cardr`bs9V   ?  pqq e^^O5A 0A0M&OOM"#45J+JO6 5  7 8e "00'#!,')$*! 7"3 J. &I/;&'89 "+   +6J7 $,*UV_U`at)u%&44YRcd 5es;A##;HDHrB weights_namevariantcl|1|jd}|dd|gz|ddz}dj|}|S)N.)r5r=)rorpsplitss r2 _add_variantrusI##C(y(6"#;6xx' rB) subfolder cache_dirforce_downloadproxieslocal_files_onlyrDr'revisionrg dduf_entriespretrained_model_name_or_pathrvrwrxryrzr{r|c t|}| rM| td|dk(r|ndj||g} | | vr| Std|d| j dt j j|r|St j j|rt j jt j j||r"t j j||} | S|at j jt j j|||r#t j j|||} | Std|d|d| tvr|tk(s |tk(rtjtjtjtjdk\rS t!|t#|| |||||||| xs| } t%j&d | d |d | d | d| d| d t(| S t!|||||||||| xs| } | S#t%j&d| d |d | d| d|dt#|| d|d|dt#|| dt(YjxYw#t*$r} t|d| d} ~ wt,$r} t| d|d| d} ~ wt.$r} t|d|d| d} ~ wt0$r} td|d| | d} ~ wt$r} tdt2d |d!|d"| d} ~ wt$r} td#|d$|d%|| d} ~ wwxYw)&NzDDUF file only allow for 1 level of directory (e.g transformer/model1/model.safetentors is not allowed). Please check the DDUF structurer+r-zError no file named z found in archive rrz found in directory z0.22.0) filenamerwrxryrzrDr'rvr{zLoading the variant z from z via `revision='zG'` is deprecated. Loading instead from `revision='main'` with `variant=z)`. Loading model variants via `revision='z9'` will be removed in diffusers v1. Please use `variant='z '` instead.zYou are loading the variant z^'`. This behavior is deprecated and will be removed in diffusers v1. One should use `variant='z%'` instead. However, it appears that z currently does not have a z file in the 'main' branch of z. The Diffusers team and community would be very grateful if you could open an issue: https://github.com/huggingface/diffusers/issues/new with the title 'z is missing z0' so that the correct variant file can be added.z is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models' If this is a private repository, make sure to pass a token having permission to this repo with `token` or log in with `hf auth login`.z is not a valid git identifier (branch name, tag name or commit id) that exists for this model name. Check the model page at 'https://huggingface.co/z' for available revisions.& does not appear to have a file named z:There was a specific connection error when trying to load z: We couldn't connect to 'zM' to load this model, couldn't find it in the cached files and it looks like z8 is not the path to a directory containing a file named z or Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/diffusers/installation#offline-mode'.zCan't load the model for 'z'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'z=' is the correct path to a directory containing a file named )r?rXr=EnvironmentErrorkeysr7pathisfileisdirrrrrparser base_versionr ruwarningswarn FutureWarningrrrrr)r}rorvrwrxryrzrDr'r{rgr| model_filees r2_get_model_filers %((E$F!  2  -2 8,GH   % "%9,GYZfZkZkZmYnno#pq q 5 6,, 4 5 77>>"'',,'DlS T&C\RJ   "rww~~ GGLL6 < P( &CYP\]J "&|n4HIfHgghi  0 0-AY1Y gmmK8EEF'--X`Jaa ,1),A'#1#%5)'%4   *8*F;X:YYijrist{|D{EEnownxxqrzq{{FG!"! 2 (-%#-!1%#!0[ J '  28*FC`Baaqrzq{|Z[cZddIJgIhhCDPQ]_gDhCiiGHeGffC D a C b b n o { | H J R o S n T T D E !(' "012dd   % "*++H*IIce   " "011WXdWeefg  "LMjLkknopnqr  "*+J*KL::W9XY66B^Dff     ",-J,KL))F(GH++7.:    sbAI)JA J MJ-- M9K  MK)) M5L ML-- M9MMc X| r|| vrCtd|d|dtjj|std|d|d| r't j | |j } n8t|d5} t j | j} dddtt dj} | d} t| dj| d<| dj| d<tjj||}tjj!|s| r| D cgc]"} tjj|| $}} |D]J| r| vs t#|d d tjj%r;t#|d d || fS| }|-|Dcgc]"}tjj||$}}d d g}|sFt'||| }| D]3t)fd|j*D}|r$t-|d d  t/||||||||| }| tjj||}| D cgc]"} tjj|| $}} |D]2}tjj|r#t-|d|d || fS#1swYFxYwcc} wcc}w#t0$r}t-dt2d|d|d}~wwxYwcc} w)a For a given model: - download and cache all the shards of a sharded checkpoint if `pretrained_model_name_or_path` is a model ID on the Hub - returns the list of paths to all the shards, as well as some metadata. For the description of each arg, see [`PreTrainedModel.from_pretrained`]. `index_filename` is the full path to the index (downloaded and cached if `pretrained_model_name_or_path` is a model ID on the Hub). zCan't find a checkpoint index (z) in rrrN weight_mapmetadataall_checkpoint_keysrz5 which is required according to the checkpoint index.z*.jsonz*.md)r{rDc3:K|]}|jvywN) rfilename)r/r0 shard_files r2r3z._get_checkpoint_shard_files..s$bHa1Z1;;%>Has)rwryrzrDr{allow_patternsignore_patternsr'rz ' to load z?. You should try again after checking your internet connection.z does not have a file named )rXr7rrjsonloads read_textopenreadsortedsetvalueslistrcopyr=rFileNotFoundErrorexistsr anysiblingsrr rr)r}index_filenamerwryrzrDr'r{rvr|indexforiginal_shard_filenamessharded_metadata shards_pathshard_filenamesrprmodel_files_infoshard_file_present cached_folderrcached_filenames cached_filers @r2_get_checkpoint_shard_filesrgs,  ->~>NeTqSrrstu uww~~n->~>NeTqSrrstu u <7AACD .# &!JJqvvx(E' &c% *=*D*D*F&GHZ(.253F3K3K3M.N*+%*<%8%=%=%?\"'',,LMn"'',,y!4nM(O %&Ch^cd2J!$$bHXHaHa$b!b %&"m#I*VBB3) )-)+!    GGLL BMAYY@X1 ]A6@XY' ww~~k*" /!=k]JA ( - --Y' &[&NB &'F&GzRoQpq> >   Zs6$K('K5'K: 6K?'L'(K2? L$LL$folder filenamesc4|r |r td|sUg}tj|D];\}}}|D]0}|jtjj |2=d}t jd|d|dtfd|DS)Nz1Both `filenames` and `folder` cannot be provided.z\d{5}-of-\d{5}z.*-z\.z \.[a-z]+$c3DK|]}j|duywr)rm)r/rvariant_file_res r2r3z8_check_legacy_sharding_variant_format..s"GY$$Q't3Ys ) rXr7walkrcrbasenamerjcompiler)rrrp_filesfiletransformers_index_formatrs @r2%_check_legacy_sharding_variant_formatrsVLMM  776?KAq%  !1!1$!78+!2jjC(A'B"WIY!WXO GYG GGrBceZdZdZ ddeej zdededzdedzdededzf d Z ddededzd edzdedzded ed edzdedzd efdZ y)PushToHubMixinzR A Mixin to push a model, scheduler, or pipeline to the Hugging Face Hub. N working_dirrepo_idrDcommit_message create_prrvc|Od|jjvrd}n4d|jjvrd}nd|jj}tjd|d|dt |||||| S) zB Uploads all files in `working_dir` to `repo_id`. Modelz Upload model SchedulerzUpload schedulerzUpload zUploading the files of z to rr)r folder_pathrDrr path_in_repo) __class____name__loggerinfor )selfrrrDrrrvs r2_upload_folderzPushToHubMixin._upload_folders  !$..111!/ 7 77!3#*4>>+B+B*C!D -k]$wiqIJ#)"   rBprivatesafe_serializationrpr(c t|||dj}|st||} t| } d|i} d|jj vr| j d|itj5} |j| fi| |s/ jtjj| d|j| |||||cd d d S#1swYy xYw) uy Upload model, scheduler, or pipeline files to the 🤗 Hugging Face Hub. Parameters: repo_id (`str`): The name of the repository you want to push your model, scheduler, or pipeline files to. It should contain your organization name when pushing to an organization. `repo_id` can also be a path to a local directory. commit_message (`str`, *optional*): Message to commit while pushing. Default to `"Upload {object}"`. private (`bool`, *optional*): Whether to make the repo private. If `None` (default), the repo will be public unless the organization's default is private. This value is ignored if the repo already exists. token (`str`, *optional*): The token to use as HTTP bearer authorization for remote files. The token generated when running `hf auth login` (stored in `~/.huggingface`). create_pr (`bool`, *optional*, defaults to `False`): Whether or not to create a PR with the uploaded files or directly commit. safe_serialization (`bool`, *optional*, defaults to `True`): Whether or not to convert the model weights to the `safetensors` format. variant (`str`, *optional*): If specified, weights are saved in the format `pytorch_model..bin`. Examples: ```python from diffusers import UNet2DConditionModel unet = UNet2DConditionModel.from_pretrained("stabilityai/stable-diffusion-2", subfolder="unet") # Push the `unet` to your namespace with the name "my-finetuned-unet". unet.push_to_hub("my-finetuned-unet") # Push the `unet` to an organization with the name "my-finetuned-unet". unet.push_to_hub("your-org/my-finetuned-unet") ``` T)rrDexist_okrPrrrpz README.md)rDrrrvN)rrr`rerrupdatetempfileTemporaryDirectorysave_pretrainedsaver7rr=r) rrrrrDrrrprvr] save_kwargstmpdirs r2 push_to_hubzPushToHubMixin.push_to_hubs`gwedS[[27%HJ,Z8J,-?@ dnn55 5    73 4  ( ( *f D  7; 7 V[ AB&&-## '+ * *s 7ACC%)NNFN)NNNFTNN) r __module__ __qualname____doc__r?r7PathLikeboolrrr.rBr2rrs!%) $ 2;;&  Tz  d    : B&*# #'" $JJd J J Tz J  J!JtJ:J JrBrr) NNFFNNNNNNFF)NNFNNNr+N)NNN)Grr7rjr4rrpathlibruuidrhuggingface_hubrrrrr r r r huggingface_hub.constantsr rhuggingface_hub.file_downloadrhuggingface_hub.utilsrrrrrr packagingrr+r constantsrrrr import_utilsrrr r!r"r#r$r%loggingr&rr__file__parentr\hexr6r<r?rArrr`rernrurrrrr.rBr2rs>"    O;     H >003KK W[[ s T 1S2 $( $!#WW :WW W Tz W  W $JW4ZW J Wd{WWWWt I S49_t5K W`  IsTz Id IsS4Z3 !  "$("04@#&:@@Tz @ Tz @  @D[@@ :@s T!@Dj@t@sI~&-@@L   04l.sI~&-l.^ H# Hc Hdg HmmrB