(tihdZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z ddlZddlmZmZmZddlmZmZmZmZmZddlmZd d lmZd d lmZm Z m!Z!m"Z"m#Z#m$Z$e$jJe&Z'ejPd Z)Gd de Z*GddZ+dZ,dZ-Gdde+Z.y)z%ConfigMixin base class and utilities.N) OrderedDict)Path)Any) DDUFEntry create_repohf_hub_download)EntryNotFoundErrorHfHubHTTPErrorRepositoryNotFoundErrorRevisionNotFoundErrorvalidate_hf_hub_args)Self) __version__)HUGGINGFACE_CO_RESOLVE_ENDPOINT DummyObject deprecateextract_commit_hashhttp_user_agentloggingzconfig\.(.*)\.jsoncJeZdZfdZdZdZdZdZfdZfdZ xZ S) FrozenDictc|t||i||jD]\}}t|||d|_y)NT)super__init__itemssetattr_FrozenDict__frozen)selfargskwargskeyvalue __class__s l/Volumes/fast/ai/experiments/MLX_z-image/.venv/lib/python3.12/site-packages/diffusers/configuration_utils.pyrzFrozenDict.__init__9s> $)&)**,JC D#u %' cHtd|jjd)Nz$You cannot use ``__delitem__`` on a instance. Exceptionr$__name__rr r!s r% __delitem__zFrozenDict.__delitem__As#>t~~?V?V>WWabccr&cHtd|jjd)Nz#You cannot use ``setdefault`` on a r(r)r,s r% setdefaultzFrozenDict.setdefaultDs#=dnn>U>U=VV`abbr&cHtd|jjd)NzYou cannot use ``pop`` on a r(r)r,s r%popzFrozenDict.popGs"6t~~7N7N6OzZ[[r&cHtd|jjd)NzYou cannot use ``update`` on a r(r)r,s r%updatezFrozenDict.updateJs#9$..:Q:Q9RR\]^^r&ct|dr/|jr#td|jjdt |||yN__frozenz$You cannot use ``__setattr__`` on a r()hasattrrr*r$r+r __setattr__rnamer#r$s r%r8zFrozenDict.__setattr__MC 4 $B4>>CZCZB[[efg g D%(r&ct|dr/|jr#td|jjdt |||yr5)r7rr*r$r+r __setitem__r9s r%r=zFrozenDict.__setitem__Rr;r&) r+ __module__ __qualname__rr-r/r1r3r8r= __classcell__r$s@r%rr8s/dc\_) ))r&rc eZdZdZdZgZdZgZdZe ddZ dZ de de fdZdd e ej zd efd Ze dd eee e fzdeeeee e ffzfd Ze dZe e dde ej zdeee e fee e fffdZedZe dZe d de ej zdee efdzfdZdZ e!dee e ffdZ"de fdZ#de ej zfdZ$e de dee effdZ%y)! ConfigMixina Base class for all configuration classes. All configuration parameters are stored under `self.config`. Also provides the [`~ConfigMixin.from_config`] and [`~ConfigMixin.save_config`] methods for loading, downloading, and saving classes that inherit from [`ConfigMixin`]. Class attributes: - **config_name** (`str`) -- A filename under which the config should stored when calling [`~ConfigMixin.save_config`] (should be overridden by parent class). - **ignore_for_config** (`list[str]`) -- A list of attributes that should not be saved in the config (should be overridden by subclass). - **has_compatibles** (`bool`) -- Whether the class has compatible classes (should be overridden by subclass). - **_deprecated_kwargs** (`list[str]`) -- Keyword arguments that are deprecated. Note that the `init` function should only have a `kwargs` argument if at least one argument is deprecated (should be overridden by subclass). NFc:|dk7rtd|d||_y)a4 Register this class with the given auto class so that it can be loaded with `AutoModel.from_pretrained(..., trust_remote_code=True)`. When the config is saved, the resulting `config.json` will include an `auto_map` entry mapping the auto class to this class's module and class name. Args: auto_class (`str` or type, *optional*, defaults to `"AutoModel"`): The auto class to register this class with. Can be a string (e.g. `"AutoModel"`) or the class itself. Currently only `"AutoModel"` is supported. Example: ```python from diffusers import ModelMixin, ConfigMixin class MyCustomModel(ModelMixin, ConfigMixin): ... MyCustomModel.register_for_auto_class("AutoModel") ``` AutoModelz$Only 'AutoModel' is supported, got ''.N) ValueError _auto_class)cls auto_classs r%register_for_auto_classz#ConfigMixin.register_for_auto_classps(4  $CJ>. ) ?>2BBe!fg g NT2 WW\\.$:J:JK ,- -.@-ABC #ZZ(8$?NjjD1G ;6IJJw-EjjN,@,@,Mb,QRG!'D'QVW__G ;5I   -##   r&configc Dd|vr|jd}| tdt|ts[d}d|jvr |d|dz }nd|jvr |d|d |d z }t d d |d |j d|dd|\}}|j|fi|\}}}d|vr|jd|d<|jD]}||vs|j|||<|di|} d|vr|j|d<| jdi|i||}|r| |fS| S)a  Instantiate a Python class from a config dictionary. Parameters: config (`dict[str, Any]`): A config dictionary from which the Python class is instantiated. Make sure to only load configuration files of compatible classes. return_unused_kwargs (`bool`, *optional*, defaults to `False`): Whether kwargs that are not consumed by the Python class should be returned or not. kwargs (remaining dictionary of keyword arguments, *optional*): Can be used to update the configuration object (after it is loaded) and initiate the Python class. `**kwargs` are passed directly to the underlying scheduler/model's `__init__` method and eventually overwrite the same named arguments in `config`. Returns: [`ModelMixin`] or [`SchedulerMixin`]: A model or scheduler object instantiated from a config dictionary. Examples: ```python >>> from diffusers import DDPMScheduler, DDIMScheduler, PNDMScheduler >>> # Download scheduler from huggingface.co and cache. >>> scheduler = DDPMScheduler.from_pretrained("google/ddpm-cifar10-32") >>> # Instantiate DDIM scheduler class with same config as DDPM >>> scheduler = DDIMScheduler.from_config(scheduler.config) >>> # Instantiate PNDM scheduler class with same config as DDPM >>> scheduler = PNDMScheduler.from_config(scheduler.config) ``` pretrained_model_name_or_pathzFPlease make sure to provide a config as the first positional argument.zJIt is deprecated to pass a pretrained model name or path to `from_config`. Schedulerz3If you were trying to load a scheduler, please use z.from_pretrained(...) instead. Otherwise, please make sure to pass a configuration dictionary instead. This functionality will be removed in v1.0.0.Modelz/If you were trying to load a model, please use z.load_config(...) followed by z.from_config(...) instead. Otherwise, please make sure to pass a configuration dictionary instead. This functionality will be removed in v1.0.0.zconfig-passed-as-pathrXFrYT)r}return_unused_kwargsdtype _class_name) r1rG isinstancerPr+r load_configextract_init_dict_deprecated_kwargsrU) rIr{rr!ra init_dict unused_kwargs hidden_dictdeprecated_kwargmodels r% from_configzConfigMixin.from_configsN +f 4ZZ ?@F >ef f&$'"n cll*#I#O--# CLL(#EcUKuNN# -w8K[` a,S__w6hlwpvwNFF0E0E0Ef0WPV0W- =+ m #!.!2!27!;Ig !$ 6 6 =0.;.?.?@P.Q *+!7  i  K '),K &   /;/9=8K8 =) )Lr&cPd|d}tdd|d|j|i|S)Nz8 The function get_config_dict is deprecated. Please use zE.load_config instead. This function will be removed in version v1.0.0get_config_dictrXFrY)rr)rIr r!ras r%rzConfigMixin.get_config_dict:sEGseL) )  #W.AQVWs///r&r}c |jdd}|jdd}|jdd}|jdd}|jdd} |jd d} |jd d} |jd d} |jd d} |jd d}|jdi}|jdd}i|ddi}t|}t|}|j t d|r!| t d|j ||}nit jj|r|}nFt jj|r|tt jjt jj|||jr,t jj|||j}nt jjt jj||jr+t jj||j}n>td|jd|d t||j||| | | ||| || } |j%||&}t'|}|s|s|S|f}|r||fz }|r||fz }|S#t$rt|dt$rt| d|dt$rt|d|jdt $r}td|d|d}~wt$r$tdt"d|d |jd!t$r td"|d#|d$|jd%wxYw#t(j*t,f$rtd'|d(wxYw))a Load a model or scheduler configuration. Parameters: pretrained_model_name_or_path (`str` or `os.PathLike`, *optional*): Can be either: - A string, the *model id* (for example `google/ddpm-celebahq-256`) of a pretrained model hosted on the Hub. - A path to a *directory* (for example `./my_model_directory`) containing model weights saved with [`~ConfigMixin.save_config`]. cache_dir (`str | os.PathLike`, *optional*): Path to a directory where a downloaded pretrained model configuration is cached if the standard cache is not used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force the (re-)download of the model weights and configuration files, overriding the cached versions if they exist. proxies (`dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, for example, `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}`. The proxies are used on each request. output_loading_info(`bool`, *optional*, defaults to `False`): Whether or not to also return a dictionary containing missing keys, unexpected keys and error messages. local_files_only (`bool`, *optional*, defaults to `False`): Whether to only load local model weights and configuration files or not. If set to `True`, the model won't be downloaded from the Hub. token (`str` or *bool*, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, the token generated from `diffusers-cli login` (stored in `~/.huggingface`) is used. revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, a commit id, or any identifier allowed by Git. subfolder (`str`, *optional*, defaults to `""`): The subfolder location of a model file within a larger model repository on the Hub or locally. return_unused_kwargs (`bool`, *optional*, defaults to `False): Whether unused keyword arguments of the config are returned. return_commit_hash (`bool`, *optional*, defaults to `False): Whether the `commit_hash` of the loaded configuration are returned. Returns: `dict`: A dictionary of all the parameters stored in a JSON configuration file. cache_dirN local_dirlocal_dir_use_symlinksautoforce_downloadFproxiesrjlocal_files_onlyrevisionmirrorrm user_agent dduf_entries file_typer{z`self.config_name` is not defined. Note that one should not load a config from `ConfigMixin`. Please make sure to define `config_name` in a class inheriting from `ConfigMixin`zDDUF file only allow for 1 level of directory (e.g transformer/model1/model.safetentors is not allowed). Please check the DDUF structurezError no file named z found in directory .) filenamerrrrrjrrmrrrz is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models' If this is a private repository, make sure to pass a token having permission to this repo with `token` or log in with `hf auth login`.z is not a valid git identifier (branch name, tag name or commit id) that exists for this model name. Check the model page at 'https://huggingface.co/z' for available revisions.z& does not appear to have a file named z:There was a specific connection error when trying to load z: zWe couldn't connect to 'zM' to load this model, couldn't find it in the cached files and it looks like z- is not the path to a directory containing a z file. Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/diffusers/installation#offline-mode'.zCan't load config for 'z'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'z2' is the correct path to a directory containing a z file)rz"It looks like the config file at 'z' is not a valid JSON file.)r1rstrrNrG_get_config_file_from_ddufrnrorpisdirrsEnvironmentErrorrr r r r r_dict_from_json_filerjsonJSONDecodeErrorUnicodeDecodeError)rIr}rreturn_commit_hashr!rrrrrrjrr_rmrr config_fileerr config_dict commit_hashoutputss r%rzConfigMixin.load_configCs2jJJ{D1 JJ{D1 !',Df!M$4e<**Y- 7D)!::&8%@::j$/ JJx &JJ{D1 ZZ b1 4:JJ~t4T : :K: $Z0 (+,I(J% ?? "s  $ 6889VXdeK WW^^9 :7K WW]]8 9$ :IsW*!ggll+H)UXUdUde  -JCOO \] ggll+H#//Z &*3??*;;OPmOnnop3 -1 __'#1#%5)'%'+A  d r22;\2ZK-k:K%(: .  y G   ~ %Gm+ &456ii ) &j!00M/NNhj & &455[\_\k\k[llmn" &56c#@ &./N.OP>>[=\]//2.?@ZZ$ &-.K-LM--J,KL$$'OO#4E; $$&89 r"%G }To#pq q rs&9!KNAN/MAN)Octttj|jj j SN)setrPinspect signaturer parameterskeys) input_classs r%_get_init_keyszConfigMixin._get_init_keyss24))+*>*>?JJKPPRSSr&c <|jdg}|jDcic]\}}||vs |dk7s||}}}t|j}|j|}|j dd|vr|j dt |dr"|j D]}|j |t|jdkDr|t|jz }tjtjdd} |jr/|jD cgc]} t!| t"r| } } ng} t} | D]$} |j| } | j%| } &| |j|z } |jDcic] \}}|| vs ||}}}|j'd|j}t!|t(rd||jk7rUt | |rIt+| |}|j||z }|jDcic] \}}||vs ||}}}n1t!|t(s!t!|t,t.fs t1d|jDcic]\}}|j3d r||}}}|jDcic]\}}|d k7s ||}}}i}|D]P}||vr||vr|j'|||<||vr|j'|||<8||vs=|j'|||<Rt|dkDr3t4j7d |d |jd |j8dt|j;}t||z dkDrt4j=||z di||}|jDcic] \}}||vs ||}}}|||fScc}}wcc} wcc}}wcc}}wcc}}wcc}}wcc}}w)N_use_default_valuesrr!_flax_internal_argsrrrz\Make sure that the `_class_name` is of type string or list of string (for custom pipelines).rquantization_configzThe config attributes z were passed to z?, but are not expected and will be ignored. Please verify your z configuration file.zG was not found in config. Values will be initialized to default values.)getrrPrremover7rlenignore_for_configr importlib import_moduler+rvhas_compatibles_get_compatiblesrrunionr1rgetattrlisttuplerG startswithrQwarningrNrru)rIrr! used_defaultskv original_dict expected_keysargdiffusers_libraryccompatible_classesexpected_keys_comp_clsexpected_keys_c orig_cls_nameorig_clsunexpected_keys_from_origrr" passed_keysrhidden_config_dicts r%rzConfigMixin.extract_init_dictsB$(=rB (3(9(9(;u(;1q ?UZ[_tZtq!t(; u[..01 **3/ V$ } $   * 3- ...$$S)/ s$$ % ))C0E0E,FFM&33HNN34G4JK   -0-A-A-C!f-C:VWYdKe!-C !f!# !$#A!003O%;%A%A/%R "$"8#:L:LS:Q!Q(3(9(9(;_(;1qH^?^q!t(; _$ s||D }c *-)=90-@H(+(:(:8(D}(T %,7,=,=,?f,?DAq1LeCe1a4,?KfM3/ =SWY^R_8`n  )4(9(9(;U(;11<P P PP 4P  PP P(P json_filerc|r||j}n't|dd5}|j}dddtjS#1swYxYw)Nrutf-8encoding) read_textopenreadrloads)rIrrtextreaders r%rz ConfigMixin._dict_from_json_fileUsN  *446Diw76{{}8zz$87s AAcT|jjd|jS)N )r$r+to_json_stringrs r%__repr__zConfigMixin.__repr__^s(..))*!D,?,?,A+BCCr&c|jS)z Returns the config of the class as a frozen dictionary Returns: `dict[str, Any]`: Config of the class. )rMrs r%r{zConfigMixin.configas"""r&ct|dr |jni}|jj|d<t|d<fdd|vrCt |j ts|j jn |j |d<|jDcic]\}}||}}}|jdd|jdd|jd d}t|d dg|jjjd d }|jd i}|d |jj||j<||d <t!j"|dddzScc}}w)z Serializes the configuration instance to a JSON string. Returns: `str`: String containing all the attributes that make up the configuration instance in JSON format. rMr_diffusers_versionc^t|tjr|j}|St|tr|j }|St |dr't|jr|j}|St|tr|Dcgc] }| }}|Scc}w)Nto_dict) rnpndarraytolistras_posixr7callablerr)r#rto_json_saveables r%rz4ConfigMixin.to_json_string..to_json_saveablews%, L E4(( L  *x /F LE4(6;rvrrHrdumps)rrrrrmodulerrs @r%rzConfigMixin.to_json_stringksp.5T;K-Ld))RT %)^^%<%< M",7 ()  !K /"+"A"A4H//779 44 - . ;F:K:K:MN:M$!Qq*1--:M N.-t4 OO5t < 4 - 9^^..44S9"=F"z26H,281T^^5L5L4M)NHT%% &&.K #zz+a4@4GGOsE8json_file_pathct|dd5}|j|jdddy#1swYyxYw)z Save the configuration instance's parameters to a JSON file. Args: json_file_path (`str` or `os.PathLike`): Path to the JSON file to save a configuration instance's parameters. wrrN)rwriter)rrwriters r%rtzConfigMixin.to_json_files3.# 8F LL,,. /9 8 8s 8Ac|dk(r |jndj||jg}||vrtd|d|j|S)N/z#We did not manage to find the file z4 in the dduf file. We only have the following files )rNrsrGr)rIr}rrs r%rz&ConfigMixin._get_config_file_from_ddufs -2 OO8#//JK  l *5k]BvxDxIxIxKwLM r&)rE)FNF)FFr)&r+r>r?__doc__rNrrrrH classmethodrKrUrrrbrnPathLikeboolrzrrPrrrrr r staticmethodrrrrrpropertyr{rrtrrr&r%rCrCXs KOK%%<8"ZZZ$*# *;*$*XNSY$sCx.0Y dDcN*+ +YYv00# g'*R[['8g tCH~tCH~- . ggRTT`<` dSVXaSaNbeiNi  D#S#X##+H+HZ 03+< 0 s Z^_bdm_mZn  r&rCcBtjfd}|S)a Decorator to apply on the init of classes inheriting from [`ConfigMixin`] so that all the arguments are automatically sent to `self.register_for_config`. To ignore a specific argument accepted by the init but that shouldn't be registered in the config, use the `ignore_for_config` class variable Warning: Once decorated, all private arguments (beginning with an underscore) are trashed and not sent to the init! c J|jDcic]\}}|jdr||}}}|jDcic]\}}|jds||}}}t|ts#t d|j j dt|dg}i}tj} t| jjD cic] \} \} } | dkDs| |vs| | j"} } } } t|| jD] \}} ||| < |j| jDcic] \}}||vr||vr||j!||"c}}t#t%|jt%|z dkDr1t't%|jt%|z |d<i||}t|ddi||g|i|ycc}}wcc}}wcc} } } wcc}}w) Nr&`@register_for_config` was applied to A init method, but this class does not inherit from `ConfigMixin`.rrrrUr)rrrrC RuntimeErrorr$r+rrr enumeraterdefaultziprr3rrrr)rr r!rr init_kwargsconfig_init_kwargsignore new_kwargsrir:prrrinits r% inner_initz®ister_to_config..inner_inits$)/ P1all3>Oq!t P/5||~S~tq!cARad~S$ ,89P9P8QR22  2B7 %%d+ 09):N:N:T:T:V0W 0W 9D![\_`[`eiqwewD!))O0W  T:??#45IC"Jt 6 #-"2"2"4 "4JAwF?q ':;??1g.."4   s:??$%K(88 9A =04S9J5KcR]N^5^0_J, -9*9j9 +*+9j9 T(D(K(CQS  s.H H  H$H*H;HH%H ) functoolswraps)rrs` r%rUrUs)__T#)#)J r&ch|jtjfd}||_|S)NcBt|ts#td|jjdt |j }tj|}i}|D]t}|j|jvrt|jtjk(rd||j<Rt||j||j<vi||}d|vr|jdt!|D]\}} ||j} | || <t#t%|j't%|z dkDr1t)t%|j't%|z |d<t|ddi| |g|i|y)NrrrrrrUr)rrCrr$r+rPr dataclassesfieldsr:rr]r _MISSING_TYPErr1rrrrr) rr r!rr"default_kwargsfieldrrrr: original_inits r%rz%flax_register_to_config..inits$ ,89P9P8QR22  6<<>* ##D)EzzT555EMM"k&?&??-1uzz*-4T5::-Fuzz*76+6 j NN7 # oFAs!9>>D"Jt & s:??$%K(88 9A =04S9J5KcR]N^5^0_J, -+*+9j9d,T,V,r&)rrr)rIrr&s @r%flax_register_to_configr's6LLM__]#&-$&-PCL Jr&cDeZdZdZeddeeeefzffd Z xZ S)LegacyConfigMixinz A subclass of `ConfigMixin` to resolve class mapping from legacy classes (like `Transformer2DModel`) to more pipeline-specific classes (like `DiTTransformer2DModel`). r{c |ddlm}|||}||urtt|||fi|S|j||fi|S)Nr)_fetch_remapped_cls_from_config)models.model_loading_utilsr+rr)r)rIr{rr!r+remapped_classr$s r%rzLegacyConfigMixin.from_configsV P9E S *NGPdohno o->--f6JUfU Ur&r) r+r>r?rrrrPrrrr@rAs@r%r)r)s3  Vd38n!< V Vr&r))/rr!rrrrrnre collectionsrpathlibrtypingrnumpyrhuggingface_hubrrrhuggingface_hub.utilsr r r r r typing_extensionsrrrutilsrrrrrr get_loggerr+rQcompile_re_configuration_filerrCrUr'r)rr&r%r:s , #CC#   H %#$9:))@W W t/d-`V Vr&