iE XdZddlZddlZddlZddlmZddlmZmZm Z m Z ddl Z ddl Z ddl Z ddlmZddlmZddlmZddlmZmZej.eZ dd e eefd ed e ed efd Zdeded efdZdeeefded dfdZded efdZ ddede eefded efdZ!ded efdZ"y)z)Utilities related to data saving/loading.N)Path)IOAnyOptionalUnion) url_to_fs)AbstractFileSystem)module_available)_MAP_LOCATION_TYPE_PATH path_or_url map_location weights_onlyreturnct|ttfstj|||St|j drH|d}t jd|dtjjt|||St|}|j|d5}tj|||cdddS#1swYyxYw)aLoads a checkpoint. Args: path_or_url: Path or URL of the checkpoint. map_location: a function, ``torch.device``, string or a dict specifying how to remap storage locations. weights_only: If ``True``, restricts loading to ``state_dicts`` of plain ``torch.Tensor`` and other primitive types. If loading a checkpoint from a trusted source that contains an ``nn.Module``, use ``weights_only=False``. If loading checkpoint from an untrusted source, we recommend using ``weights_only=True``. For more information, please refer to the `PyTorch Developer Notes on Serialization Semantics `_. )rrhttpNFz:Defaulting to `weights_only=False` for remote checkpoint: z\. If loading a checkpoint from an untrustted source, we recommend using `weights_only=True`.rb) isinstancestrrtorchload startswithlogdebughubload_state_dict_from_urlget_filesystemopen)r rrfsfs x/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/lightning_fabric/utilities/cloud_io.py_loadr""s" kC; /zz %%   ;""6*   L IIL[MZno  yy11  %%2   $B d #qzz %%  $ # #s .CCpathkwargsc 6tt|fi|\}}|S)N)rr)r#r$r_s r!rrPs c$i *6 *EB I checkpointfilepathctj}tjd|t j || t jjt|\}}|j5|j|d5}|j|jddddddy#1swYxYw#1swYyxYw#t$r]}t|j t"r9t%|j ddt&j(k(r t+d|Yd}~yYd}~yd}~wwxYw)aSaves a checkpoint atomically, avoiding the creation of incomplete checkpoints. Args: checkpoint: The object to save. Built to be used with the ``dump_checkpoint`` method, but can deal with anything which ``torch.save`` accepts. filepath: The path to which the checkpoint will be saved. This points to the file that the checkpoint will be stored in. zSaving checkpoint: wbNerrnoz]Upgrade fsspec to enable cross-device local checkpoints: pip install "fsspec[http]>=2025.5.0")ioBytesIOrrrsavefsspeccorerr transactionrwritegetvaluePermissionErrorr __context__OSErrorgetattrr,EXDEV RuntimeError)r(r) bytesbufferrurlpathr es r! _atomic_saver>Us**,KII#H:./ JJz;' kk++CM: G ^^RWWWd3q GGK((* +4^^33^^  ammW -'!--RV2W[`[f[f2fo 3g -sO7C;C  B?.C 6C?C C  CCC D= AD88D=rctdrddlm}t||rytdrddlm}t||rytdrddlm}t||ryy ) Nadlfsr)AzureBlobFileSystemTgcsfs) GCSFileSystems3fs) S3FileSystemF)r r@rArrBrCrDrE)rrArCrEs r!_is_object_storagerFpsN - b- . ' b- (% b, ' r'strictct|r%|r|j|S|j| S|j|S)aCheck if a path is directory-like. This function determines if a given path is considered directory-like, taking into account the behavior specific to object storage platforms. For other filesystems, it behaves similarly to the standard `fs.isdir` method. Args: fs: The filesystem to check the path against. path: The path or URL to be checked. strict: A flag specific to Object Storage platforms. If set to ``False``, any non-existing path is considered as a valid directory-like path. In such cases, the directory (and any non-existing parent directories) will be created on the fly. Defaults to False. )rFisdirisfile)rr#rGs r!_is_dirrKs>&" 88D> !99T?"" 88D>r'cXtjjt|dk(S)Nfile)r0utils get_protocolr)r#s r!_is_local_file_protocolrPs << $ $SY /6 99r')NN)F)#__doc__r,r-loggingpathlibrtypingrrrrr0 fsspec.utilsr fsspec.corerfsspec.implementations.localr lightning_utilities.core.importsr lightning_fabric.utilities.typesr r getLogger__name__rboolr"rdictrr>rFrKrPr'r!r_s0 ++  !;=Fg! (,#'+ r5y!+ $+ 4.+  + \#2D T#s(^u6-$,"%T *:DUY<:%:D:r'