+ LV-j4^RIHt^RIt^RIt^RIt^RIt^RIt^RIHtH t H t ^RI H t ^RI HtHtHtHt/t]P&!R4tRtRRltRR lt!R R ]4tRR ltRR ltRtR#)) annotationsN)AsyncFileSystem_run_coros_in_chunks sync_wrapper)DEFAULT_CALLBACK) filesystemget_filesystem_classsplit_protocol url_to_fszfsspec.genericc ,\V3/VB\V&R#)z4Populate the dict used for method=="generic" lookupsN)r _generic_fs)protocolstorage_optionss&,_/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/fsspec/generic.pyset_generic_fsrs&xC?CKc\V\\34'd V^,MTpT;'g\V4^,pT;'g/pVR8Xd \ V4#VR8Xd\ V,#VR8Xd\ V4pVP4#VR8Xd!\V3/VPV/4BwrVV#\RV 24h)zPick instance of backend FSdefaultgenericcurrentoptionszUnknown FS resolution method: ) isinstancelisttupler rr r rr get ValueError)urlmethodrrclsfs_s&&&& r _resolve_fsr"ssT5M22#a&C11>#.q1H%++O (## 8$$ "8,{{} #C!4!4Xr!BC 5fX> ??rc T;'g\R/T;'g/BpVPV4pVPV4pVPVRRR7p VPV4'g \ R4hVPVRRR7p V P 4U U u.uF/wrV R,R8XgKV P W4V 9gK-V NK1 p p p \P\V 4 R24V 'd2TPV Uu.uFqP W4NK upRR7V P 4U U u/uFwrV R,R8XgKWbK p p p \P\V 4 R 24V P 4UU u.uF/wrVP W4V 9gKV R,R8XgK-VNK1 ppp V P4P 4Fwpp VP W4pVV 9dVR 8XdVV V&K,VR 8XdV PV4KFVR 8Xdn\V4'd V!V 4MW,pV V,p\V4'd V!V4MVV,pVV8wdVV V&KV PV4KKVV V&K \P\V 4 R 24V 'd/\V P 4!wppVP!VV3/VB\P\V4 R24V'dV'dVP!V4V #uup p iuupiuup p iuup pi)aSync files between two directory trees (experimental) Parameters ---------- source: str Root of the directory tree to take files from. This must be a directory, but do not include any terminating "/" character destination: str Root path to copy into. The contents of this location should be identical to the contents of ``source`` when done. This will be made a directory, and the terminal "/" should not be included. delete_missing: bool If there are paths in the destination that don't exist in the source and this is True, delete them. Otherwise, leave them alone. source_field: str | callable If ``update_field`` is "different", this is the key in the info of source files to consider for difference. Maybe a function of the info dict. dest_field: str | callable If ``update_field`` is "different", this is the key in the info of destination files to consider for difference. May be a function of the info dict. update_cond: "different"|"always"|"never" If "always", every file is copied, regardless of whether it exists in the destination. If "never", files that exist in the destination are not copied again. If "different" (default), only copy if the info fields given by ``source_field`` and ``dest_field`` (usually "size") are different. Other comparisons may be added in the future. inst_kwargs: dict|None If ``fs`` is None, use this set of keyword arguments to make a GenericFileSystem instance fs: GenericFileSystem|None Instance to use if explicitly given. The instance defines how to to make downstream file system instances from paths. Returns ------- dict of the copy operations that were performed, {source: destination} T)withdirsdetailzCan only rsync on a directorytype directoryz directories to createexist_okfilez files to consider for copyalwaysnever differentz files to copyz files to delete)GenericFileSystem_strip_protocolfindisdirritemsreplaceloggerdebuglenmake_many_dirscopypopcallablezipcprm)source destinationdelete_missing source_field dest_field update_cond inst_kwargsr kwargsallfiles otherfilesavdirsdirno to_deletek otherfileinf1v2inf2 source_files target_filess&&&&&&&&, rrsyncrV(s h 7 7 7K$5$527B    'F$$[1KwwvTw:H 88F  899tDAJNN$ $DA V9 # () &(Fj(X $    LLCI;456  ;? @44\\& .4 @4  "*!1I!1QvY&5H!1HI LLCM?"=>?$$&&DA 99[ ) 9 >?i6>Q &  %%'1IIf2  "h&' ' Q +*2<*@*@|Aao *)1*)=)=z"~2j>4<"+HQKLLO,$HQK'(( LLCM?.12%((..*:%;" l lL3F3 LLC N##345) i OY  AIs6M6MMMMMM7 MMca]tRt^tRtRtRV3RlltRtRtRRlt Rt RR lt R t R t R tRR ltRtR]R3RRlltRRlt]!]4tRRRlltRtV;t#)r/aBWrapper over all other FS types This implementation is a single unified interface to be able to run FS operations over generic URLs, and dispatch to the specific implementations using the URL protocol prefix. Note: instances of this FS are always async, even if you never use it with any async backend. rNc @<WnW n\SV` !R/VBR#)am Parameters ---------- default_method: str (optional) Defines how to configure backend FS instances. Options are: - "default": instantiate like FSClass(), with no extra arguments; this is the default instance of that FS, and can be configured via the config system - "generic": takes instances from the `_generic_fs` dict in this module, which you must populate before use. Keys are by protocol - "options": expects storage_options, a dict mapping protocol to kwargs to use when constructing the filesystem - "current": takes the most recently instantiated version of each FS Nr.)rst_optssuper__init__)selfdefault_methodrrF __class__s&&&,rr[GenericFileSystem.__init__s % &  "6"rc \WPVPR7pVPVP V44#r)r"rrYunstrip_protocol_parentr\pathr s&& rrdGenericFileSystem._parents0 {{DLL I""2::d#344rc \WPVPR7pVPVP V44#ra)r"rrYrcr0res&& rr0!GenericFileSystem._strip_protocols2 {{DLL I""2#5#5d#;<BBABc "\WP4pVP'dVP!V3RR/VBGRjxL pMVP!V3RR/VBpVUu.uFqfP 4NK ppVFpVP VR,4VR&K V'dV#VUu.uF qfR,NK up#L~uupiuupi5i)r%TNrl)r"rrm_lslsr9rc)r\rr%rFr rorMs&&&, rrwGenericFileSystem._lss kk * ===s:4:6::C%%3D3F3C!$%Avvx%A++AfI6AfI J'*+s!fIIs+ +;& ,s6AC CC !C9-C 'C -C>C  C c "\WP4pVP'dVP!V3/VBGRjxL #VP!V3/VB#L5iN)r"rrm _cat_filecat_file)r\rrFr s&&, rr|GenericFileSystem._cat_filesN kk * ===c4V44 4;;s-f- -5s>AAAc "\WPVPR7pVP'dVP!W3/VBGRjxL #VP !W3/VB#L5i)rbN)r"rrYrm _pipe_file pipe_file)r\rfvaluerFr s&&&, rrGenericFileSystem._pipe_filesT {{DLL I ===t=f== =<<6v6 6>sA A& A$ A&c "Tp\V\4'dV.p\V^,VP4pVP'dVP !V3/VBGRjxL R#VP !V3/VBR#L5i)rN)rstrr"rrm_rmr>)r\rrFurlsr s&&, rrGenericFileSystem._rmsh dC 6D a$++ . ===&&(( ( ( EE#   )sA!B#A?$Bc "\PRV4\WPVPR7pVP 'dVP WR7GRjxL R#VPWR7R#L5i)z Make dir %srbr(N)r5r6r"rrYrm _makedirsmakedirs)r\rfr)r s&&& rrGenericFileSystem._makedirssW ]D) {{DLL I ===,,t,7 7 7 KKK 0 8sAA>!A<"A>c "\W3RV/VBR#)zKSync files between two directory trees See `func:rsync` for more details. r N)rV)r\r?r@rFs&&&,rrVGenericFileSystem.rsyncs f5d5f5rcV^8dQhRR/#)tempdir str | Noner.)formats"r __annotate__GenericFileSystem.__annotate__sQQ  Qrc ("\WP4p\W P4pWxJdAVP'dVP!W3/VBGRjxL #VP!W3/VB#\ Wq.W.V^RR7GRjxL R#L3L5i)Nraiseon_error)r"rrm_copyr9 copy_file_op) r\rurl2 blocksizecallbackrrFr fs2s &&&&&&, r_cp_fileGenericFileSystem._cp_fileskk *$ , 9}}}XXc:6:::wws3F332uc67APPP; Qs*ABBB,BBBBc "\V^,VP4pVP'd6VUu.uFqCPWBR7NK pp\ V4GRjxL R#VFpVP WBR7K R#uupiL(5i)rr(N)r"rrmrrr)r\rr)r ucoross&&& r_make_many_dirs!GenericFileSystem._make_many_dirs2sn a$++ . ===AEFA\\!\7EF&u- - - A 1G -s4B BB  B !)B c4V^8dQhRRRRRRRRRR R R R R /#) rpath1z list[str]path2 recursiveboolrrrkz int | None batch_sizerrr.)rs"rrr=sP            rc "V'd \R4h\V\4'dV.MTp\V\4'dV.MTp\WP4p \W P4p WJdAV P 'dV P !W3/VBGRjxL #V P!W3/VB#\WWWvVR7GRjxL R#L0L5i)zPlease use fsspec.generic.rsyncNr) NotImplementedErrorrrr"rrmrr9r) r\rrrrrkrrrFr rs &&&&&&&&, rrGenericFileSystem._copy=s %&GH H%eS11u%eS11u  ,%- 9}}}XXe=f===wwu6v66 s7   > s*B C C#C$)C CCC)rrY)rN)NFF)T)Fi)FignoreNNN)__name__ __module__ __qualname____firstlineno____doc__rr[rdr0rnrsrwr|rrrrVrrrrr8r__static_attributes__ __classcell__)r^s@rr/r/sr H#(5= (,& . 7!16!" Q&2"/2N  rr/c"^RIpT;'gVP4p\W4UU u.uFOwr\VVVV \P P V\P!4P44NKQ p pp \WRR7GRjxL p \P!V4VR8XdV #VR8Xd$V Fp \V \4'gKV h R#R#uup piLU \P!T4i;i5i)rNT)rreturn_exceptionsreturnr)tempfilemkdtempr< _copy_file_oposrfjoinuuiduuid4hexrshutilrmtreer Exception) fs1url1rrrrrru1u2rrorMs &&&&&&& rrr]s++))+Gd/  *  Wdjjl&6&67  *   ) D    g8 W A!Y'' #     gs@D C0AC(C0C.C0>D  D (C00DD cb"VP'dVPW4GRjxL MVPW4VP'dVPWC4GRjxL MVP WC4\ P !V4\PRW4R#LLF5i)NzCopy %s -> %s; done) rm _get_fileget_file _put_fileput_filerunlinkr5r6)rrrrlocalrs&&&&&&rrr{sx ~~~mmD((( T! ~~~mmE((( U!IIe LL&3 ) )s('B/B+'B/B/&B-'AB/-B/c^"\P!V4'd VGRjxL #V#L5ir{)inspect iscoroutine)cors&r maybe_awaitrs(3y s "-+-)NN)Fsizerr-NN)Nr)r) __future__rrloggingrrrasynrrr callbacksrcorerr r r r getLoggerr5rr"rVr/rrrr.rrrsm" EE'MM   + ,D @$gTH H V< 4r