+ LV-j.:^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIHt^RIH t ^RI H t H t ^RI t^RIHt^RIt^RIHt^RIHt^RI HtHtHt^R IHt^R IHtHtH t ]PB!R 4t"!R R ]#4t$Rt%Rt&Rt'!RR]PPPR4t*!RR]PPPV4t,Rt-!RR]PPP\4t/!RR]4t0!RR]4t1R# ]d] 'g^RItLi;i)N) lru_cache)chain) TYPE_CHECKINGLiteral)AbstractBufferedFile)AsyncFileSystem)DEFAULT_CALLBACK) filesystemopensplit_protocol)AsyncFileSystemWrapper) isfilelikemerge_offset_ranges other_pathszfsspec.referencec8aa]tRt^"toV3RltRtRtVtV;t#)ReferenceNotReachablec<<\SV`!V!WnW nR#N)super__init__ referencetarget)selfrrargs __class__s&&&*q/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/fsspec/implementations/reference.pyrReferenceNotReachable.__init__#s $" c:RVP RVP 2#)z Reference "z" failed to fetch target rrrs&r__str__ReferenceNotReachable.__str__(sT^^,,Edkk]SSrr ) __name__ __module__ __qualname____firstlineno__rr"__static_attributes____classdictcell__ __classcell__r __classdict__s@@rrr"s TTrrcF\\VP444#r)nextitervalues)ds&r_firstr2,s QXXZ !!rcVPV4p\V\\34'dQ\V^,\4'd2V^,'d\ V^,4^,#V^,#R#R#rN)get isinstancelisttuplestrr )path referencesrefs&& r_prot_in_referencesr=0s_ .. C#e}%%*SVS*A*A,/FF~c!f%a(>A>+B%rc\V\4'd\W4V./#/pVF/p\W14pVPV.4P V4K1 V#r)r6r9r= setdefaultappend)pathsr;outr:protocols&& r_protocol_groupsrD6sZ%#E6@@ C&t8 x$++D1 Jrc&a]tRt^@toRtRtVtR#)RefsValuesViewc#*"VPPP4F)p\P!V4P 4xK+ VPP P4RjxL VPP4FopVPPV4p\V4^8XdVPVR,,xKLVPPV4RjxL Kq R#LL 5i)N/0) _mapping zmetadatar0jsondumpsencode_itemslistdir_get_chunk_sizeslen_generate_all_records)rvalfield chunk_sizess& r__iter__RefsValuesView.__iter__As==**113C**S/((* *4==''..000]]**,E--88?K;1$mmEDL11}}::5A A A - 1 Bs%A9D;D.open_refss88???>D::dgg..t45D WW))$t{{)C57ZZ@Z25>>++Z@KA K s$5B+B&"B+&B++ B<;B<N) rNrrjoinrrKloadsrrJrrr)rmetrsf rrLazyReferenceMapper.setups $(GG$4$4 HHdii. /%  L!jj\23}-Z 4?? +  , #rc R/RV/pVf.\PP!V3/T;'g/Bwr VPV4'dVP VRR7VP VRR7VP RPVR.4\P!V4P44\W3/VB#)aMake empty parquet reference set First deletes the contents of the given directory, if it exists. Parameters ---------- root: str Directory to contain the output; will be created storage_options: dict | None For making the filesystem to use for writing is fs is None fs: FileSystem | None Filesystem for writing record_size: int Number of references per parquet file kwargs: passed to __init__ Returns ------- LazyReferenceMapper instance rrT recursiveexist_okrr) rcore url_to_fsexistsrmmakedirspiperrKrLrMrj)rstorage_optionsrrkwargsrs&&&&, rcreateLazyReferenceMapper.creates,2}k: :{{,,TMo6K6KMHB 99T?? EE$$E ' D4 ( $ -. 30F0F0HI"46v66rc >RVP4p\V4#)zList top-level directoriesc3"TF6qPR4'dKVPR^4^,xK8 R#5i).zrN) startswithrsplit.0ps& r .LazyReferenceMapper.listdir..s0V^<.s5ndTnc3$"TFqxK R#5irrXrs& rrrs2kdTkrFrtype directorysizer|cVR,#)rrX)rgs&r(LazyReferenceMapper.ls..sAfIrkeyrb)rstriprOrlstriprrJrNupdatesortedrQrKrLr_keys_in_fieldr7rRr^)rr:detailpathdashdirnamesr1rfothersrdirinfofileinforTr_recsrecrecinfos&&& rlsLazyReferenceMapper.lss%{{3!%4#:2<<> ||H% *-QXXh5G*G A  4!N5dnn52dkk2A <<)  /2(9K.K   d#f~%RVWRV$fk61ERVGW# #DDFC>>1 4>>$#78![[.#  ',2EF F"nn Lnd4& 0KTTn L $ K $qz/Jtt K L   ~~-JJt~~d34T*    ""5) U?<$t*, ,))%0!_ , 1vv >%0D4AHIAITWR[47 Im ?J Q< NO O S>aV #R= }I'89 )3-S ( )JsF F1F. F))F.c DVPR^4wr#VPV4p\V4^8XdR#VPR4Uu.uFp\ V4NK pp\ Wd4pWpP ,pWpP ,p W\V43#uupi)z3Details needed to construct a reference for one keyr.)rrr)rrPrQsplitintrhr) rrrTchunkrUr chunk_idx chunk_numberrrs && rr"LazyReferenceMapper._key_to_recordTszz#q) ++E2 { q N%*[[%56%5SV%5 6(@ !1!11 ,, ,3{+++ 7s Bc BWP9dxVPV R2,p\VR,VR,4UUu.uF!wr4\P!W4, 4NK# pppT;'g^.VPV&VPV,#uuppi)z6The number of chunks along each axis for a given fieldz/.zarrayshapechunks)rUrJr^mathceil)rrTzarrayrgr size_ratios&& rrP$LazyReferenceMapper._get_chunk_sizes`s (( (^^ugX$67F-0&BR-S-STQ !% -S '1&7&7QCD  U #&& s'Bc VPW4p\\VP4!4p\ V4^8Xd RV4#\ V4^8Xd VR,#RV4#)z8The references for a given parquet file of a given fieldc38"TFp\V4xK R#5irr7rts& rr7LazyReferenceMapper._generate_record..ps(RDGGRrc3t"TF.q^,'g\VR,4MV^,xK0 R#5i)rrNrrs& rrrvs'Br!ttD2K15rs68)rr/r^r0rQ)rrTrrits&&& r_generate_record$LazyReferenceMapper._generate_recordjs^~~e, #t{{}% & t9>(R( ( Y!^; CrB Brc# "^pVPV4F pW#,pK \P!W P, 4p\ V4FpVP W4RjxL K R#L 5i)zJLoad all the references within a field by iterating over the parquet filesN)rPrr rranger)rrTnrecchrs&& rrR)LazyReferenceMapper._generate_all_recordsxsb''.B JD/yy 0 001DkF,,U; ; ;" ;sA+A:-A8. A:c\V4#r)rFr!s&rr0LazyReferenceMapper.valuess d##rc\V4#r)r\r!s&ritemsLazyReferenceMapper.itemss T""rc\V4#r)idr!s&r__hash__LazyReferenceMapper.__hash__s $xrc$VPV4#r)r)rrs&&r __getitem__LazyReferenceMapper.__getitem__s!!#&&rcRV9dVPV4'gyVPR^4wr4VPV4wrVpVPP W53/4pW(V&\ V4VP 8XdVPW54R#R#\VR4'd VP4P4p M)\V\4'dVP4p MTp WPV&\P!V 4p /VPP!V/4CV CVPV&R#)rto_bytesN)rrrrNr?rQrwritehasattrr*decoder6bytesrKrrJr5) rrvaluerTrrrfrsubdictrS new_values &&& r __setitem__LazyReferenceMapper.__setitem__s #:dmmC00::c1-LE..s3LFqkk,,e_bAGAJ7|t/// 5)0uj))nn&--/E5))lln"KK  3I"NT^^%7%7R%@"NI"NDNN3 rc>VPR4;'gRV9#)rz/.zrrs&rrLazyReferenceMapper._is_metas~~d#33u|3rcWP9dVPVR#WP9dVPVR#RV9dVPV4'gyVPR^4wr#VP V4wrEpVPP W$3/4pRWe&\ V4VP8XdVPW$4R#R#RVPV&R#rN) rNrJrrrr?rQrr+)rrrTrrrfr0s&& r __delitem__LazyReferenceMapper.__delitem__s ++  C NN "s#cz$--"4"4::c1-#2237 1++00%"E! w<4#3#33JJu-4$( C rc H^RIp^RIp^RIpVPW3,pRp \ V4VP 8dVP W4p V 'd&V R,p V R,p V R,p V R,p MVPVP VPRR7p VPVP R R7p VPVP R R7p VPVP VPRR7p VP4Fwr\V\4'd\V P4R 8Xd;V^,V PP 9dV P#V^,4p V^,W&\ V4^8dV^,W&V^,W&KKVfRW&^W&^W&RW&KVP$P'V4W&K VP)RV RV RV RV /RR 7pVP*P-4VP*P/4;'g^, VP08dVR,P3R 4VR&RR RR /pRR.pT;'g VP4 RV RV R2pVP6P9T;'g VP4 RV 2RR7VP:R8XdRR/pM2VP:R8Xd RRRVRV/pM\=VP: R24hVP>!V3RVP:RT;'g\AVP6RR4RRRR/VBVPC4VPPEW34R# \dELQi;i)rNFr:rrrO)dtypeint64category)copyr.utf8rz/refs.z.parqTrrwwrite_statisticsrvstatsobject_encoding has_nullsz not supportedrur compressionzstdindex)# kerchunk.dfrlrprNrQrrrfullnanzerosr r6r7r9r= categoriesadd_categoriesr _proc_raw DataFramer:countnuniquerastyperrmkdirsruNotImplementedError to_parquetgetattrclearpop)rrTrbase_urlrkerchunkrmrq partitionoriginalrAoffsetsrdrawsjrrrDrEfndf_backend_kwargss&&&&& rr+LazyReferenceMapper.writesjKK0  y>D,, , >>%8 V$Ex(GV$EE?DGGD,,bffCG@Ehht//wh?GHHT--WH=E774++RVV37?D (GA$%% $ 2Qu{{'='==!00a9E7t9q=!%aGJ#AwEH! #++//5')*\\'t     77==?bggoo/441 5 GF**:6BvJ '66:UO ))DMM*!E7& F (33dmm4AeW=M ;;) #!3U ;  [[M )!?Y!  & ^&DE E  ;; ,99tww 148          (Q  sN N! N!c \VP4F4p\V\4'gKVwrEVP VVVVR7K6 \VP4FQpVR8wgK RV9gK\ P !VPPV44VPV&KS RVPRVP/pVPP4\ P!V4P4VPR&VPPRPT;'g VP R.4VPR,4VP"P%4R#)zdOutput any modified or deleted keys Parameters ---------- base_url: str Location of the output )rZrrrrrrN)r7rNr6r8r+rKrrYrJrrXrLrMrrrrr cache_clear)rrZrthingrTrkrs&&& rflushLazyReferenceMapper.flush s#$++&E%'' %  %$3 'dkk"AL TQY$(JJt{{q/A$Bq!#4>>=$:J:JK $(JJsO$:$:$< L!  HHh//$--> ? KK % ""$rcR^pVP4FQpVPR4'd V^, pK%V\P!VP V44, pKS V\ VP 4, pV\RVP44, pV#)rrc3V"TFp\V\4'dK^xK! R#5i)rN)r6r8)rrs& rr.LazyReferenceMapper.__len__..8sH 1:a3GQQ s) )) rOrrprodrPrQrJsumrN)rrQrTs& r__len__LazyReferenceMapper.__len__.s\\^E$$ 4#8#8#?@@ $ T^^$$ H HHH rc#."\VP4pVPVP4VFp\ V\ 4'gKVxK! VP 4F'pVPV4FpW@9gK VxK K) R#5ir)rrJrrNr6r9rOr)rmetasbitrTrgs& rrVLazyReferenceMapper.__iter__;srDNN# T[[!C#s## \\^E((/9G0$sA B2BBcNVPV4R# \dR#i;i)TF)rrrs&&r __contains__ LazyReferenceMapper.__contains__Hs*    t $  s  $$c # 0"VPV4p\V4^8XdVR,xR#\P!RV4!pVF=pVR,RP VUu.uFp\ V4NK up4,xK? R#uupi5i)zlList key names in given field Produces strings like "field/x.y" appropriate from the chunking of the array rHNc38"TFp\V4xK R#5ir)r)rrfs& rr5LazyReferenceMapper._keys_in_field..Xs"A[588[rrr)rPrQ itertoolsproductrr9)rrTrUindsindrs&& rr"LazyReferenceMapper._keys_in_fieldOs ++E2 { q $,    "A["ABC#+#)>#Q#a&#)> ?? ?)>sA&B(B <B)rNrrrrUrurrOrrrrrrJ)NN rv)NNi')rTNN)#r$r%r&r'__doc__propertyrmrqrrr staticmethodrrOrrrrPrrRr0r r$r'r2rr9r+rhrorVrvrr(r)rZs@rrjrj[sY  5K5Kn##077< @"D&P ,' C<$#'O(44("S)j!%F   @ @rrjc$aa]tRtRtoRtRtRtR"V3RlltR#RltR#Rlt R#Rlt R t R t ] 3R ltR$R ltR%R ltR&RltRtR&RltRtRtRtR'RltR(RltRtRtRtR(RltR)V3RlltRtRtRt R*Rlt!R*Rlt"R t#R!t$Vt%V;t&#)+ReferenceFileSystemi]aView byte ranges of some other file as a file system Initial version: single file system target, which must support async, and must allow start and end args in _cat_file. Later versions may allow multiple arbitrary URLs for the targets. This FileSystem is read-only. It is designed to be used with async targets (for now). We do not get original file details from the target FS. Configuration is by passing a dict of references at init, or a URL to a JSON file containing the same; this dict can also contain concrete data for some set of paths. Reference dict format: {path0: bytes_data, path1: (target_url, offset, size)} https://github.com/fsspec/kerchunk/blob/main/README.md rFc <\SV`!R /VBW nWnWn/Vn/Vn/VnWnWn \V\4'Ed\R /T;'g T;'g/BRV/Bp\PP!V3/VBwppRV9dYVP!R 4'gVP#V4'd+\$P'RV4\)VVV R7VnMy\P,!VR3/VB;_uu_4p\$P'RV4\.P0!V4pRRR4VP3XV 4MVP3W4\V\4'dVP54UUu/uFMwppT\V\4'd/\P6!VP9R^4^,3/VBMTbKO uppVnRVP 9d\7R 4VP R&R#VeN\VP:\<4'dVP:^,M VP:pWP V&VfVP P?4F~p\AV4'dV!4p\PPCV4wppV'gKGVVP 9gKZ\7V3/T;'g/BpWP V&K VfVP*P?4Fp\AV4'dV!4p\V\D4'gK3V^,'gKD\PPCV^,4wppVVP 9gK\7V3/T;'g/BpWP V&M V'd5W`P 9d%\7V3/T;'g/BpWP V&T;'g \7R 4VP R&VP P54FlwppVPF'g'\IVVPJR 7VP V&K>VPJVPJ, 'gKc\MR 4h R# +'giEL;iuuppi)a` Parameters ---------- fo : dict or str The set of references to use for this instance, with a structure as above. If str referencing a JSON file, will use fsspec.open, in conjunction with target_options and target_protocol to open and parse JSON at this location. If a directory, then assume references are a set of parquet files to be loaded lazily. target : str For any references having target_url as None, this is the default file target to use ref_storage_args : dict If references is a str, use these kwargs for loading the JSON file. Deprecated: use target_options instead. target_protocol : str Used for loading the reference file, if it is a path. If None, protocol will be derived from the given path target_options : dict Extra FS options for loading the reference file ``fo``, if given as a path remote_protocol : str The protocol of the filesystem on which the references will be evaluated (unless fs is provided). If not given, will be derived from the first URL that has a protocol in the templates or in the references, in that order. remote_options : dict kwargs to go with remote_protocol fs : AbstractFileSystem | dict(str, (AbstractFileSystem | dict)) Directly provide a file system(s): - a single filesystem instance - a dict of protocol:filesystem, where each value is either a filesystem instance, or a dict of kwargs that can be used to create in instance for the given protocol If this is given, remote_options and remote_protocol are ignored. template_overrides : dict Swap out any templates in the references file with these - useful for testing. simple_templates: bool Whether templates can be processed with simple replace (True) or if jinja is needed (False, much slower). All reference sets produced by ``kerchunk`` are simple in this sense, but the spec allows for complex. max_gap, max_block: int For merging multiple concurrent requests to the same remote file. Neighboring byte ranges will only be merged when their inter-range gap is <= ``max_gap``. Default is 64KB. Set to 0 to only merge when it requires no extra bytes. Pass a negative number to disable merging, appropriate for local target files. Neighboring byte ranges will only be merged when the size of the aggregated range is <= ``max_block``. Default is 256MB. cache_size : int Maximum size of LRU cache, where cache_size*record_size denotes the total number of references that can be loaded in memory at once. Only used for lazily loaded references. kwargs : passed to parent class rCz.jsonz$Open lazy reference dict from URL %s)rrrbzRead reference from URL %sN:r|) asynchronouszEReference-FS's target filesystem must have same value of asynchronousrX)parqparquetr)'rrrtemplate_overridessimple_templates templatesfss _dircachemax_gap max_blockr6r9dictrrrendswithisdirloggerinforjr;r rKload_process_referencesr r rrCr8r0callabler r7 async_implr rr)rforref_storage_argstarget_protocoltarget_optionsremote_protocolremote_optionsrrrrrrrdicref_fsfo2rtextrgoptsr<rCrrs&&&&&&&&&&&&&&, rrReferenceFileSystem.__init__osR "6" "4 0 " b#  #;;~;;GVC!++//:c:KFCc! 455c9J9J BBG"5)#[[T1S11QKK #-R[[%"@"@ Abkk )+HH_ %  "~~,,.C==%C$kk88= !8 8#HG1E1E2GB)+HHX& /  "--/C==%Cc4((SVV"(++"<"OF0D0D"FB(*HH_ %11z&1HHNN$DAq<<<4QTEVEVW ""Q^^33 & %o211s"-S $AS  S c VPV4p\PRV 24VPV,p\ T\4'dTP4p\TR4'dTP4p\ T\4'dS\PRT R24TPR4'd\P!TR,4pTRR3#\T4^8Xd(\PRT RT 24T^,pY#rMlTwrip \PRT RT R T R T 24Y,p TeT^8d Y,pM Y,pMT pTeT^8d Y,pM Y,pMT pTf TP pYgT3# \dp\ T4ThRp?ii;i) zcat: Nr*z Reference: z , type bytesbase64:NNz, whole file => z => z , offset z, size )_strip_protocolrdebugr;rrr6r9rMr,r*r.rbase64 b64decoderQr) rr:startendpartrrstart1end1start0rend0s &&&& r _cat_commonReferenceFileSystem._cat_commons##D) uTF^$ 3??4(D dC ;;=D 4 $ $==?D dE " " LL;tfL9 :z**''R1t# # t9> LL;tf,s$($4$4TC$4$P! T k5 ) )S) )$[1  B(+55t6  B': A Bs;>B'A/(A-)A/,B-A// B : BB  Bc VPWVR7wrVp\V\4'dWRV#\V4wrVPV,P WVVR7# \ dp \Y4T hRp ? ii;ir)rr6r.r rrrrrs &&&&, rrReferenceFileSystem.cat_fileJs$($4$4TC$4$P! T k5 ) )S) )$[1  B88H%..{d.S S B': A Bs#A## A?. A::A?c "W PV&R#)z2Temporarily add binary data or reference as a fileNr;)rr:r/rs&&&,r pipe_fileReferenceFileSystem.pipe_fileTs %rc&"VPV4'd\P!VRR7#VPV4GRjxL p\ VR4;_uu_4pVP V4RRR4R#L4 +'giR#;i5i)TrNwb)rosrrr r+)rrpathlpathrrrs&&&, r _get_fileReferenceFileSystem._get_fileXsf ::e  ;;ut4 4^^E** %  ! GGDM +   s*ABA;BA=1 B= B  Bc VPV4'd\P!VRR7#VP!V3/VBpVP \ V44\ V4'dVPV4M.\VR4;_uu_4pVPV4RRR4VP\ V44R# +'giL,;i)TrrN) rrrrset_sizerQrr+r absolute_update)rrrcallbackrrrs&&&&, rget_fileReferenceFileSystem.get_file_s ::e  ;;ut4 4}}U-f-#d)$ e   KK eT""a #  T+#"s C  C c V'dVPR4VPWR7p\P!RRR7p\ W4pV'd;TP VUu.uFqpP V4'dKVNK up4pMVP V4p\W4F%wrW9gK VPWV ,4K' R#uupi)rrr|T) auto_mkdirN) r expand_pathrr rcatrr^r) rrrrrrtargetsrrremotelocals &&&&, rr5ReferenceFileSystem.getks  GGBK   <   v$ 7e+ 88C1ZZ]QQCDD88E?D 0MF~ UL11Ds &CCc \V\4'dV'd\h\V\4'dIV'g;\;QJdRV4F 'gK RM RM !RV44'd\h\ WP 4p/pVP4EFwrxVPV,p ....3wrrVF|pVPV4wppp\V\\34'gK7V PV4V PV4V PV4V PV4K~ .p.p.p.p\4p\WW4Fwpppp\V\4'dWV&K$VeK*VPV4VPV4VPV4VPV4VPV4K \WW4F[wppppVfKVV9gKVPV4VPV4VPV4VPV4K] \!\V4\V4\V4RVP"VP$R7wpppV P'VVV4p\WW4FwppppW9dK\VVVV4FwppppVV8Xd.VeVf&\V\(4'dVWn&K3VVVWn&K<VV8XgKEVV8gKNVV8:gKW\V\(4'dVWn&KsTVV, VV, ;'gRWn&K K EK VP+4P4Fuwp p!\V!\(4'gKV VP 9gK1VV ,p"\-V VP V ,4p#V"V#nVR8XdV#hVR8wgKpV#VV &Kw \1V4^8Xd)\V\4'dRV9d \3V4#V# \d'pTR8XdhTR8wd TYn&Rp?EKRp?EKRp?ii;i)c3,"TF pRV9xK R#5i)*NrXrs& rr*ReferenceFileSystem.cat..}s7O$Qq$TFraiseomitN)sortrrr)r6r9rUr7anyrDr;r rrr.r@rrr^addrrr cat_rangesrr@r __cause__rQr2)$rr:ron_errorr proto_dictrBprotorArurlsstartsends valid_pathsrurgrerrurls2starts2ends2paths2 whole_files new_paths new_startsnew_ends bytes_outrmnsnebrgvexnew_exs$&&&&, rrReferenceFileSystem.catzs dC Y% % dD ! !yCC7O$7OCCC7O$7O4O4O% %%dOO< &,,.LE%B.0"b"n +D$*"..q1GAq!%a%66 7KKNMM!$KKN&&q)#(EGEF%K!$B 1aa''FY OOA&LLONN1%LLOMM!$C"$B 1a=Qk%9LLONN1%LLOMM!$ C/BU W U  .. / +Iz8 iXFI"$B 1a8%(J)%TMBBQwBJ"*%a33%&CF%&qVCFqQ"Wb%a33%&CF%&q2vR0@0@D%ACF&UCy/VHHJ$$&DAq!Y''A,@V.q$//!2DE#% w& L'#CF' s8q=Zc22s$#;  [)%7*6)!$*%s1Q  Q<Q77Q<cVPRR4pVfVPV4R#V^8XdVPWR7R#\RV 24h)versionN)rz Unknown reference spec version: )r5_process_references0_process_references1r)rr;rverss&&& rr'ReferenceFileSystem._process_referencessP~~i. <  % %j 1 QY  % %j % X?vFG Grc  \V\4'dQVP4UUu/uF4wr#T\V\4'd\P!V4MTbK6 pppWnR#uuppi)z&Make reference dict for Spec Version 0N)r6rr rKrLr;)rr;rrSs&& rr(ReferenceFileSystem._process_references0sc j$ ' ' !+ 0 0 2 2HC 3(=(=TZZ_3F 2 % s:A/c^aaSP'dSP'd^RIo/SnSP VP R/44\ R4VV3Rl4pVP R/4P4EFfwrE\V\4'dSVPR4'd+\P!VR,4SPV&VSPV&Kn\V\4'd&\P!V4SPV&KSP'dV^,pRV9dXSP'd>VP!RR 4P!R R 4P"!R /SPBpMV!V4p\%V4^8XdV.MWe^,V^,.SPV&EKWVSPV&EKi SPP'SP)VP R .444R#)rNricZ<SPV4P!R/SPB#NrX)Templaterenderr)rjinja2rs&r _render_jinja?ReferenceFileSystem._process_references1.._render_jinjas$??1%,,>t~~> >rrzbase64:r{{{z}}}genrX)rrrr;_process_templatesr5rr r6r9rrrrrKrLreplacerxrQr _process_gen)rr;rrrgrrrsf&& @rr(ReferenceFileSystem._process_references1s$$$   {B ?@ 4 ?  ?NN62.446DA!S!!<< **)/)9)9!B%)@DOOA&%&"At$$%)ZZ]"aD19,,,IIdC0$WT3/#V$6&*nn6 *!,,/FaKaSa1qt_"%&")7* t00r1JKLrca/VnVPeVPVP4VP4F6wr#RV9d^RIoV3V3RllVPV&K(W0PV&K8 R#)NrcF<SPV4P!R/VB#r)rr)temprrs&,rr8ReferenceFileSystem._process_templates..s(V__>&>>#!>#r)rrrr r)rtmprgrrs&& @rr&ReferenceFileSystem._process_templatesse  " " . JJt.. /IIKDAqy01%#q!%&q! rca /pVEFpVR,P4UUu/uFRwrET\V\4'dTM3\VP R^4VR,VP R^44bKT uppo V 3Rl\ P !S P4!4pVEF&p^RIpVPVR,4P!R /VBVPBp VPVR,4P!R /VBVPBp RV9dR V9d\VPVR,4P!R /VBVPB4p \VPVR ,4P!R /VBVPB4p WV .W)&EKRV9R V9, 'd \R 4hV .W)&EK) EK V#uuppi) dimensionsrstopstepc3j<"TF(p\\SP4V44xK* R#5ir)rr^r_)rr0 dimensions& rr3ReferenceFileSystem._process_gen..,s.DFS)6233Ds03Nrrrlengthz^Both 'offset' and 'length' are required for a reference generator entry if either is provided.rX)r r6r7rr5r{r|r0rrrrrr)rgensrBrrgrproductsprrrrrr)r's&& @rr ReferenceFileSystem._process_gen!sC -335  6DA !!T**quuWa0!F)QUU61=MNO 6 I'//1A1A1CDHooc%j188P2PPooc%j188P2PPO(c/ H 6==UUdnnUF!H 6==UUdnnUF!$V4CH#o(c/::$K !$uCH'B AsAG c ,R./VnVPP4pVEFiwr#\V\\ 34'g\ VR4'd \V4pM\V4^8XdRpMVwrTRV9dVPR^4^,MRpTpV.pV'd5WpP9d%VPV4pVPV4K<VP4\WR,4F`wrWP9gQhWP9gQhVPV ,PRV RRR^/4.VPV &Kb VPV,PRVRR RV/4EKl R#) rr*Nr:rNNrrrrr|) dircacher;r r6r.r9r,rQr_parentr@reverser^) rrr:rrrparpar0subdirsparentchilds & r_dircache_from_items(ReferenceFileSystem._dircache_from_itemsFsUR __ " " $JD$ --z1J1J4yTa! 1,/4K$++c1%a(RCDfG4}}4||D)t$ OO !$Wbk!: MM111... f%,,UFKC(* e$"; MM#  % %vtVVVT&R S3rc &VPV4wrgp\V\4'd\P!WgV4#\ V4wrVf.Vf*VP V ,P!VV3RVRV/VB#\VVV3RVRV/VB#)N block_size cache_options) rr6r.rrr r_open ReferenceFile) rr:moder:r;rrrrrCrs &&&&&, rr<ReferenceFileSystem._opends$($4$4T$:! T k5 ) )::k67 7$[1  >dl88H%++&,        "  (     rc \PRV4VPV4p\VP\ 4'dVPP W4#VP'gVP4VPV4pVf \V4hV'dV#VUu.uF qUR,NK up# \dMi;i\RT R24huupi)zlist %s'z' is not a known keyr) rrrr6r;rjrrrr/r7_ls_from_cache)rr:rrrBos&&&, rrReferenceFileSystem.ls~s Y%##D) doo': ; ; ))$77}}}  % % '!!$' ;#D) ) J#&'3a& 3''  #av-A$BC C(s C4C( CCc VVPV4;'gVPV4#r)risfilerr:rs&&,rrReferenceFileSystem.existss"zz$444;;t#44rc\aVP'dSVP9#\VP\4'dSVPP 49#\ ;QJd)V3RlVP4F 'gK R# R#!V3RlVP44#)c3J<"TFqPS R24xK R#5ir8r5)rrr:s& rr,ReferenceFileSystem.isdir..s!IA||tfAJ//s #TF)r/r6r;rjrOrrr:s&frrReferenceFileSystem.isdirsx ===4==( ( )< = =4??2244 43II33 I3 I3III IrcWP9#rrrLs&&rrFReferenceFileSystem.isfiles&&rc0"VP!W3/VB#5ir)r)rr:rrs&&&,r_lsReferenceFileSystem._lsswwt.v..sc <aV'd\SV`!S3RVRVRV/VB#S'd2VPS4o\V3RlVP44pM\VP4pV'dKVP 'gVP 4VUu/uFqwVPV4^,bK up#V#uupi)maxdepthwithdirsrc3X<"TFqPS4'gKVxK! R#5irr5)rrgr:s& rr+ReferenceFileSystem.find..sH/Q\\$5Gqq/s* *)rfindrrr;r/r7rB) rr:rTrUrrrrgrs &f&&&, rrXReferenceFileSystem.finds 7<'2:CIMS  ''-DH$//HHAt'A ===))+:;GD"hhtn11$//$2G2JKDGFOAw9s D< D<c,"VPV4#5ir)rrGs&&,r_infoReferenceFileSystem._infosyyrcz"VPPVR4VPP4R#5ir)r;rYr/rXrGs&&,r_rm_fileReferenceFileSystem._rm_files.  $  s9;c"VR8XdVPV4'd\hW PV&VPP 4R#5i)rN)rFileExistsErrorr;r/rX)rr:rr>rs&&&&,r _pipe_fileReferenceFileSystem._pipe_files= 8  D 1 1! ! $ s A0Ac$"VR8XdVPV4'd\h\VR4;_uu_4pVP4VPV&RRR4VP P 4R# +'giL,;i5i)rrN)rrer readr;r/rX)rrrr>rrs&&&&, r _put_fileReferenceFileSystem._put_filesa 8  E 2 2! ! %  !%&VVXDOOE "  s!BBA=$B= B Bc /pVPP4F5wrE\V\4'dVP R4W4&K1WSV&K7 \P!VR3/VB;_uu_4pVP\P!R^RV/4P44RRR4R# \ d2R\ P!T4,P 4Y4&Ki;i +'giR#;i)z+Write modified references into new locationasciirrrrN)r;r r6r.r-UnicodeDecodeErrorr b64encoderr r+rKrLrM)rrrrBrgrrs&&, r save_jsonReferenceFileSystem.save_jsonsOO))+DA!U##IXXg.CFA,[[d 6o 6 6! GGDJJ 1fc:;BBD E7 6 *I(6+;+;A+>>FFHCFI7 6 6sB868C788C43C47 D ) rr/rrrr;rrrr) NNNNNNNNTii@Brr)F)Frr)rNN)T)NFF) overwrite)'r$r%r&r'rrCcachablerrrrrrr rr5rrrrrrr7r<rrrrFrQrXrr_rbrfrjrpr(r)r*r+s@@rrr]s HHaF*!X BB&/? , 2`DH %MB &#JT< 4($5J'/"*  F FrrcXaa]tRtRtoRV3Rllt]R4tV3RltRtRt Vt V;t #)r=ic   <\S V`!VV3RVRVRVRVRVRV/V BVPPVP4wqnVn\V 4wrVPPV ,Vn Wn RVn R#)r>r: autocommitr cache_typer;N) rrrrr:rrr rsrc_fssrc_path_f)rrr:r>r:rvrwr;rrrrCrrs&&&&&&&&&, rrReferenceFile.__init__s     " "  " (  -1GG,?,? ,J) Z$[1 ggkk(+ # rc &VPeVPP'd]VPP!VP3RVP RVP RVPRR/VPBVnVP#)Nr>r:rvrwnone) rzclosedrxr<ryr> blocksizervrr!s&rrReferenceFile.fs 77?dggnnnkk'' YY >> ??  "  ++ DGwwrcp<VPeVPP4\SV`4#r)rzcloser)rrs&rrReferenceFile.closes& 77  GGMMOw}rcWP,p\W P,VP4pVPP V4VPP W!, 4#r)rminrrseekri)rrrs&&&r _fetch_rangeReferenceFile._fetch_range sJ "# "DHH-  Evv{{3;''r)rzrrxryr)rdefaultT readaheadNN) r$r%r&r'rrrrrr(r)r*r+s@@rr=r=s-:   ((rr=)2r collectionsrr{loggingrr functoolsrrtypingrr fsspec.corer fsspec.specrujsonrKr fsspec.asynrfsspec.callbacksr r r r #fsspec.implementations.asyn_wrapperr fsspec.utilsrrr getLoggerr RuntimeErrorrr2r=rDabc ValuesViewrF ItemsViewr\rhMutableMappingrjrr=rXrrrs   ), (-88F   - .TLT"?  B[__// BAKOO--A @+//88@DP F/P Ff4((4(& sDDDD