iA ,ddlZddlmZmZmZmZddlmZddlm Z m Z m Z ddl Z ddl mZddl mZddlmZmZmZmZmZmZddlmZddlZdd lmZmZmZmZdd l m!Z!dd l"m#Z#dd l$m%Z%dd l&m'Z'ddl(m)Z)m*Z*e ee+ee dfedfZ,e)Z-de,dee e.ddffdZ/de,de.fdZ0 dde1ddde2deefdZ3 d dede eefde e%defdZ4 d dede eefde e%de5e5e e6e+e fffdZ7 d dede eefde e%de6e+e ffdZ8de1de2fdZ9y)!N) GeneratorIterableMappingSized)fields)AnyOptionalUnion)is_dataclass_instance)Tensor) BatchSampler DataLoaderIterableDataset RandomSamplerSamplerSequentialSampler) TypeGuard)_reinstantiate_wrapped_cls_replace_value_in_saved_argshas_iterable_dataset sized_len)PossibleUserWarning)_IndexBatchSamplerWrapper) RunningStage)MisconfigurationException) WarningCacherank_zero_warnBTypebatchreturnc#Kt|tr(|jdk(rdy|jdyt|tt frKt|t s;t|t r|j}|D]}t|Ed{yt|r8t|D])}tt||jEd{+ydy7O7w)Nr) isinstancer ndimsizerrstrvalues_extract_batch_sizer rgetattrname)rsamplefields u/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/pytorch_lightning/utilities/data.pyr(r(+s% ::?G**Q-  EHg. / 5#8N eW %LLNEF*62 2 2 u %E]E*75%**+EF F F# 3 Gs%BC(C$AC(C& C(&C(cd}d} t|D]'}||}||k7stjd|dn| t ||S#t$r t|wxYw)zUnpack a batch to find a ``torch.Tensor``. Returns: ``len(tensor)`` when found, or ``1`` when it hits an empty or non iterable. zWe could not infer the batch_size from the batch. Either simplify its structure or provide the batch_size as `self.log(..., batch_size=batch_size)`.NzZTrying to infer the `batch_size` from an ambiguous collection. The batch size we found is zK. To avoid any miscalculations, use `self.log(..., batch_size=batch_size)`.)r( warning_cachewarnRecursionErrorr)r error_msg batch_sizebss r-extract_batch_sizer5>s PJ (%e,B! r!""!!+ ,wy-' 22  (Y''(sA A A dataloaderstrategyzpl.strategies.Strategy2allow_zero_length_dataloader_with_multiple_devicesc|t|}|y|jtj||jd}|dk(r"t dt |jd|dkDr:|dk(r5t |j}|std|d t d|d t|r t d y ) zIChecks if a given object has ``__len__`` method implemented on all ranks.F)devicesum) reduce_oprzTotal length of `zA` across ranks is zero. Please make sure this was your intention.`zW` within local rank has zero length. Please make sure that it returns at least 1 batch.zb` across ranks is zero, but local rank has zero length. Please be cautious of uneven batch length.zYour `IterableDataset` has `__len__` defined. In combination with multi-process data loading (when num_workers > 1), `__len__` could be inaccurate if each worker is not configured independently to avoid having duplicate data.T) rreducetorchtensor root_devicertype__name__ RuntimeErrorr)r6r7r8 local_length total_lengthdataloader_cls_names r-has_len_all_ranksrH]s Z(L??5<< XEYEY#Zfk?lLqZ 0 9 9:;9 9 aLA-":.77A'()FF   345B B J' / samplermodec@t|||\}}t|g|i|SN)$_get_dataloader_init_args_and_kwargsr)r6rJrKdl_args dl_kwargss r-_update_dataloaderrQs->j'SWXGY %j H7 Hi HHrIc t|tstd|dt|d}|r1|j}|j }|j }|j}nQt|jD cic]\}} |jdr|| } }} d}|j| d<d}ttj|jj } t#d| j%D} | r|rx| j'tjtjj jD cic]!\}} | j(| j*us|| #c} }nN| j'tjtjj | j-dd|st| jD chc]\} }|  vs |j(| | us|  }} }|j/d  jD cic] \}} ||vs || }}} d}j1d |}t|t2r d|d <d|d <n|j't5|||| j%Dchc]f}|j6|j8|j:fvr@|j(|j*ur(|j<|vr|j<|vr |j<h}}|rQt?|}|j@jB}d jEd |D}tGd|d|d|d|d | s`tI|tI|z| jKz }|r6t?|}|j@jB}tGd|d|d|d|fScc} }wcc} }wcc}} wcc} }wcc}w)NzThe dataloader z0 needs to subclass `torch.utils.data.DataLoader`__pl_saved_args_multiprocessing_contextc3LK|]}|j|juywrM)kind VAR_KEYWORD).0ps r- z7_get_dataloader_init_args_and_kwargs..sO!aff 5s"$selfdataset batch_samplerrJz, c3(K|] }d|d yw)z`self.r=NrV)rZarg_names r-r\z7_get_dataloader_init_args_and_kwargs..s(cNb(6(1)=Nbsz,Trying to inject custom `Sampler` into the `z` instance. This would fail as some of the `__init__` arguments are not available as instance attributes. The missing attributes are z. If you instantiate your `zZ` inside a `*_dataloader` hook of your module, we will do this for you. Otherwise, define z inside your `__init__`.z&Trying to inject parameters into the `z{` instance. This would fail as it doesn't expose all its attributes in the `__init__` signature. The missing arguments are z. HINT: If you wrote the `zA` class, add the `__init__` arguments or allow passing `**kwargs`)&r#r ValueErrorhasattrrS__pl_saved_kwargs__pl_saved_arg_names __datasetvarsitems startswithrUdictinspect signature__init__ parametersanyr'updatedefaultemptypopaddgetr'_dataloader_init_kwargs_resolve_samplerrXPOSITIONAL_ONLYPOSITIONAL_OR_KEYWORDr*sorted __class__rCjoinrsetkeys)r6rJrK was_wrappedrOrP arg_namesoriginal_datasetkvattrsparamshas_variadic_kwargsr*r[ non_defaultsr^ required_argssorted_required_argsrGmissing_args_messagemissing_kwargssorted_missing_kwargss r-rNrNs j* -?:,6fghh*&78K,,00 33 %//#'z"2"8"8":T":$!Q!,,sBSA":T +5+M+M'( '##J$7$78CC DFOv}}OO  MM!(!2!2:3F3F!G!R!R!X!X!Z!ZA^_^g^gopovov^v1!Z  MM'++J,?,?@KK L JJvt $ ,2LLNmNqdemPQPYPYafgkalPlN m #&+kkmImdaqL7HQTm ImmI'78G'?+%) /"# )@WVZ[\ A 66a'')@)@A A II FF) # FF) #  %m4(22;;#yy(cNb(cc':;N:OP**>)??Z[nZop""6!77O  Q   i.3y>9V[[]J $*>$: !","6"6"?"? +89L8MN--B,CC]^q]rsRR  I WU"n Js=;OO O 0O ! O.OO+ O8OA+OcR|tjk(}t|d}t|}|6|tus|r+t |dr|j }|j}|j}|j} |r/tdd|||| \} }}| std|jdtd||||| \} }}| std |jd t|g|i|}njt |d r1t |dr% |||j|rdn |j }n-|r td|jdt(n td|r t+|}dd|dddS|dddS#t$r3} d dl} | j%dt'| } | std| d} ~ wwxYw)a.This function is used to handle the sampler, batch_sampler arguments associated within a DataLoader for its re- instantiation. If the dataloader is being used for prediction, the sampler will be wrapped into an `_IndexBatchSamplerWrapper`, so Lightning can keep track of its indices. r_NrS drop_lastFzlTrying to inject `drop_last=False` into batch sampler since you are predicting, however it seems the class `z` does not support it. Your predictions might be incomplete. To mitigate this, expose `drop_last` in the `__init__` method of your custom class.rJzYTrying to inject a modified sampler into the batch sampler; however, it seems the class `z` does not have an argument called `sampler.` To mitigate this, expose an argument `sampler` in the `__init__` method of your custom class.r3)r3rrz:.*__init__\(\) (got multiple values)|(missing \d required)a Lightning can't inject a (distributed) sampler into your batch sampler, because it doesn't subclass PyTorch's `BatchSampler`. To mitigate this, either follow the API of `BatchSampler` and instantiate your custom batch sampler inside the `*_dataloader` hook of your module, or set `Trainer(use_distributed_sampler=False)`. If you choose the latter, you will be responsible for handling the distributed sampling within your batch sampler.z&You are using a custom batch sampler `z` for prediction. Lightning would normally set `drop_last=False` to ensure all samples are returned, but for custom samplers it can't guarantee this. Make sure your sampler is configured correctly to return all indices.)categorya\ Lightning can't inject a (distributed) sampler into your batch sampler, because it doesn't subclass PyTorch's `BatchSampler`. To mitigate this, either follow the API of `BatchSampler` or set `Trainer(use_distributed_sampler=False)`. If you choose the latter, you will be responsible for handling the distributed sampling within your batch sampler.r")rJshuffler_r3r)rJrr_)r PREDICTINGr)rBr rcrSrd__pl_saved_default_kwargsrerr __qualname__ TypeErrorrr3rrematchr&rr)r6rJrK is_predictingr_batch_sampler_clsargskwargsdefault_kwargsrsuccessexrrs r-rvrvs'L333MJ8M]+ &7|&K} ="3 4 00D"44F*DDN%::I(Dfni)%v"//@/M/M.NOFF%A7D&.)% !GT6)6678hh 7}VtVvVM ]L 1gm[6Y  1,77(5u=;R;R! , 89J9W9W8XY  -  `  5mDM*   54 HH_ !^`cdf`gh d   s>#E** F&3.F!!F&ct|drSd|jvr|jdSd|jvr(|j|jj dSt|drt |j tryt|dsy|j}|t|dr |jn|}n |j}t |tryt |tS)Nrdrr^FrJ) rcrdrerSindexr#r^rr_rJrr)r6r_rJs r-_is_dataloader_shuffledrSsz./  44 4// : :  77 7--j.M.M.S.ST].^_ _z9%*Z5G5G*Y :y ),,M +2=)+L-''R_$$',- g} --rI)FrM):rkcollections.abcrrrr dataclassesrtypingrr r r?#lightning_utilities.core.apply_funcr r torch.utils.datar rrrrrtyping_extensionsrpytorch_lightningpllightning_fabric.utilities.datarrrr#lightning_fabric.utilities.warningsr'pytorch_lightning.overrides.distributedr pytorch_lightning.trainer.statesr&pytorch_lightning.utilities.exceptionsr%pytorch_lightning.utilities.rank_zerorrr&rr/intr(r5objectboolrHrQtuplerjrNrvrrVrIr-rs??'' Eqq' DM9LN fc73<0(72CCD u8C=$3L)M&eD@E$$&$9=$u $P_cII%*7H+<%=IEMlE[II$([[ 7H$ %[ < [ 5:tCH~ %& [B$(gIgI 7H$ %gI < gI #s(^ gIT..4.rI