i1ddlZddlmZmZmZmZddlmZmZddl Z gdZ eddZ Gdd ee Z Gd d e e ZGd d e e ZGdde e ZGdde e ZGdde ee Zy)N)IterableIteratorSequenceSized)GenericTypeVar) BatchSampler RandomSamplerSamplerSequentialSamplerSubsetRandomSamplerWeightedRandomSampler_T_coT) covariantc"eZdZdZdeefdZy)r aBase class for all Samplers. Every Sampler subclass has to provide an :meth:`__iter__` method, providing a way to iterate over indices or lists of indices (batches) of dataset elements, and may provide a :meth:`__len__` method that returns the length of the returned iterators. Example: >>> # xdoctest: +SKIP >>> class AccedingSequenceLengthSampler(Sampler[int]): >>> def __init__(self, data: List[str]) -> None: >>> self.data = data >>> >>> def __len__(self) -> int: >>> return len(self.data) >>> >>> def __iter__(self) -> Iterator[int]: >>> sizes = torch.tensor([len(x) for x in self.data]) >>> yield from torch.argsort(sizes).tolist() >>> >>> class AccedingSequenceLengthBatchSampler(Sampler[List[int]]): >>> def __init__(self, data: List[str], batch_size: int) -> None: >>> self.data = data >>> self.batch_size = batch_size >>> >>> def __len__(self) -> int: >>> return (len(self.data) + self.batch_size - 1) // self.batch_size >>> >>> def __iter__(self) -> Iterator[List[int]]: >>> sizes = torch.tensor([len(x) for x in self.data]) >>> for batch in torch.chunk(torch.argsort(sizes), len(self)): >>> yield batch.tolist() .. note:: The :meth:`__len__` method isn't strictly required by :class:`~torch.utils.data.DataLoader`, but is expected in any calculation involving the length of a :class:`~torch.utils.data.DataLoader`. returnctN)NotImplementedErrorselfs m/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/torch/utils/data/sampler.py__iter__zSampler.__iter__Bs!!N)__name__ __module__ __qualname____doc__rrrrrr r s#J"(5/"rr cJeZdZUdZeed<deddfdZdeefdZ defdZ y)r zSamples elements sequentially, always in the same order. Args: data_source (Sized): data source to sample from. Must implement __len__. data_sourcerNc||_yr)r!)rr!s r__init__zSequentialSampler.__init__js &rcPttt|jSr)iterrangelenr!rs rrzSequentialSampler.__iter__msE#d../011rc,t|jSr)r'r!rs r__len__zSequentialSampler.__len__ps4##$$r) rrrrr__annotations__r#rintrr)rrrr r as> 'E'd'2(3-2%%rr c eZdZUdZeed<eed< d dedededzddfdZe defdZ de efd Z defd Z y) r aSamples elements randomly. If without replacement, then sample from a shuffled dataset. If with replacement, then user can specify :attr:`num_samples` to draw. Args: data_source (Sized): data source to sample from. Must implement __len__. replacement (bool): samples are drawn on-demand with replacement if ``True``, default=``False`` num_samples (int): number of samples to draw, default=`len(dataset)`. generator (Generator): Generator used in sampling. r! replacementN num_samplesrc"||_||_||_||_t |jt st d|jt |jtr|jdkrtd|jy)N;replacement should be a boolean value, but got replacement=rDnum_samples should be a positive integer value, but got num_samples=) r!r- _num_samples generator isinstancebool TypeErrorr.r+ ValueError)rr!r-r.r3s rr#zRandomSampler.__init__s'&'"$**D1MdN^N^M_` $**C0D4D4D4IVW[WgWgVhi 5Jrc\|jt|jS|jSr)r2r'r!rs rr.zRandomSampler.num_sampless-    $t''( (   rc#Kt|j}|jptt j dtj jj}t j}|j|n |j}|jrt|jdzD]?}t j|dtj |jEd{At j||jdzftj |jEd{yt|j|zD]/}t j ||jEd{1t j ||jd|j|zEd{y777H7 w)Nrdtype )r<)highsizer;r3r3)r'r!r3r+torchemptyint64random_item Generator manual_seedr-r&r.randinttolistrandperm)rnseedr3_s rrzRandomSampler.__iter__s   ! >> !u{{2U[[9AACHHJKD)I  ! !$ 'I   4++r12 ==ekkY&(3}}&&+-kk#  fh   4++q01 >>!yAHHJJJ2~~a9=DDF&$""Q&   K sJC=G"?GA G" G AG"G>G"G G"G"G" G"c|jSrr.rs rr)zRandomSampler.__len__r)FNN)rrrrrr*r5r+r#propertyr.rrr)rrrr r ts  ""& 4Z   ,!S!! (3-6  rr cXeZdZUdZeeed<ddeeddfdZdeefdZ defdZ y) r zSamples elements randomly from a given list of indices, without replacement. Args: indices (sequence): a sequence of indices generator (Generator): Generator used in sampling. indicesNrc ||_||_yr)rRr3)rrRr3s rr#zSubsetRandomSampler.__init__s "rc#Ktjt|j|jj D]}|j|ywNr?)r@rIr'rRr3rH)ris rrzSubsetRandomSampler.__iter__s@DLL 1T^^LSSUA,,q/ !VsAAc,t|jSr)r'rRrs rr)zSubsetRandomSampler.__len__s4<<  rr) rrrrrr+r*r#rrr)rrrr r sFc]# #$#"(3-"!!rr c eZdZUdZej ed<eed<eed< d de e dededdfdZ de efdZ defd Zy) raSamples elements from ``[0,..,len(weights)-1]`` with given probabilities (weights). Args: weights (sequence) : a sequence of weights, not necessary summing up to one num_samples (int): number of samples to draw replacement (bool): if ``True``, samples are drawn with replacement. If not, they are drawn without replacement, which means that when a sample index is drawn for a row, it cannot be drawn again for that row. generator (Generator): Generator used in sampling. Example: >>> # xdoctest: +IGNORE_WANT("non-deterministic") >>> list( ... WeightedRandomSampler( ... [0.1, 0.9, 0.4, 0.7, 3.0, 0.6], 5, replacement=True ... ) ... ) [4, 4, 1, 4, 5] >>> list( ... WeightedRandomSampler( ... [0.9, 0.4, 0.05, 0.2, 0.3, 0.1], 5, replacement=False ... ) ... ) [0, 1, 4, 3, 2] weightsr.r-Nrct|trt|ts|dkrtd|t|tstd|t j |tj }t|jdk7r!tdt|j||_ ||_ ||_ ||_ y)Nrr1r0r:z=weights should be a 1d sequence but given weights have shape )r4r+r5r7r@ as_tensordoubler'shapetuplerYr.r-r3)rrYr.r-r3weights_tensors rr#zWeightedRandomSampler.__init__s;,+t,aVWbVcd +t,Mk][  E ~## $ )&&+N,@,@&A%BD  & &&"rc#Ktj|j|j|j|j }t |jEd{y7wrU)r@ multinomialrYr.r-r3r%rH)r rand_tensors rrzWeightedRandomSampler.__iter__sL'' LL$**D,<,<  **,---sAA( A&!A(c|jSrrNrs rr)zWeightedRandomSampler.__len__rOr)TN)rrrrr@Tensorr*r+r5rfloatr#rrr)rrrrrss4\\ ! #%## #  #@.(3-.   rrc^eZdZdZdeeeezdededdfdZde e efdZ defd Z y) r aWraps another sampler to yield a mini-batch of indices. Args: sampler (Sampler or Iterable): Base sampler. Can be any iterable object batch_size (int): Size of mini-batch. drop_last (bool): If ``True``, the sampler will drop the last batch if its size would be less than ``batch_size`` Example: >>> list( ... BatchSampler( ... SequentialSampler(range(10)), batch_size=3, drop_last=False ... ) ... ) [[0, 1, 2], [3, 4, 5], [6, 7, 8], [9]] >>> list( ... BatchSampler(SequentialSampler(range(10)), batch_size=3, drop_last=True) ... ) [[0, 1, 2], [3, 4, 5], [6, 7, 8]] sampler batch_size drop_lastrNct|trt|ts|dkrtd|t|tstd|||_||_||_y)NrzBbatch_size should be a positive integer value, but got batch_size=z7drop_last should be a boolean value, but got drop_last=)r4r+r5r7rhrirj)rrhrirjs rr#zBatchSampler.__init__4sr:s+*d+QTU_T`a )T*I)U  $"rc#8Kt|j}|jr'|g|jz}t |ddiD]}g| ygt j ||j}|r*|gt j ||j}|r)yyw)NstrictF)r%rhrjrizip itertoolsislice)r sampler_iterargsbatch_droplastbatchs rrzBatchSampler.__iter__MsDLL) >> >DOO3D"%t":E":'''#;Gi&&|T__EFE J)**<IJs BBBc|jr"t|j|jzSt|j|jzdz |jzS)Nr[)rjr'rhrirs rr)zBatchSampler.__len__ZsI >>t||$7 7 %7!;O Or) rrrrr r+rr5r#rlistrr)rrrr r sd*# -## #  #2 K(49- KPPrr )rocollections.abcrrrrtypingrrr@__all__rr r+r r r rrvr rrrrzs??#   4('"gen'"J% %&H GCLH V!'#,!,F GCLF RDP749%DPr