+ QV-jmC>^RIt^RIHtHt^RIHt^RIHtHtH t H t H t H t H t ^RIt^RIt^RIHt^RIHt^RIHt^RIHtHtHt^R IHtHt]'d^RIt^R I H!t!^R I"H#t#!R R ] 4t$]!RR44t%RRlt&RRlt'RRlt(RRRllt)R#)N) dataclassfield)Path) TYPE_CHECKINGAnyClassVarLiteralOptional TypedDictUnion)config)DownloadConfig) array_cast) is_local_path is_remote_urlxopen)no_op_if_value_is_nullstring_to_dict VideoDecoder) FeatureTypec,a]tRt^toV3RltRtVtR#)ExamplecR<V^8dQh/S[S[,;R&S[S[,;R&#)pathbytes)r strr)format __classdict__s"h/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/datasets/features/video.py __annotate__Example.__annotate__s# 3- E?N)__name__ __module__ __qualname____firstlineno____annotate_func____static_attributes____classdictcell__r s@r!rrsr$rcFa]tRt^toRtRtRtRt^tRt Rt ] !RRR7t R t ]P!R ]P !4R ]P"!4/4t] !RRRR 7tR tV3RlRltRV3RlRlltV3RlRltV3RlRltRV3RlRlltV3RltRtVtR#)Videou Video [`Feature`] to read video data from a video file. Input: The Video feature accepts as input: - A `str`: Absolute path to the video file (i.e. random access is allowed). - A `pathlib.Path`: path to the video file (i.e. random access is allowed). - A `dict` with the keys: - `path`: String with relative path of the video file in a dataset repository. - `bytes`: Bytes of the video file. This is useful for parquet or webdataset files which embed video files. - A `torchcodec.decoders.VideoDecoder`: torchcodec video decoder object. Output: The Video features output data as `torchcodec.decoders.VideoDecoder` objects. Args: decode (`bool`, defaults to `True`): Whether to decode the video data. If `False`, returns the underlying dictionary in the format `{"path": video_path, "bytes": video_bytes}`. stream_index (`int`, *optional*): The streaming index to use from the file. If `None` defaults to the "best" index. dimension_order (`str`, defaults to `NCHW`): The dimension order of the decoded frames. where N is the batch size, C is the number of channels, H is the height, and W is the width of the frames. num_ffmpeg_threads (`int`, defaults to `1`): The number of threads to use for decoding the video. (Recommended to keep this at 1) device (`str` or `torch.device`, defaults to `cpu`): The device to use for decoding the video. seek_mode (`str`, defaults to `exact`): Determines if frame access will be “exact” or “approximate”. Exact guarantees that requesting frame i will always return frame i, but doing so requires an initial scan of the file. Approximate is faster as it avoids scanning the file, but less accurate as it uses the file's metadata to calculate where i probably is. read more [here](https://docs.pytorch.org/torchcodec/stable/generated_examples/approximate_mode.html#sphx-glr-generated-examples-approximate-mode-py) Examples: ```py >>> from datasets import Dataset, Video >>> ds = Dataset.from_dict({"video":["path/to/Screen Recording.mov"]}).cast_column("video", Video()) >>> ds.features["video"] Video(decode=True, id=None) >>> ds[0]["video"] >>> video = ds[0]["video"] >>> video.get_frames_in_range(0, 10) FrameBatch: data (shape): torch.Size([10, 3, 50, 66]) pts_seconds: tensor([0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333, 0.4333], dtype=torch.float64) duration_seconds: tensor([0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167, 0.0167], dtype=torch.float64) >>> ds.cast_column('video', Video(decode=False))[0]["video] {'bytes': None, 'path': 'path/to/Screen Recording.mov'} ``` TNNCHWcpuexactF)defaultreprz torchcodec.decoders.VideoDecoderrr)r3initr4cVP#N)pa_type)selfs&r!__call__Video.__call__fs ||r$c^<V^8dQhRS[S[S[S[S[S[P R3,RS[/#)rvaluerreturn)r rr bytearrayrnpndarray)rr s"r!r"Video.__annotate__is7.O.OE#ui"**Vd*d$e.Ojq.Or$c bVf \R4h\P'd^RIHpMRp\ V\ 4'd\P!V4p\ V\4'dRVRR/#\ V\4'dR\VP44RR/#\ V\\34'dRRRV/#\ V\P4'd \V4#Ve\ W4'd \!V4#\ V\"4'dnVP%R4VP%R4rCVe,\&P(P+V4'dRRRV/#VfVeRVRV/#\RV R24h\-R\/V4 24h) zEncode example into a format for Arrow. Args: value (`str`, `np.ndarray`, `bytes`, `bytearray`, `VideoDecoder` or `dict`): Data passed as input to Video feature. Returns: `dict` with "path" and "bytes" fields Nzvalue must be providedrrrzTA video sample should have one of 'path' or 'bytes' but they are missing or None in .z!Unsupported encode_example type: ) ValueErrorr TORCHCODEC_AVAILABLEtorchcodec.decodersr isinstancelistr@arrayrrabsoluterr?rAencode_np_arrayencode_torchcodec_videodictgetosrisfile TypeErrortype)r9r=rrbytes_s&& r!encode_exampleVideo.encode_exampleis{ =56 6  & & & 8L eT " "HHUOE eS ! !E7D1 1 t $ $C 017DA A y1 2 2D'51 1 rzz * *"5) )  %*U*I*I*51 1 t $ $ 99V,eii.@&BGGNN4$8$8vt44#t'766 jkpjqqrs?U }MN Nr$c |<V^8dQhRS[S[S[3,RS[S[S[S[S[S[3,3,,RR/#)rr=token_per_repo_idr>r)r rrr rNbool)rr s"r!r"rBsOGGS'\"G$DeD#I.>)>$?@G  Gr$c  VP'g \R4h\P'd^RIHpM \ R4hVf/p\V\4'dTRrTMVR,VR,rTVfVf\RV R24h\V4'dBV!VVPVPVPVPVPR 7pMz\!VVVPVPVPVPR 7pM@V!VVPVPVPVPVPR 7pRVRV/VnWFP$nV#) aDecode example video file into video data. Args: value (`str` or `dict`): A string with the absolute video file path, a dictionary with keys: - `path`: String with absolute or relative video file path. - `bytes`: The bytes of the video file. token_per_repo_id (`dict`, *optional*): To access and decode video files from private repositories on the Hub, you can pass a dictionary repo_id (`str`) -> token (`bool` or `str`). Returns: `torchcodec.decoders.VideoDecoder` zMDecoding is disabled for this feature. Please use Video(decode=True) instead.rz8To support decoding videos, please install 'torchcodec'.NrrzBA video should have one of 'path' or 'bytes' but both are None in rD stream_indexdimension_ordernum_ffmpeg_threadsdevice seek_mode)rXr]r^r_r`)decode RuntimeErrorr rFrGr ImportErrorrHrrErr\r]r^r_r`hf_video_reader _hf_encodedmetadatar)r9r=rXrrrTvideos&&& r!decode_exampleVideo.decode_examplesT,{{{no o  & & & 8XY Y  $ "  eS ! ! $& =%.& >| #efkellm!noot$$$!%!2!2$($8$8'+'>'>;;"nn (&7$($8$8'+'>'>;;"nn !!.. $ 4 4#'#:#:{{.. E$T7F;" r$cH<V^8dQhRS[RS[S[R3,3,/#)rr>r)r rNr)rr s"r!r"rBs(   }d3 3E.FFG  r$c Z^RIHpVP'dV#RV!R4RV!R4/#)zfIf in the decodable state, return the feature itself, otherwise flatten the feature into a dictionary.)Valuerbinaryrstring)featuresrlra)r9rls& r!flatten Video.flattens8#{{{  xh r$c<V^8dQhRS[S[PS[PS[P3,RS[P/#)rstorager>)r pa StringArray StructArray ListArray)rr s"r!r"rBs:2121E".."..",,*V$W21\^\j\j21r$c  \PPVP4'dr\P!R.\ V4,\P !4R7p\PPW!.RR.VP4R7pEM\PPVP4'd\V\P !44p\P!R.\ V4,\P!4R7p\PPW.RR.VP4R7pEM\PPVP4'dr\P!R.\ V4,\P!4R7p\PPW.RR.VP4R7pEMQ\PPVP4'EdVPPR4^8dVP!R4pM<\P!R.\ V4,\P !4R7pVPPR4^8dVP!R4pM<\P!R.\ V4,\P!4R7p\PPW#.RR.VP4R7pEM\PP#VP4'd\P!VP%4Uu.uF.qDe'\'\(P!V44R,MRNK0 up\P !4R7p\P!R.\ V4,\P!4R7p\PPW#.RR.VP4R7p\WP*4#uupi)aCast an Arrow array to the Video arrow storage type. The Arrow types that can be converted to the Video pyarrow storage type are: - `pa.string()` - it must contain the "path" data - `pa.binary()` - it must contain the video bytes - `pa.struct({"bytes": pa.binary()})` - `pa.struct({"path": pa.string()})` - `pa.struct({"bytes": pa.binary(), "path": pa.string()})` - order doesn't matter - `pa.list(*)` - it must contain the video array data Args: storage (`Union[pa.StringArray, pa.StructArray, pa.ListArray]`): PyArrow array to cast. Returns: `pa.StructArray`: Array in the Video arrow storage type, that is `pa.struct({"bytes": pa.binary(), "path": pa.string()})`. NrSrrmask)rttypes is_stringrSrJlenrmrv from_arraysis_nullis_large_binaryrrn is_binary is_structget_field_indexris_list to_pylistrLr@r8)r9rs bytes_array path_arrayarrs&& r! cast_storageVideo.cast_storages& 88  gll + +((D6CL#8ryy{KKnn00+1G'SYIZahapapar0sG XX % %gll 3 3 G4&3w<"7biikJJnn00'1FRXHY`g`o`o`q0rG XX   - -4&3w<"7biikJJnn00'1FRXHY`g`o`o`q0rG XX   - -||++G49%mmG4  hhvG '<299;O ||++F3q8$]]62 XXtfs7|&;"))+N nn00+1JWV\L]dkdsdsdu0vG XX  gll + +((ahararatuatZ]O#/8QUUatuYY[K4&3w<"7biikJJnn00)GV+<;CVCVCX1G'<<00vs4Q&cZ<V^8dQhRS[PRS[RS[RS[P/#)rrs local_files remote_filesr>)rtrvrY)rr s"r!r"rB#s;C1C1~~C1LPC1gkC1 C1r$c  aSf/o\V3Rl4p\P!VP4Uu.uFlpVedVR,fPV'd\ VR,4'g!V'd(\ VR,4'dV!VR,4M VR,MRNKn up\P !4R7p\P!VPR4P4Uu.uF\pVeTV'd\ V4'gV'd1\ V4'd \PPV4MTMRNK^ up\P!4R7p \PPWy.RR.VP4R7p\WP 4#uupiuupi)aEmbed image files into the Arrow array. Args: storage (`pa.StructArray`): PyArrow array to embed. token_per_repo_id (`dict`, optional): Dictionary repo_id -> token to fetch the files bytes. local_files (`bool`, defaults to `True`) Whether to embed local files data in the array remote_files (`bool`, defaults to `True`) Whether to embed remote files data in the array. E.g. files with paths that start with hf:// or https:// Returns: `pa.StructArray`: Array in the Video arrow storage type, that is `pa.struct({"bytes": pa.binary(), "path": pa.string()})`. Nc<VPR4R,pVP\P4'd\PM\P p\ W4pVeSPVR,4MRp\VR7p\VRVR7;_uu_4pVP4uuRRR4# +'giR#;i)::Nrepo_idtokenrbdownload_config) split startswithr HF_ENDPOINTHUB_DATASETS_URLHUB_DATASETS_HFFS_URLrrOrrread)r source_urlpatternsource_url_fieldsrrfrXs& r! path_to_bytes*Video.embed_storage..path_to_bytes>sD)"-J+5+@+@ASAS+T+T''Z`ZvZv !/z C K\Kh%))*;I*FGnrE,59OtT?CCqvvxDCCCs *C C rrryrz)rrtrJrrrrmrrPrbasenamernrvrrrr8) r9rsrXrrrxrrrs &&f&& r! embed_storageVideo.embed_storage#s0  $ "     hh!**, -A= z)%-& *B*B YfghiogpYqYq"!F),7-   XX$MM&1;;= >D#$ d(;(;R_`dReReGG$$T* >   ..,,k-FRXHY`g`o`o`q,r'<<007  s#F>F>56F>8G G"8Gc<V^8dQh/S[;R&S[S[,;R&S[R ,;R&S[;R&S[S[S[R3,,;R&S[R ,;R&S[S[,;R&S[S[,;R &S[S[,;R &S[;R &#)rrar\r]r^ torch.devicer_r`iddtyper8_typer0NHWCr2 approximate)rYr intr r rrr)rr s"r!r"rBs| }~3-&@^,5ABCD U3./ 08EF-.8GH  7IL C==MNc]SOP ?Qr$r%r7)NTT)r&r'r(r)__doc__rar\r]r^r_r`rrrrtstructrmrnr8rr:rUrhrprrr*r+r,r-s@r!r/r/s:xF"&L/5O38F18Id7B=EYYfbiik'RSGwU?E.O.O`GGR   2121hC1C1Or$r/c(V^8dQhRRR\/#rrgrr>)r)rs"r!r"r"is  . U r$c\4h)zOConvert a torchcodec Video object to bytes using native compression if possibleNotImplementedErrorrgs&r!video_to_bytesris  r$c(V^8dQhRRR\/#r)r)rs"r!r"r"ns  > g r$cT\VR4'd VP#\R4h)rezYEncoding a VideoDecoder that doesn't come from datasets.Video.decode() is not implemented)hasattrrerrs&r!rMrMns+um$$   ! g  r$cDV^8dQhR\PR\/#)rrJr>)r@rAr)rs"r!r"r"ws  2:: ' r$c\4hr7r)rJs&r!rLrLws  r$cV^8dQhR\R\\\\\\3,3,,R\R\ R ,R\ R\\\R3,,R\ R ,R R /#) rrrXstreamr]r^r_rr`r>rrr)rr rNr rYr r)rs"r!r"r"s S%c *:%: ;< ^,    U3./ 0 -.r$c ^RIHpVf/pVPR4R ,pVP\P 4'd\P M\Pp \W4p V eVPV R,4MRp \V R7p \VRV R7p \VPR44^8Xd^M \VPR4^,4pV!V VVVVVR 7pV#) rrNrrrrr:r[r)rGrrrr rrrrrOrrr~r)rrXrr]r^r_r`rrrrrrr stream_idvds&&&&&&& r!rdrds1 D!"%J)3)>)>v?Q?Q)R)Rf%%X^XtXtG&z;CTC`  ! !"3I"> ?fjE$51O dD/:Ac*+q0c&,,s:KA:N6OI  '-  B Ir$)Nrgr0r1r2)*rP dataclassesrrpathlibrtypingrrrr r r r numpyr@pyarrowrtr download.download_configrtablerutils.file_utilsrrrutils.py_utilsrrtorchrGrrorrr/rrMrLrdr%r$r!rs (TTT5BBC0%i  I1I1 I1X    r$