+ QV-jG^aR)t20t^RIt^RIt^RIt^RIHtHt^RIHt^RI H t ^RI H t H t HtHtHt^RIt^RIt^RIHt^RIHt^RIHt^R IHtHtHt^R IH t H!t!H"t"] 'd ^RI#t$^R I%H&t&Rs']^k]PPR 8XdR MRt)]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4]PT!R4.t+]!RR44t,RR lt-R!R"lt.R#R$lt/R%R&lt0R'R(lt1R#)*N) dataclassfield)BytesIO)Path) TYPE_CHECKINGAnyClassVarOptionalUnion)config)DownloadConfig) array_cast) is_local_path is_remote_urlxopen)first_non_null_valueno_op_if_value_is_nullstring_to_dict) FeatureTypelittle<>z|b1|u1zu2zi2zu4zi4zf4zf8c6a]tRt^.toRtRtRt]!RRR7tRt ] P!R] P!4R] P!4/4t]!RRRR 7tR tV3R lR ltRV3R lRlltV3RlRltV3RlRltRV3RlRlltV3RltRtVtR#)ImageaImage [`Feature`] to read image data from an image file. Input: The Image feature accepts as input: - A `str`: Absolute path to the image file (i.e. random access is allowed). - A `pathlib.Path`: path to the image file (i.e. random access is allowed). - A `dict` with the keys: - `path`: String with relative path of the image file to the archive file. - `bytes`: Bytes of the image file. This is useful for parquet or webdataset files which embed image files. - An `np.ndarray`: NumPy array representing an image. - A `PIL.Image.Image`: PIL image object. Output: The Image features output data as `PIL.Image.Image` objects. Args: mode (`str`, *optional*): The mode to convert the image to. If `None`, the native mode of the image is used. decode (`bool`, defaults to `True`): Whether to decode the image data. If `False`, returns the underlying dictionary in the format `{"path": image_path, "bytes": image_bytes}`. Examples: ```py >>> from datasets import load_dataset, Image >>> ds = load_dataset("AI-Lab-Makerere/beans", split="train") >>> ds.features["image"] Image(decode=True, id=None) >>> ds[0]["image"] >>> ds = ds.cast_column('image', Image(decode=False)) {'bytes': None, 'path': '/root/.cache/huggingface/datasets/downloads/extracted/b0a21163f78769a2cf11f58dfc767fb458fc7cea5c05dccc0144a2c0f0bc1292/train/healthy/healthy_train.85.jpg'} ``` NTF)defaultreprPIL.Image.Imagebytespath)rinitrcVP#N)pa_type)selfs&h/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/datasets/features/image.py__call__Image.__call___s ||c^<V^8dQhRS[S[S[S[S[S[P R3,RS[/#)valuerreturn)r strr bytearraydictnpndarray)format __classdict__s"r& __annotate__Image.__annotate__bs3''E#uirzzSd*d$e'jn'r)c \P'd^RIpM \R4h\ V\ 4'd\ P!V4p\ V\4'dRVRR/#\ V\4'dR\VP44RR/#\ V\\34'dRRRV/#\ V\ P4'd \V4#\ WPP4'd \!V4#VP#R4eB\$P&P)VR,4'dRRRVP#R4/#VP#R4fVP#R4e%RVP#R4RVP#R4/#\+RV R24h)zEncode example into a format for Arrow. Args: value (`str`, `np.ndarray`, `PIL.Image.Image` or `dict`): Data passed as input to Image feature. Returns: `dict` with "path" and "bytes" fields N4To support encoding images, please install 'Pillow'.r rzUAn image sample should have one of 'path' or 'bytes' but they are missing or None in .)r PIL_AVAILABLE PIL.Image ImportError isinstancelistr1arrayr.rabsoluterr/r2encode_np_arrayrencode_pil_imagegetosr isfile ValueError)r%r,PILs&& r&encode_exampleImage.encode_examplebso     TU U eT " "HHUOE eS ! !E7D1 1 t $ $C 017DA A y1 2 2D'51 1 rzz * *"5) ) yy / /#E* * YYv  *rww~~eFm/L/LT6599V+<= = YYw  +uyy/@/LUYYw/69JK Kghmgnnop r)c$<V^8dQhRS[RR/#)r+r,r-rr0)r3r4s"r&r5r6s;;D;EV;r)c VP'g \R4h\P'd ^RIp^RIpM \ R4hVf/pVR,VR,rTVEf(Vf\RV R24h\V4'dVPPV4pEM VPR4R ,pVP\P4'd\PM\Pp\!Wx4p V eVP#V R ,4MRp \%V R 7p \'VR V R 7;_uu_4p \)V P+44pRRR4VPPV4pM$VPP\)V44pVP-4VP/4P#VPP0P2P44eVP6P9V4pVP:'d7VP:VP:8wdVP=VP:4pV# +'giEL;i)a Decode example image file into image data. Args: value (`str` or `dict`): A string with the absolute image file path, a dictionary with keys: - `path`: String with absolute or relative image file path. - `bytes`: The bytes of the image file. token_per_repo_id (`dict`, *optional*): To access and decode image files from private repositories on the Hub, you can pass a dictionary repo_id (`str`) -> token (`bool` or `str`). Returns: `PIL.Image.Image` zMDecoding is disabled for this feature. Please use Image(decode=True) instead.Nz4To support decoding images, please install 'Pillow'.r rzCAn image should have one of 'path' or 'bytes' but both are None in r9::repo_idtokenrbdownload_config)decode RuntimeErrorr r:r; PIL.ImageOpsr<rFrropensplit startswith HF_ENDPOINTHUB_DATASETS_URLHUB_DATASETS_HFFS_URLrrCr rrreadloadgetexifExifTagsBase OrientationImageOpsexif_transposemodeconvert) r%r,token_per_repo_idrGr bytes_image source_urlpatternsource_url_fieldsrPrSfs &&& r&decode_exampleImage.decode_examples${{{no o      TU U  $ " V}eGnf >| #fglfmmn!opp &&IINN40E!%D!1"!5J&001C1CDD//#99 )7z(K%O`Ol)--.? .JKrv'55&AOtT?KKq!(!2LIINN62EIINN76?3E ==?  syy1166BB C OLL//6E 999ejj0MM$)),E LKKs I-- I> cH<V^8dQhRS[RS[S[R3,3,/#)r+r-r)r r0r.)r3r4s"r&r5r6s(   }d3 3E.FFG  r)c Z^RIHpVP'dV#RV!R4RV!R4/#)zfIf in the decodable state, return the feature itself, otherwise flatten the feature into a dictionary.)Valuerbinaryr string)featuresrsrU)r%rss& r&flatten Image.flattens8#{{{  xh r)c<V^8dQhRS[S[PS[PS[P3,RS[P/#)r+storager-)r pa StringArray StructArray ListArray)r3r4s"r&r5r6s:<1<1E".."..",,*V$W<1\^\j\j<1r)c  \PPVP4'd&VP \P !44p\PPVP4'dr\P!R.\V4,\P!4R7p\PPW1.RR.VP4R7pEM\PPVP4'd\!V\P!44p\P!R.\V4,\P !4R7p\PPW.RR.VP4R7pEM\PP#VP4'dr\P!R.\V4,\P !4R7p\PPW.RR.VP4R7pEMQ\PP%VP4'EdVPP'R4^8dVP)R4pM<\P!R.\V4,\P!4R7pVPP'R4^8dVP)R4pM<\P!R.\V4,\P !4R7p\PPW4.RR.VP4R7pEM\PP+VP4'd\P!VP-4Uu.uF.qUe'\/\0P!V44R,MRNK0 up\P!4R7p\P!R.\V4,\P !4R7p\PPW4.RR.VP4R7p\!WP24# \P dp\RT 24ThRp?ii;iuupi)aCast an Arrow array to the Image arrow storage type. The Arrow types that can be converted to the Image pyarrow storage type are: - `pa.string()` - it must contain the "path" data - `pa.large_string()` - it must contain the "path" data (will be cast to string if possible) - `pa.binary()` - it must contain the image bytes - `pa.struct({"bytes": pa.binary()})` - `pa.struct({"path": pa.string()})` - `pa.struct({"bytes": pa.binary(), "path": pa.string()})` - order doesn't matter - `pa.list(*)` - it must contain the image array data Args: storage (`Union[pa.StringArray, pa.StructArray, pa.ListArray]`): PyArrow array to cast. Returns: `pa.StructArray`: Array in the Image arrow storage type, that is `pa.struct({"bytes": pa.binary(), "path": pa.string()})`. zvFailed to cast large_string to string for Image feature. This can happen if string values exceed 2GB. Original error: Ntyperr mask)r{typesis_large_stringrcastru ArrowInvalidrF is_stringr?lenrtr} from_arraysis_nullis_large_binaryr is_binary is_structget_field_indexris_list to_pylistrAr1r$)r%rze bytes_array path_arrayarrs&& r& cast_storageImage.cast_storagesd( 88 # #GLL 1 1 !,,ryy{3 88  gll + +((D6CL#8ryy{KKnn00+1G'SYIZahapapar0sG XX % %gll 3 3 G4&3w<"7biikJJnn00'1FRXHY`g`o`o`q0rG XX   - -4&3w<"7biikJJnn00'1FRXHY`g`o`o`q0rG XX   - -||++G49%mmG4  hhvG '<299;O ||++F3q8$]]62 XXtfs7|&;"))+N nn00+1JWV\L]dkdsdsdu0vG XX  gll + +((ahararatuatZ]O#/8QUUatuYY[K4&3w<"7biikJJnn00)GV+<;CVCVCX1G'<<00K??  ''(c+  <vs$R:&4S&:S#SS#cZ<V^8dQhRS[PRS[RS[RS[P/#)r+rz local_files remote_filesr-)r{r}bool)r3r4s"r&r5r6s;C1C1~~C1LPC1gkC1 C1r)c  aSf/o\V3Rl4p\P!VP4Uu.uFlpVedVR,fPV'd\ VR,4'g!V'd(\ VR,4'dV!VR,4M VR,MRNKn up\P !4R7p\P!VPR4P4Uu.uF\pVeTV'd\ V4'gV'd1\ V4'd \PPV4MTMRNK^ up\P!4R7p \PPWy.RR.VP4R7p\WP 4#uupiuupi)aEmbed image files into the Arrow array. Args: storage (`pa.StructArray`): PyArrow array to embed. token_per_repo_id (`dict`, optional): Dictionary repo_id -> token to fetch the files bytes. local_files (`bool`, defaults to `True`) Whether to embed local files data in the array remote_files (`bool`, defaults to `True`) Whether to embed remote files data in the array. E.g. files with paths that start with hf:// or https:// Returns: `pa.StructArray`: Array in the Image arrow storage type, that is `pa.struct({"bytes": pa.binary(), "path": pa.string()})`. Nc<VPR4R,pVP\P4'd\PM\P p\ W4pVeSPVR,4MRp\VR7p\VRVR7;_uu_4pVP4uuRRR4# +'giR#;i)rMNrNrOrQrRrT) rYrZr r[r\r]rrCr rr^)r rkrlrmrPrSrnrhs& r& path_to_bytes*Image.embed_storage..path_to_bytes.sD)"-J+5+@+@ASAS+T+T''Z`ZvZv !/z C K\Kh%))*;I*FGnrE,59OtT?CCqvvxDCCCs *C C rr rr)rr{r?rrrrtrrDr basenamerur}rrrr$) r%rzrhrrrxrr rs &&f&& r& embed_storageImage.embed_storages0  $ "     hh!**, -A= z)%-& *B*B YfghiogpYqYq"!F),7-   XX$MM&1;;= >D#$ d(;(;R_`dReReGG$$T* >   ..,,k-FRXHY`g`o`o`q,r'<<007  s#F>F>56F>8G G"8Gc<V^8dQh/S[S[,;R&S[;R&S[S[,;R&S[S[,;R&S[S[,;R&S[;R&#)r+rfrUiddtyper$_type)r r.rr r)r3r4s"r&r5r6.soR 3-ST UV  7WZ C=,[\c]S]^ ?_r)r#)NTT)__name__ __module__ __qualname____firstlineno____doc__rfrUrrrr{structrtrur$rr'rHrorwrr__annotate_func____static_attributes____classdictcell__)r4s@r&rr.s%NDFd7B,EYYfbiik'RSGwU?E''R;;z   <1<1|C1C1Kr)rc:V^8dQhR\\,/#)r+r-)r>r.)r3s"r&r5r5Ys & &S &r)cn\P'd^RIpM \R4h\fVP P 4\\VP PP44\VP PP44,4s\#)rNr8) r r:r;r<_IMAGE_COMPRESSION_FORMATSrr!r>setOPENkeysSAVE)rGs r&list_image_compression_formatsrYsu PQQ") %)#ciinn.A.A.C*Ds399>>K^K^K`Ga*a%b" %%r)c(V^8dQhRRR\/#r+rjrr-)r)r3s"r&r5r5fs+r)c\4pVP\49dVPpMVPR9dRMRpVP WR7VP 4#)zmConvert a PIL Image object to bytes using native compression if possible, otherwise use PNG/TIFF compression.PNGTIFF)r3)1LLARGBRGBA)rr3rrfsavegetvalue)rjbufferr3s& r&image_to_bytesrfsP YF ||577**(GGV JJvJ% ?? r)c(V^8dQhRRR\/#rrK)r3s"r&r5r5qs>>->$>r)c\VR4'd"VPR8wdRVPRR/#RRR\V4/#)filenamer rN)hasattrrr)rjs&r&rBrBqsAuj!!enn&:66g~e'<==r)cDV^8dQhR\PR\/#)r+r?r-)r1r2r0)r3s"r&r5r5xs(:(:2::(:$(:r)cr\P'd^RIpM \R4hVPpVP R8wd VP M\ pVPpVPpRpVPR,'dTVR9d\RV RV R24h\P!R4pW&8wd\P!R V R V R 24MV\9dTpMV^8dwW4,\V4,p\P!V4\9d5\P!V4p\P!R V R V R 24M V^,pK}Vf\R V R \ 24hVP P#VP%V44pRRR\'V4/#)rNr8=:r+NNzUnsupported array dtype z for image encoding. Only z' is supported for multi-channel arrays.rzDowncasting array dtype z to z to be compatible with 'Pillow'zCannot downcast dtype z- to a valid image dtype. Valid image dtypes: r r)ui)r r:r;r<r byteorder_NATIVE_BYTEORDERkinditemsizeshape TypeErrorr1warningswarn_VALID_IMAGE_ARRAY_DTPYESr.r fromarrayastyper) r?rGrdtype_byteorder dtype_kinddtype_itemsize dest_dtype dtype_strrjs & r&rArAxs PQQ KKE).C)?eooEVOJ^^NJ {{2 Z '*5'1KJ7JJIxx "&??XXi0  8tJ%#8 99r)cV^8dQhR\\\,\\,\\P ,\R,3,R\\,/#)r+objsrr-)r r>r.r0r1r2)r3s"r&r5r5sE S 4:tBJJ'7>O9PP Q $Zr)c"\P'd^RIpM \R4hV'd\ V4wr#\ V\ 4'dVUu.uFq3eRVRR/MRNK up#\ V\P4'd'\\4pVUu.uF q4!V4NK up#\ W1PP4'd'\\4pVUu.uF q4!V4NK up#V#V#uupiuupiuupi)zmEncode a list of objects into a format suitable for creating an extension array of type `ImageExtensionType`.Nr8r r) r r:r;r<rr=r.r1r2rrArrB)rrG_objobj_to_image_dict_funcs& r&objects_to_list_of_image_dictsrsPQQ %d+ c3  Y]^Y]RUOVS'40MY]^ ^ c2:: & &%;O%L ";?@4C*3/4@ @ YY__ - -%;r.)r3s"r&r5r5s! 076HT#Y/61 r))3rrDsysr dataclassesrriorpathlibrtypingrrr r r numpyr1pyarrowr{rr download.download_configr tablerutils.file_utilsrrrutils.py_utilsrrrr;rGrvrrrrrrrrrrBrArr5)rs@r&rs? (@@5BBYY%376==H4C#HHUOHHUOHHUOHHUOHHUOHHUOHHUOHHUOHHUOHHUOHHUOHHUOHHUOHHUO$ g1g1 g1T &>(:Vr)