iCddlZddlmZmZddlZddlmZddlmZddl m Z ddl m Z ddl mZGdd e Zed d Zed Zed ZdefdZdeeeeefdeeeeffdZdeddfdZdedeeeeffdZy)N)AnyUnion)RequirementCache)override) Accelerator)_AcceleratorRegistry)_check_data_typec eZdZdZdededdffd ZedejddfdZ edd Z e ed e e eee fde e ee ffd Ze ed e e ee fdeejfd Ze eej&d de fdZe eej&d defdZe edefdZeededdfdZxZS)XLAAcceleratorzAccelerator for XLA devices, normally TPUs. .. warning:: Use of this accelerator beyond import and instantiation is experimental. argskwargsreturnNctstttts t dt ||i|y)Nz-The XLA XRT runtime is not supported anymore.)_XLA_AVAILABLEModuleNotFoundErrorstr _using_pjrt RuntimeErrorsuper__init__)selfr r __class__s v/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/lightning_fabric/accelerators/xla.pyrzXLAAccelerator.__init__!s9%c.&9: :}NO O $)&)devicecyN)rrs r setup_devicezXLAAccelerator.setup_device( rcyrr)rs rteardownzXLAAccelerator.teardown,r rdevicesct|S)z!Accelerator device parsing logic.)_parse_tpu_devicesr#s r parse_deviceszXLAAccelerator.parse_devices0s"'**rct|}t|tr-t|Dcgc]}t j d|c}St j d|dgScc}w)z*Gets parallel devices for the Accelerator.xlar)r% isinstanceintrangetorchr)r#is rget_parallel_devicesz#XLAAccelerator.get_parallel_devices6sZ%W- gs #49'NCNqELL*NC C UGAJ/00DsA#)maxsizectsytrddlm}|j Sddlm}dddd}|j |jdS)z!Get the devices when set to auto.r)tpu)r5)r_XLA_GREATER_EQUAL_2_1torch_xla._internalr3num_available_devicestorch_xla.experimentalgetversion)r3device_count_on_versions rauto_device_countz XLAAccelerator.auto_device_countCsH ! /,,. ..&'A!"4&**3;;=!<S++ 1eCcN&;1U\\@R11 Y# =s =$ = Y#$$ #  9M RV  rr ztorch_xla>=1.13 torch_xlaztorch_xla>=2.1ztorch_xla>=2.5rctrddlm}|jduStrddlm}|j Sddlm}|j S)Nr)runtime)pjrt)_XLA_GREATER_EQUAL_2_5rXrZ device_typer8 using_pjrtr;r[)xrr[s rrrus<+~~t+++}}+ ?? rr#cht|t|tr t|}t ||S)aParses the TPU devices given in the format as accepted by the :class:`~pytorch_lightning.trainer.trainer.Trainer` and :class:`~lightning_fabric.Fabric`. Args: devices: An int of 1 or string '1' indicates that 1 core with multi-processing should be used An int 8 or string '8' indicates that all 8 cores with multi-processing should be used A single element list of int or string can be used to indicate the specific TPU core to use. Returns: A list of tpu cores to be used. )r r*r_parse_tpu_devices_str_check_tpu_devices_validr&s rr%r%s-W'3(1W% Nrctj}t|tr|d|hvs8t|tt fr#t |dk(rd|dcxkr|dz krynytd|d|dz d|)Nr0rz!`devices` can only be 'auto', 1, z or [<0-z>] for TPUs. Got )r r?r*r+rRtuplelenrA)r# device_counts rrbrbs!335L 7C <( ( ge} - LA   /|a/ / 0  +L>,QRBRASSdeldop rc&|j} t|S#t$rj |jdDcgc]*}t |dkDst|j,ncc}wc}cYS#t$rtd|wxYwwxYw)N,rz*Could not parse the selected TPU devices: )stripr+rAsplitre)r#xs rrarasmmoGW7| W W,3MM#,>M,>q#a&1*C N,>M M WI'UV V WWs1  BA4A*A*)A41B4B  B)rStypingrrr- lightning_utilities.core.importsrtyping_extensionsr)lightning_fabric.accelerators.acceleratorr&lightning_fabric.accelerators.registryr(lightning_fabric.utilities.device_parserr r rr8r\rUrr+rrRr%objectrbrarrrrss =&AGER [R l""3[A)*:;)*:;T"c3S &9 :uS$s)^?T(f"WCWE#tCy.,AWr