iddlZddlZddlmZddlmZddlmZmZm Z ddl m Z eje ZGdde Zy)N)Any)override)_XLA_AVAILABLE_XLA_GREATER_EQUAL_2_1XLAAccelerator)ClusterEnvironmentceZdZdZdededdffd ZeedefdZ eede fdZ eede fd Z eedefd Zeej"d de fd Zede ddfdZeej"d de fdZede ddfdZeej"d de fdZeej"d de fdZxZS)XLAEnvironmentaCluster environment for training on a TPU Pod with the `PyTorch/XLA `_ library. A list of environment variables set by XLA can be found `here `_. argskwargsreturnNc`tstttt||i|yN)rModuleNotFoundErrorstrsuper__init__)selfr r __class__s ~/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/lightning_fabric/plugins/environments/xla.pyrzXLAEnvironment.__init__"s(%c.&9: : $)&)cy)NFrs rcreates_processes_externallyz+XLAEnvironment.creates_processes_externally'srctrNotImplementedErrorrs r main_addresszXLAEnvironment.main_address, "!rctrrrs r main_portzXLAEnvironment.main_port2r rc*tjSr)r is_availablerrrdetectzXLAEnvironment.detect8s**,,r)maxsizecltrddlm}|jSddlmcm}|jS)znThe number of processes across all devices and hosts. The output is cached for performance. rruntimeN)r torch_xlar* world_sizetorch_xla.core.xla_modelcore xla_modelxrt_world_sizerxrxms rr,zXLAEnvironment.world_size=s+ " /==? "--  ""rsizec.tjdy)NzYXLAEnvironment.set_world_size was called, but setting world size is not allowed. Ignored.logdebug)rr4s rset_world_sizezXLAEnvironment.set_world_sizeNs mnrcltrddlm}|jSddlmcm}|jS)zThe rank (index) of the currently running process across all host and devices. The output is cached for performance. rr)N)rr+r*global_ordinalr-r.r/ get_ordinalr1s r global_rankzXLAEnvironment.global_rankRs, " /$$& &--~~rrankc.tjdy)Nz[XLAEnvironment.set_global_rank was called, but setting global rank is not allowed. Ignored.r6)rr>s rset_global_rankzXLAEnvironment.set_global_rankcs oprcltrddlm}|jSddlmcm}|jS)zThe rank (index) of the currently running process inside of the current host. The output is cached for performance. rr)N)rr+r* local_ordinalr-r.r/get_local_ordinalr1s r local_rankzXLAEnvironment.local_rankgs. " /##% %--##%%rctrddlm}|jSddlmcm}ddlm}||jtdS)zxThe rank (index) of the host on which the current process runs. The output is cached for performance. rr)N) getenv_as) rr+r* host_indextorch_xla.core.xla_env_varsr. xla_env_varstorch_xla.utils.utilsrF HOST_ORDINALint)rr2xenvrFs r node_rankzXLAEnvironment.node_rankxs4 " /==? "223**C33r)__name__ __module__ __qualname____doc__rrpropertyrboolrrrrLr" staticmethodr% functools lru_cacher,r9r=r@rDrN __classcell__)rs@rr r s*c*S*T*  d "c"" "3"" -D--Y# #C #$ #o3o4ooY#  S  $  qCqDqqY# &C &$ &Y# 43 4$ 4rr )rVloggingtypingrtyping_extensionsr!lightning_fabric.accelerators.xlarrr9lightning_fabric.plugins.environments.cluster_environmentr getLoggerrOr7r rrrr_s=&ddXg!m4'm4r