i ddlmZddlmZmZddlZddlmZddlm Z de e dee fdZ ddeee e e e fd ed edee e fd Zd ee e e e fdee e e ffd Zdde e d ed ede e fdZdee e e ee dffd ed edee e fdZdd ed ede e fdZde e ddfdZdeddfdZde fdZy))MutableSequence)OptionalUnionN)MisconfigurationException)_DEVICEgpusreturncr|yt|ts tdt|dkDsJd|dS)a Args: gpus: Non-empty list of ints representing which GPUs to use Returns: Designated root GPU device id Raises: TypeError: If ``gpus`` is not a list AssertionError: If GPU list is empty NzGPUs should be a listrzGPUs should be a non-empty list) isinstancelist TypeErrorlen)rs }/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/lightning_fabric/utilities/device_parser.py_determine_root_gpu_devicersC | dD !/00 t9q=;;;= 7N include_cuda include_mpsct||0t|tr|dk(st|j dvryt |}t |||}|s tdtjjrGtjjr)t|dk7rtt||dk(r|St|t|||S)aHParses the GPU IDs given in the format as accepted by the :class:`~pytorch_lightning.trainer.trainer.Trainer`. Args: gpus: An int -1 or string '-1' indicate that all available GPUs should be used. A list of unique ints or a string containing a list of comma separated unique integers indicates specific GPUs to use. An int of 0 means that no GPUs should be used. Any int N > 0 indicates that GPUs [0..N) should be used. include_cuda: A boolean value indicating whether to include CUDA devices for GPU parsing. include_mps: A boolean value indicating whether to include MPS devices for GPU parsing. Returns: A list of GPUs to be used or ``None`` if no GPUs were requested Raises: MisconfigurationException: If no GPUs are available but the value of gpus variable indicates request for GPUs .. note:: ``include_cuda`` and ``include_mps`` default to ``False`` so that you only have to specify which device type to use and all other devices are not disabled. Nr)0z[]rrz&GPUs requested but none are available.)_check_data_typer intstrstrip!_normalize_parse_gpu_string_input"_normalize_parse_gpu_input_to_listrtorch distributed is_availableis_torchelastic_launchedr_get_all_available_gpus _check_unique_sanitize_gpu_idsrrrs r_parse_gpu_idsr&1s:T | 4-$!)D @QU`@` -T 2D -d[f gD '(PQQ &&(    6 6 8 IN '\{[ \`a a $ T + VVrsct|ts|S|dk(ryd|vrE|jdDcgc]*}t|dkDst |j ,c}St |j Scc}w)Nz-1,r)r rsplitrrr)r'xs rrrjsi a Dy ax() C 1A AGGI CC qwwy>Ds A;A;ct||fdk(r tdt||}|D]}||vstd|d||S)asChecks that each of the GPUs in the list is actually available. Raises a MisconfigurationException if any of the GPUs is not available. Args: gpus: List of ints corresponding to GPU indices Returns: Unmodified gpus variable Raises: MisconfigurationException: If machine has fewer available GPUs than requested. rz*At least one gpu type should be specified!rzYou requested gpu: z But your machine only has: )sum ValueErrorr"r)rrrall_available_gpusgpus rr$r$tsj L+ &'1,EFF0lXcd ( (+%dV+IJ\I]^  Kr.c|Jt|ttfr t|S|sy|dk(r t ||Stt |S)Nr)r)r rtupler r"ranger%s rrrsT   $%01Dz  rz&LkZZ d rcPddlm}ddlm}|r|ng}|r|ng}||zS)z7 Returns: A list of all available GPUs r)_get_all_visible_cuda_devices)_get_all_available_mps_gpus)"lightning_fabric.accelerators.cudar6!lightning_fabric.accelerators.mpsr7)rrr6r7 cuda_gpusmps_gpuss rr"r"s0 QM3?-/RI0;*,H x r device_idscZt|tt|k7r tdy)zChecks that the device_ids are unique. Args: device_ids: List of ints corresponding to GPUs indices Raises: MisconfigurationException: If ``device_ids`` of GPUs aren't unique z!Device ID's (GPU) must be unique.N)rsetr)r<s rr#r#s* :#c*o..'(KLL/rc"d}|t|dt|ttfr?|D]9}t |}|t ust|dt |j dyt |t tfvrt|d|dy)a3Checks that the device_ids argument is one of the following: int, string, or sequence of integers. Args: device_ids: gpus/tpu_cores parameter as passed to the Trainer Raises: TypeError: If ``device_ids`` of GPU/TPUs aren't ``int``, ``str`` or sequence of ``int``` zQDevice IDs (GPU/TPU) must be an int, a string, a sequence of ints, but you passedNz Nonez a sequence of . )r r rr3typer__name__r)r<msgid_id_types rrrs ^C3%u &&*67C3iGc!3%tCy7I7I6J! LMM j #s +3%qa011 ,rcddlm}ddlm}ddlm}|j ry|j ry|j ryy) z8Choose the accelerator type (str) based on availability.r)CUDAAccelerator)MPSAccelerator)XLAAcceleratortpumpscudacpu)r8rHr9rI!lightning_fabric.accelerators.xlarJr )rHrIrJs r_select_auto_acceleratorrPs;B@@""$""$##% r)FF)collections.abcrtypingrrr%lightning_fabric.utilities.exceptionsr lightning_fabric.utilities.typesrr rrrboolr&rr$r3rr"r#objectrrPrrrXs," K4T']x7H86W 5c49,- .6W6W6Wd3i 6WrsCc/B)CcSWX[S\nH]DITPTaefiaj4  T#Yc3h/ 0 @D SW  d3i   $  T  VZ[^V_   Md3i MD M22D2. # r