i ddlmZddlZddlmZddlmZddlm Z m Z m Z m Z m Z ddlmZdeddfd Zded ddfd Zdeddfd Zddd e ddfdZy))UnionN)OptimizedModule) DDPStrategyDeepSpeedStrategy FSDPStrategySingleDeviceStrategyStrategy)_check_mixed_importsmodelreturnpl.LightningModulect|ts"tdt|jd|j }t|t js-t|tdt|jdd|j|j|j|j|j|jd|_|j|j|_ |j|j|_ |j|j|_ |j|j|_ |j|j|_|S)aZReturns an instance LightningModule from the output of ``torch.compile``. .. warning:: This is an :ref:`experimental ` feature. The ``torch.compile`` function returns a ``torch._dynamo.OptimizedModule``, which wraps the LightningModule passed in as an argument, but doesn't inherit from it. This means that the output of ``torch.compile`` behaves like a LightningModule, but it doesn't inherit from it (i.e. `isinstance` will fail). Use this method to obtain a LightningModule that still runs with all the optimizations from ``torch.compile``. z8`model` is required to be a `OptimizedModule`. Found a `z ` instead.z?`model` is expected to be a compiled LightningModule. Found a `z ` insteaddynamo)compiler dynamo_ctxoriginal_forwardoriginal_training_steporiginal_validation_steporiginal_test_steporiginal_predict_step) isinstancer ValueErrortype__name__ _orig_modplLightningModuler rforward training_stepvalidation_step test_step predict_step _compiler_ctx)r orig_modules x/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/lightning/pytorch/utilities/compile.py from_compiledr&sD e_ -STXY^T_ThThSiistuu//K k2#5#5 6U#MdS^N_NhNhMiir s  &&'//"-";";$/$?$?)33!,!9!9!K **;+>+>?K % 0 01J1J KK"'"2"2;3N3N"OK!,,[-B-BCK$// 0H0HIK )r ztorch._dynamo.OptimizedModulect|trG|j}t|tjs`t dt |jt|tjr|j td|}n td|j}|9|d|_ |d|_ |d|_ |d|_ |d |_d|_|S) aReturns an instance of LightningModule without any compilation optimizations from a compiled model. .. warning:: This is an :ref:`experimental ` feature. This takes either a ``torch._dynamo.OptimizedModule`` returned by ``torch.compile()`` or a ``LightningModule`` returned by ``from_compiled``. Note: this method will in-place modify the ``LightningModule`` that is passed in. zGUnexpected error, the wrapped model should be a LightningModule, found Nzc`model` is required to be a compiled LightningModule. Found a non-compiled LightningModule instead.zH`model` must either be an instance of OptimizedModule or LightningModulerrrrr)rrrrr TypeErrorrrr#rrrr r!r")r originalctxs r% to_uncompiledr,As%)??(B$6$67YZ^_dZeZnZnYop  E2-- .    &u cdd  C 12!$%=!>#&'A#B  !56 #$; <!% Or'ct|tr t|St|tjr|St |t dt|jd)NzM`model` must be a `LightningModule` or `torch._dynamo.OptimizedModule`, got ``) rrr&rrr r)r __qualname__)r s r%_maybe_unwrap_optimizedr0is\%)U##%++,   WX\]bXcXpXpWqqrs r'strategyc|jktttf}t ||rt |t r=dj d|D}tdt|jd|dyy)Nz, c34K|]}|jyw)N)r).0ss r% z4_verify_strategy_supports_compile..xs0ZEYEYszCUsing a compiled model is incompatible with the current strategy: `z`. Only zj support compilation. Either switch to one of the supported strategies or avoid passing in compiled model.) r#rrrrrjoin RuntimeErrorrr)r r1supported_strategiessupported_strategy_namess r%!_verify_strategy_supports_compiler;ts & 4k<P($89ZRc=d'+yy0ZEY0Z'Z $UVZ[cVdVmVmUno123BB >e'r')typingrtorch torch._dynamorlightning.pytorchpytorchrlightning.pytorch.strategiesrrrrr )lightning.pytorch.utilities.model_helpersr r&r,objectr0r;r'r%rEs| )uuJ&&-A&R%TU%Zn%P6.B -A X Z^ r'