)tiZdZddlmZddlmZddlmZmZeje Z dZ y)z Liger Kernel integration for applying optimized Triton kernels to transformer models. See https://github.com/linkedin/Liger-Kernel for details. )PreTrainedModel)unwrap_peft_model)is_liger_kernel_availableloggingcts tdddlm}|xsi}t |}t |t r |dd|i|ytjdy)al Apply Liger Kernel optimizations to a model instance. Liger Kernel provides optimized Triton kernels for common transformer operations. This function patches the model in-place with those kernels. Args: model: The model to patch. Must be a `PreTrainedModel` or a PEFT wrapper around one. kernel_config: Kernel configuration. zYou have set `use_liger_kernel` to `True` but liger-kernel >= 0.3.0 is not available. Please install it with `pip install liger-kernel`)_apply_liger_kernel_to_instancemodelzRThe model is not an instance of PreTrainedModel. No liger kernels will be applied.N) r ImportErrorliger_kernel.transformersr r isinstancerloggerwarning)r kernel_configr base_models n/Volumes/fast/ai/experiments/MLX_z-image/.venv/lib/python3.12/site-packages/transformers/integrations/liger.pyapply_liger_kernelrs^ % & @  J!'RM"5)J*o.'JjJMJklN) __doc__modeling_utilsr trainer_utilsrutilsrr get_logger__name__rrr rrrs/ --6   H %mr