iXddlmZddlmZmZddlmZddlmZeGddeZ y) ) dataclass)DictOptional) BaseModelArgs)Modelc>eZdZUeed<eed<eed<eed<eed<eed<eed<eed<eed <eed <eed <eed <eed <eed<eed<eed<eed<eed<eed<eed<dZe e ed<dZ eed<dZ eed<dZ eed<dZeed<dZeed<dZeed <y)! ModelArgs model_type vocab_size hidden_sizeintermediate_sizemoe_intermediate_sizenum_hidden_layersnum_attention_headsnum_key_value_headshead_dimn_shared_expertsn_routed_expertsrouted_scaling_factornum_experts_per_tokfirst_k_dense_replacenorm_topk_probmax_position_embeddings rms_norm_eps rope_thetatie_word_embeddingspartial_rotary_factorN rope_scalingFattention_bias use_qk_normrn_group topk_groupsigmoid scoring_funcnoaux_tc topk_method)__name__ __module__ __qualname__str__annotations__intfloatboolrrrr r!r"r#r%r'm/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/mlx_lm/models/solar_open.pyr r sOOM      #'L(4.' ND KGSJ!L#!!K!r1r N) dataclassesrtypingrrbaserglm4_moerr r0r1r2r7s."! " " "r1