iD5ddlZddlZddlZddlmZmZmZddlmZ ddl m Z ddl Z ddlmZddlmZddlmZddlmZddlmZ d4d e j2d ed ed ed edeeeff dZ d5d e j2d ed edede j2f dZdedefdZdede d ededdf dZ! d6dedeeee jDfdededeedeededed eed!eed"eed#eed$eed%eeee jDfd&eed'eded(e#d)e#d*e#d+ed,e#d-ed.e#d/e#ddf4d0Z$d1Z%d2Z&e'd3k(re&yy)7N)OptionalTupleUnion)sliding_window_view)write) load_audio) AudioPlayer) load_modelwav sample_ratewindow_durationenergy_threshold margin_factorreturnc t||z}||z}|dz}t||dd|}tjtj|dzd} | |k\} tj | s t dtdtj| |z|z } tt|t| dz tj| dddz |z|z} | | fS) a,Detect the start and end points of speech in an audio signal using RMS energy. Args: wav: Input audio signal array with values in [-1, 1] sample_rate: Audio sample rate in Hz window_duration: Duration of detection window in seconds energy_threshold: RMS energy threshold for speech detection margin_factor: Factor to determine extra margin around detected boundaries Returns: tuple: (start_index, end_index) of speech segment Raises: ValueError: If the audio contains only silence Nr axisz*No speech detected in audio (only silence)r) intrnpsqrtmeanany ValueErrormaxargmaxminlen) r r rrr window_sizemargin step_sizewindowsenergy speech_maskstartends k/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/mlx_audio/tts/generate.pydetect_speech_boundariesr+s,o 34K [ (Fr!I"#{3KiK@GWWRWWWaZa0 1F,,K 66+ EFF 299[)I5> ?E  C [ A  +dd*; < < IFR C #:volume_thresholdc.t||||\}}|||S)aRemove silence from both ends of an audio signal. Args: wav: Input audio signal array sample_rate: Audio sample rate in Hz window_duration: Duration of detection window in seconds volume_threshold: Amplitude threshold for silence detection Returns: np.ndarray: Audio signal with silence removed from both ends Raises: ValueError: If the audio contains only silence )r+)r r rr-r(r)s r*remove_silence_on_both_endsr/?s*(* [/+;JE3 uS>r,pitchcBdtjd|dz zz}|S)z Converts a frequency from the Hertz scale to the Mel scale. Parameters: - pitch: float or ndarray Frequency in Hertz. Returns: - mel: float or ndarray Frequency in Mel scale. i# r i)rlog10)r0mels r* hertz_to_melr4Ys$ !eck/* *C Jr, file_name audio_chunks audio_formatc||syt|dkDrtj|dn|d}t||||y)Nr rrformat)r!mx concatenate audio_write)r5r6r r7audios r*write_joined_audior?isE  | q  |!, !_  5+lCr,textmodel max_tokensvoicepromptinstructspeed lang_code cfg_scale ddpm_stepssigma ref_audioref_text stt_model output_path file_prefix join_audioplayverbose temperaturestreamstreaming_intervalsaveuse_zero_spk_embc |xs|}| td| | r | tdt|tr t|}| rtj j | std| d}t|dr|jdk(rd }t| |j| } | sd dl }d |j|jjvrgt!d d dlm}t| tr|| } | j| j&} ~ t)j*t!d| |rt-|jnd}|r7t j.|d tj j1||}|t!d|t!d|d|d|d|t3d:||||| | || |||||||d|}|||d<| | |d<|jd:i|}|xr|} g}!g}"i}#i}$|d|}%t5|D]\}&}'|r|j7|'j8| ra|r|"j;|'j8n|'j<}(|(|#vrg|#|(<|'j|$|(<|#|(j;|'j8nq|r|s|!j;|'j8nQ|sO|d|&dd|}%t?|%tAjB|'j8|'j|t!d|%|st!dt!d |'jDt!d!|'jFd"d#t!d$|'jHd%|'jJd&d#d't!d(|'jFd)d*|'jFd"d#d+t!d,|'jLd-d.t!d/|'jNd-d0t!d1|'jPd-d2| rE|rC|"rA|rt!d3tS|"d4tU|%|"|j|t!d|%n| r`|#r^tW|#D]O}(|d|(dd|}%|#|(})|$|(}*|rt!d3tS|)d5|(tU|%|)|*|t!d|%QnH|rF|sD|!rB|rt!d3tS|!d6tU|%|!|j||rt!d|%|r!|jY|j[yy#t\$r#}+t!d7|+t!d8Yd}+~+yd}+~+wt^$r,}+t!d9|+d dl0},|,jcYd}+~+yd}+~+wwxYw);a Generates audio from text using a specified TTS model. Parameters: - text (str): The input text to be converted to speech. - model (str): The TTS model to use. - voice (str): The voice style to use (also used as speaker for Qwen3-TTS models). - instruct (str): Instruction for emotion/style (CustomVoice) or voice description (VoiceDesign). - temperature (float): The temperature for the model. - speed (float): Playback speed multiplier. - lang_code (str): The language code. - ref_audio (mx.array): Reference audio you would like to clone the voice from. - ref_text (str): Caption for reference audio. - stt_model_path (str): A mlx whisper model to use to transcribe. - output_path (str): Directory path where audio files will be saved. - file_prefix (str): The output file path without extension. - audio_format (str): Output audio format (e.g., "wav", "flac"). - join_audio (bool): Whether to join multiple audio files into one. - play (bool): Whether to play the generated audio. - verbose (bool): Whether to print status messages. - save (bool): Whether to save streamed audio to a file when using stream mode. - model (object): A already loaded model. - stt_model (object): A already loaded stt model. Returns: - None: The function writes the generated audio to a file when not streaming, or when streaming with saving enabled. Nz.Model path or model instance must be provided.zKSTT model path or model instance must be provided when ref_text is missing.) model_pathz Reference audio file not found: F model_typesparkT)r volume_normalizerrLz-Ref_text not found. Transcribing ref_audio...)loadzRef_text: )r )exist_okzInstruct: zText: z Voice: z Speed: zx Language: )r@rCrFrGrKrLrHrIrSrBrRrTrUrErWrDrJ._03dr9u0✅ Audio successfully generated and saving as: z ==========zDuration: zSamples/sec: zsamples-per-secz.1fzPrompt: z tokens, ztokens-per-secz tokens-per-seczAudio: samplesz samples, z samples-per-seczReal-time factor: z.2fxzProcessing time: szPeak memory usage: GBzJoining z streamed audio chunksz# streamed audio chunks for segment z audio fileszImport error: zIThis might be due to incorrect Python path. Check your project structure.zError loading model: )2r isinstancestrr ospathexistsFileNotFoundErrorhasattrrZrr inspect signaturegenerate parametersprint mlx_audio.sttr]r@r; clear_cacher makedirsjoindict enumerate queue_audior>append segment_idxr=rarrayaudio_duration audio_samples token_countrDreal_time_factorprocessing_time_secondspeak_memory_usager!r?sortedwait_for_drainstop ImportError Exception traceback print_exc)-r@rArBrCrDrErFrGrHrIrJrKrLrMrNrOr7rPrQrRrSrTrUrVrWkwargs normalizernload_stt_modelplayer gen_kwargsresultssave_streamed_audio audio_liststreamed_audio_chunksstreamed_segment_audiostreamed_segment_sample_ratesr5iresultr{r6r ers- r*generate_audiorzspz~v =MN N  )0@]  eS !%0E 77>>),'*J9+(VWWIul+0@0@G0K "u'8'89I!2!25>>!B!M!MMIJD!)S1$29$= (11)<AAH!NN$5hZ@A@D):):;  KK d 3'',,{K@K   -hZ8 9 #D6*%%*G,%%*G,((1{ 4  !#!1- ! $  #)Jx  "'Jw  %...:.$o "!#(*%"m1\N3 "7+IAv""6<<0")00>"("4"4K"*@@>@.{;EKEWEW5kB*;7>>v||LF!!&,,/*m1QsG1\NC HHV\\*&&'  H TUl#/0E0E/FGH-f.B.BCT.UVY-Z[-f.@.@-A6==YiKjknJoo~-f.B.B9.M-NjY_YmYmnZABEYFFVW/0G0G/LANO/0N0Ns/SSTUV/0H0H/MRPQQ,T :2G%:!; <":Z 1>? !!   H TU   ! ! # KKM    qc"# W    %aS)* s+L T G:T U'T// U';"U""U'ctjd}|jdtdd|jdtdd |jd tdd |jd tdd |jdtdd |jdtdd |jdt dd |jdt dd |jdtdd |jdt dd |jdtdd |jd!t dd" |jd#td$d% |jd&tdd' |jd(td)d* |jd+d,d-.|jd/d,d0.|jd1d,d2.|jd3td4d5 |jd6tdd7 |jd8tdd9 |jd:td;d< |jd=t d>d? |jd@t ddA |jdBd,dC.|jdDt dEdF |jdGtdHdI |jdJt dKdL |jdMd,dN.|jdOt dPdQ |jdRd,dS.|j }|jr|js|jdT|jztjjs3tjjj|_ |St!dUt#dVj|_ |S)WNz#Generate audio from text using TTS.) descriptionz--modelTzPath or repo id of the model)typerequiredhelpz --max_tokensz$Maximum number of tokens to generate)rdefaultrz--textz1Text to generate (leave blank to input via stdin)z--voicez?Voice/speaker name (e.g., Chelsie, Ethan, Vivian for Qwen3-TTS)z--promptz&Optional model-specific prompt prefix.z --instructzNInstruction for CustomVoice (emotion/style) or VoiceDesign (voice description)z--exaggerationg?z!Exaggeration factor for the voicez --cfg_scaleg?uHClassifier-free guidance scale. Lower (≈1.0-1.5) is often more stable.z --ddpm_stepszFOverride diffusion steps. Higher = better quality, slower (try 30-50).z--speed?zSpeed of the audioz--gendermalez"Gender of the voice [male, female]z--pitchzPitch of the voicez --lang_codeenz Language codez --output_pathzDirectory path for output filesz --file_prefixr>zOutput file name prefixz --verbose store_truezPrint verbose output)actionrz --join_audiozJoin all audio files into onez--playzPlay the output audioz--audio_formatr zOutput audio formatz --ref_audiozPath to reference audioz --ref_textzCaption for reference audioz --stt_model-mlx-community/whisper-large-v3-turbo-asr-fp16z.STT model to use to transcribe reference audioz --temperatureffffff?zTemperature for the modelz--sigmaz6Optional model-specific sigma value (e.g., Ming Omni).z--use_zero_spk_embzFOptional model-specific zero speaker embedding mode (e.g., Ming Omni).z--top_pg?zTop-p for the modelz--top_k2zTop-k for the modelz--repetition_penaltyg?z Repetition penalty for the modelz--streamz.Stream the audio as segments during generationz--streaming_interval@z3The time interval in seconds for streaming segmentsz--savez1Save streamed audio to a file. Requires --stream.z--save requires --streamz"Please enter the text to generate:z> )argparseArgumentParser add_argumentrhrfloat parse_argsrVrTerrorr@sysstdinisattyreadstriprrinput)parserargss r*rros;  $ $1V WF   +     3     @     N     5     ]     0     W     U   sAUV f3W  sAUV  COT c46W c79R  L?UV |2Q ST   /    =    B    @    D yy /0 yyyy! (..0DI K 6 7d ))+DI Kr,c@t}tdit|y)Nrf)rrvars)rs r*mainrs r FFTrFrFF)(rrirtypingrrrmlx.corecorer;mlx.nnnnnumpyrnumpy.lib.stride_tricksrmlx_audio.audio_iorr=mlx_audio.utilsr audio_playerr utilsr ndarrayrrr+r/r4rhlistr?Moduleboolrrr__name__rfr,r*rs ))73&% !" * *** *  *  38_ *`!"    ZZ 4  %  DDDD D  D&.2 "!% $!#" 8!% #"7r r E#ryy.) *rr  r SM r sm r rrr r E?r}rsmr c299nr"##r$%r&'r()r* +r,-r./r0 1r23r4 5r67r: ;rjM`!  zFr,