+ UV-j+^RIHtHtHtHtHtHt^RIHt ^RI H t ^RI H t HtHtHtHtRRltRRltRRR ] P(/R R lltRRR ] P(R R/R RlltR#))AnyCallable GeneratorListOptionalTupleN)_dflash_block_total_record_speculative_round_speculative_walk_speculative_walk_batchgeneration_streamc\V^8dQhR\PR\R\R\/#) draft_modelrequested_block_totalremaining_budgetreturn)nnModuleint)formats"k/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/mlx_vlm/speculative/dflash.py __annotate__rs40%0%0%0%0% 0%c\W4pV^8:dV#\VRR4'dV#\VRR4;'g.p\VRR4;'g.p\VRRVRR4UUu.uF-wrg\V4^8gK\ V4\V43NK/ pppV'gV#\V\ ^VR,^,^,44p \V^4p \ RV44p \ RV44p W, p V \V4, pV R8gVR 8d@V ^8d\ V \W9^,44#\ V \W9^, 44#V R 8d\ V \W9^, 44#\ R V44pV\V4, pV R 8dVR 8d\W9^,4#\W94#uuppi)a4Choose the next DFlash verify block size from recent acceptance. DFlash checkpoints advertise a trained block size, usually 16. Treat that as the ceiling and back off quickly when deeper positions are mostly rejected. When acceptance is strong at the current depth, grow back toward the configured ceiling. prefer_requested_block_sizeF accept_lensN draft_lensc3*"TF wrVxK R#5iN).0_ds& r *_dflash_next_block_size..-s'!c3*"TF wrVxK R#5ir r!)r"ar#s& rr%r&.s(1r'g333333?g@g?c3:"TFwrW8gK ^xK R#5i)Nr!)r"r)r$s& rr%r&:s3&$!AFAA&s  g333333?g?i)mingetattrziprfloatmaxsumlen)rrr block_totalrrr)r$recentcurrent min_totaldraftedaccepted accept_rate mean_accept full_hits full_hit_rates&&& r_dflash_next_block_sizer>s+>Ka{95AA+}d;AArKlD9??RJ BC(*RS/::DA q6A: q3q6:  +s1fRjma&789GK#I'''G(((H$KS[(KT[3. a<y#ka<"@A A9c+{;<<T9c+{;<<3&33IF +Md}4;! ,, { $$9s -G!G!cV^8dQhR\PR\\\,,R\\P,/#)r hidden_fullnew_tokens_listr)mxarrayrr)rs"rrrBs8,0cO "((^rc \V4UUu.uF$wr#WV^,1R\V41R3,NK& upp#uuppi)r+NNNN) enumerater3)r@rAi new_tokenss&& r!_dflash_committed_hidden_segmentsrIBsO '7 7MA AI0Z0!3447  s*=draft_block_size token_dtypecV^8dQhR\PR\PR\\,R\P R\ R\ R\\P .\P 3,R\\ ,R \PR \\\ R 3,R R 3,/ #) rmodelr prompt_cachehidden first_bonus max_tokenssamplerrJrKrN) rrrrrBrCrrrDtyperr)rs"rrrKsUU 99UUs)U HH U  UUrxxj"((* +UsmUUuS$Yt+,Urc #"\VR4'd VPMTp \V R4'g"\\V 4P R24h\ VP P4p \W4p VPV4p Tp ^pW8Ed\VV W^, ^,4pV^8:dR#VPWWWh4p\P!V4\P!\4;_uu_4\P !\P"!V ..VR7V.^R7pV !VVV R7p\P !VP$R R7pV!VP&4pRRR4\P!XV4\)VVW^, 4wpp\+VVV^, 4VFpVR3xV^, pW8gKR# VV^, 8dVRRV^,1R3,pV'd VR ,MT p VV^, 8dJ\P!\4;_uu_4V P-VXP.VV4RRR4VR ,^8XgEK\P0!4EKR# +'giEL+;i +'giLO;i5i) uDFlash speculative-decoding **round loop**. draft → verify → walk → rollback. ``generate_step`` is responsible for prefill, sampling the first bonus token, and packaging the captured hidden states into ``hidden``. language_modelrollback_speculative_cachez does not implement rollback_speculative_cache. Speculative decoding with a DFlash drafter currently only supports mlx_vlm.models.qwen3_5.dtypeaxiscachecapture_layer_idsNrEr,)hasattrrU RuntimeErrortype__name__listconfigtarget_layer_idsr resetr> draft_blockrB async_evalstreamr concatenaterC hidden_stateslogitsr r rV gdn_states clear_cache)rMrrNrOrPrQrRrJrKlmrer4 draft_cachebemittedbs draft_tokens verify_input verify_out target_tokensr9rHtoks&&&&$$$$$ r_dflash_roundsryKsh$")0@!A!A  uB 23 4 4Bx  !"/ /  K..??@%kDK##E*KAG   $    1 $  7 ".. {  l# YY( ) )>>A3%{3\BL""2J ^^J$<$<2FF#J$5$56M* mV, 1 -)= * "+xa@Ct)O qLG$  b1f A~A~q01F(JrNa b1f ,---- *"7"72. S=A  NN i * ) )@.-sJDK A2J 1). Supports continuous batching: when a sequence finishes (EOS or max_tokens), it is filtered out of the target caches and the drafter cache is reinitialized for the new batch size. ``stop_check(seq_idx, token_id) -> bool`` is an optional callback that returns True to stop a sequence (e.g. EOS detection). Yields ``(tokens_list, None)`` where ``tokens_list[i]`` is the token for sequence ``i`` (or ``None`` if that sequence has nothing to emit this step). rUrVz/ does not implement rollback_speculative_cache.FrWrYNr[c38"TFp\V4xK R#5ir )r3)r"nts& rr%'_dflash_rounds_batch..s8"c"ggsTfilterr^)rENr,)%r_rUr`rarbshapercrdrer rfrange make_cachetolistr2r3r1r>r-rBrCrjrgrrhrir rkrlr rIr rVrmint32rrn)2rMrrNrOrPrQrRrJrKrzroBrer4r# draft_cachesrqrrfinished active_idxrGhidden_by_orig total_emittedj remainingrsn_activeb_activeb_arrrtrurvr@rwbudgets accepted_listrA min_accepted accepted_arrhidden_segmentsorigr)max_newpos tokens_outrx keep_slotskeep_mxc new_totals2&&&&$$$$$$ r_dflash_rounds_batchrs4")0@!A!A  uB 23 4 4Bx  !!T T   !AK..??@%kDKe6;Ah?h**,hL? AcAgGw{HeAhJ16q:AfQQ'N:LM j/A 3z?+ + : 1 66: ;+  %[s9~ N 7 z?.3Ho>oAjm$$o>5 ~~x )A'' $":a=1 A/ )    l#YY( ) )>>5><*HqQL""2J ..)A)AKK#J$5$56M* m[1AFhP1: 1 666P)@ -* & =) xx . ;  xAa=Dq!''*Q.'6q'9t$! A %k1b1f ==L#888QR>C/3fqjJ8_!!}_Q/00$)!,S1C'*Jt$DMQ&Mt} 2)-!-*T32G2G)-%d" ""xAa=Dq!!)!,R0$! "q& ,---- *"7"7r. "'xPAA8O8Oaa P z?X %:!#hhz:G!1h''HHW%"2<<A*Q--J<L  ms2 2 NN ! Y @;  ?  * ) )QT.-- Q=sB/Z-1Y AZ-Y"%4Z-1Y' 8Z-Y,7Z-A Y1AZ-A!Y6?,Z-+ Z  A2Z-4Z-7AZ- Z-$>Z-' Z-86Z-3AZ-:ZZ-.Z# Z#AZ-4Z- Z(AZ-6 Z Z- Z Z-)typingrrrrrrmlx.corecorerBmlx.nnrcommonr r r r r r>rIrryrr!rrrsxBB0%fU'+UHHUp\"'+\"HH\"8<\"\"r