+ QV-jq\^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIHtH t ^RI H t H t ^RI HtHt^RIt^RIt^RIt^RIt^RIHtHt^RIHt^RIHt^RIt]P:!4R8wd^RIt]!4'd-^R IH t ^R I!H"t"^R I#H$t$^R I%H&t&^R I'H(t(H)t)H*t*H+t+H,t,^RI-H.t.RRRR/t/]0!]Pb]Pd,4t3]0!]Pb]Ph,]Pd,R,4t5RRR/RRR/RRR/RRR/RRR/RRR /R!RR"//t6R#t7R$R%Pq]6Ps44 R&2t:!R'R(4t;!R)R*4tR8R/R0llt?R1R2lt@R3R4ltA]BR58Xd ]?@[]^_`{|}~llamatextz5There is a Llama in my lawn, how can I get rid of it?codezyWrite a Python function that integrates any Python function f(x) numerically over an arbitrary interval [x_start, x_end]. helicopterz4How many helicopters can a human eat in one sitting?numbersz4Count to 10 but skip every number ending with an 'e'birdszWhy aren't birds real?socksz2Why is it important to eat socks after meditating?numbers2z$Which number is larger, 9.9 or 9.11?a **TRANSFORMERS CHAT INTERFACE** Chat interface to try out a model. Besides chatting with the model, here are some basic commands: - **!help**: shows all available commands (set generation settings, save chat, etc.) - **!status**: shows the current status of the model and generation settings - **!clear**: clears the current conversation and starts a new one - **!exit**: closes the interface am **TRANSFORMERS CHAT INTERFACE HELP** Full command list: - **!help**: shows this help message - **!clear**: clears the current conversation and starts a new one - **!status**: shows the current status of the model and generation settings - **!example {NAME}**: loads example named `{NAME}` from the config and uses it as the user input. Available example names: `z`, `a#` - **!set {ARG_1}={VALUE_1} {ARG_2}={VALUE_2}** ...: changes the system prompt or generation settings (multiple settings are separated by a space). Accepts the same flags and format as the `generate_flags` CLI argument. If you're a new user, check this basic flag guide: https://huggingface.co/docs/transformers/llm_tutorial#common-options - **!save {SAVE_NAME} (optional)**: saves the current chat and settings to file by default to `./chat_history/{MODEL_ID}/chat_{DATETIME}.yaml` or `{SAVE_NAME}` if provided - **!exit**: closes the interface ca]tRt^jtoV3RlRltV3RlRltV3RlRltRtV3RlR ltV3R lR lt RV3R lR llt RV3RlRllt V3RlRlt V3RlRlt RtVtR#) RichInterfacec,<V^8dQhRS[RS[RS[/#)model_iduser_idbase_urlstr)format __classdict__s"f/Volumes/fast/ai/experiments/ui-tars-smoke/.venv/lib/python3.14/site-packages/transformers/cli/chat.py __annotate__RichInterface.__annotate__ks"!!!s!c!cH\4VnWnW nW0nR#N)r_consoler(r)r*)selfr(r)r*s&&&&r/__init__RichInterface.__init__ks     r2cz<V^8dQhRS[S[S[,,RS[S[S[S[,R,3,/#)r'streamreturnN)rrr tupler,r)r-r.s"r/r0r1qs;;#;# .H IJ;# sC#I$$ %;#r2c "VPPRVP R24\VP^R7;_uu_4pRp^p\P!4pRpVGRjxL RjxL pVP ^,P Pp\VP ^,RV4p\VRR4p V e\V RV4pV'gKw\P!RR V4pW8, p.p VP4FOp V PV 4V PR 4'dV PR 4K>V PR 4KQ \RPV 4P!4R R7p VP#V RR7EK<ELAEL;ED=RRR4M +'giM;i\P!4X, p T ^8dQX^8dJYM, pTPP4TPPRT RT R RTR R24TPP4XX3#5i)z [bold blue]:)consolerefresh_per_secondN finish_reasonusagecompletion_tokensz <(/*)(\w*)>z\<\1\2\>z``` z z github-dark) code_themeT)refreshz[dim]z tokens in z.1fzs (z tok/s)[/dim])r5printr(rtimechoicesdeltacontentgetattrresub splitlinesappend startswithrjoinstripupdate)r6r:liverrC start_timerAtokenoutputsrBlineslinemarkdownelapsed tok_per_secs&& r/ stream_outputRichInterface.stream_outputqs l4==/<= $--A > >$D ! J(,M%+||) 4) 4e--*0088 ' a(8/= Y w5$(/7JL](^%&&gF OO-DLL&u-- T* V,.$BGGEN$8$8$:}U Hd 3S ,) 4| ? > > >`))+ * Q;,q0+5K MM   ! MM  %(9':+gc]RUVabeUffs t u ]""sWA I# !F?,F--F?1F35F0 6F39A,F?&CF?0F33F?6 I#? G BI#c <V^8dQhRS[/#r'r;r+)r-r.s"r/r0r1ssr2c VPPRVP R24pVPP4V#)z!Gets user input from the console. [bold red]: )r5inputr)rG)r6rds& r/rdRichInterface.inputs8 ##k$,,t$DE  r2c :VPP4R#)zClears the console.N)r5clear)r6s&r/rgRichInterface.clears r2c <V^8dQhRS[/#)r'rr+)r-r.s"r/r0r1ssr2c VPPRVP RV 24VPP4R#)z%Prints a user message to the console.rcz>:[/ bold red] N)r5rGr))r6rs&&r/print_user_message RichInterface.print_user_messages6 k$,,7GvNO r2c&<V^8dQhRS[RS[/#)r'rcolorr+)r-r.s"r/r0r1sCr2c |VPPRV RV 24VPP4R#)z,Prints text in a given color to the console.z[bold ]N)r5rG)r6rrns&&&r/ print_colorRichInterface.print_colors1 fUG1TF34 r2c,<V^8dQhRS[RS[RS[/#)r'messagedefaultr;r,bool)r-r.s"r/r0r1s" ( (s (T (d (r2c V'dRMRpVPPRV RV R24pVPP4VP4P 4pV'gV#VR9#)zFDisplays a yes/no prompt to the user, returning True for confirmation.zY/nzy/Nz [bold yellow]z (z): >yyes)r5rdrGrSlower)r6rtru default_hintresponses&&& r/confirmRichInterface.confirmsf 'uU ==&&wir,s'ST >>#))+N<''r2c <V^8dQhRS[/#)r'minimal)rw)r-r.s"r/r0r1s$r2c VPP\V'd\M\44VPP4R#)z'Prints the help message to the console.N)r5rGrHELP_STRING_MINIMAL HELP_STRING)r6rs&&r/ print_helpRichInterface.print_helps. HG%8UV r2c <V^8dQhRS[/#)r'modelr+)r-r.s"r/r0r1sPPcPr2c aaa\P!VPPR4 R2RS/RR7pVP 4!RR\ 4pRRR R R R R R/oVP P\S4^,^F,8oVVV3Rlp\\R4\^(R7V!4\4VP R7pVPV!R4RR7pRp\WPP RR7;_uu_4VP4EFpV'dVP!R4'gK%\"P$!VR,4p V P'R4p V R8XdV P'RR4pMV R8Xd\)V P'RR44hV R8XgKV P'R 4p V P'R!4p V!V 4p V 'd:V R 8XdR"MR#pVP+WmV R$,V P'R%4VR&7EKVP+Wm^RR'7EK RRR4V'd*VP P-\/R(S R)244M(VP P-\/R(S R*244VP P-4R# +'giL;i)+/z /load_modelrT)jsonr:c&a]tRt^toRtRtVtR#)3RichInterface.print_model_load..StatsColumncVP'g \R4#VPPR4R8Xd\P !\ VP44p\P !\ VP44pVP'd.R\P !\ VP44 R2MRpVPe?R\ VP^<,4 R\ VP^<,4R 2pMRp\V RV V V 2RR 7#\\ VP4 R\ VP4 24#) r@unitbytesz z/s:02drzprogress.download)style) totalrfieldsgetrdecimalint completedspeedtime_remaining)r6taskdonetotretas&& r/render:RichInterface.print_model_load..StatsColumn.renderszzz8O;;??6*g5#++C,?@D"**3tzz?;CJN***b!1!1#djj/!B C2FZ\E**6 "3t':':b'@#A"B!CH[H[^`H`DabeCfg 4&#ugcU ;CVWWs4>>231S_4EFGGr2N)__name__ __module__ __qualname____firstlineno__r__static_attributes____classdictcell__r.s@r/ StatsColumnrs H Hr2r processorzLoading processorconfigzLoading configdownloadzDownloading filesweightszLoading into memorycH<SPW4pS'dS RV 2#V#)u → )r) stage_key stage_textrshow_model_prefix stage_labelss& r/_label.RichInterface.print_model_load.._labels-%)))?J  |44 r2z[bold]{task.description}) bar_width)r>N)rF)r> transientsdata: :NNstatusreadycachederrorrtz Unknown errorloadingstageprogressritemscurrentr) descriptionrrr)rrrz_*z was already loaded.*_z is warm.*_)requestspostr*rstripraise_for_statusrr5widthlenrrrradd_taskr iter_linesrQrloadsr RuntimeErrorrTrGr)r6rr}rrrtask_idrrZeventrrproglabelrrrs&f @@r/print_model_loadRichInterface.print_model_loads^==DMM$8$8$=#>k!JRY[`Qajno!!# H. H& , & + ,  !MM//3u:>B3FF   1 2  # M  MM  ##F;$7t#D (MMT B B ++-4??9#=#= 48,8,W$"YYx7FW$&uyyO'LMMY&!IIg.E 99Z0D"5ME*/:*=w7 #$y/Y]YaYabiYjqu(!aW[\1.C6  MM  2eW4J)K L M MM  2eWK)@ A B ?C Bs 3J;A1J;:1J;,AJ;; K c <V^8dQhRS[/#)r'rr )r-r.s"r/r0r1%s#3r2c VPPRVP R24VPPRV 24VPP4R#)zFPrints the status of the model and generation settings to the console.z[bold blue]Model: rDz [bold blue]N)r5rGr()r6rs&&r/ print_statusRichInterface.print_status%sK 0rBC k&23 r2)r5r*r(r)N)F)rrrrr7r^rdrgrkrqr~rrrrrrs@r/r%r%jsh!! ;#;#z   ( ( PPdr2r%ca]tRtRtoRtR]R, R]R, 2RRRRRR3V3R lR llt]R 4tV3R lR lt Rt Rt Vt R#)Chati,(Chat with a model from the command line.zhttp://rrrNz./chat_history/cr<V^8dQhRS[S[S[P!RR73,RS[S[R,S[P!RR73,RS[S[S[,R,S[P!RR73,R S[S[R,S[P !R R73,R S[S[R,S[P !R R73,R S[S[S[P !RR73,RS[S[R,S[P !RR73,RS[S[R,S[P !RR73,RR/ #)r'r(z9ID of the model to use (e.g. 'HuggingFaceTB/SmolLM3-3B').)helpr*Nz7Base url to connect to (e.g. http://localhost:8000/v1).generate_flagsaFlags to pass to `generate`, using a space as a separator between flags. Accepts booleans, numbers, and lists of integers, more advanced parameterization should be set through --generation-config. Example: `transformers chat max_new_tokens=100 do_sample=False eos_token_id=[1,2]`. If you're a new user, check this basic flag guide: https://huggingface.co/docs/transformers/llm_tutorial#common-optionsuserzKUsername to display in chat interface. Defaults to the current user's name. system_promptzSystem prompt. save_folderzFolder to save chat history. examples_pathz"Path to a yaml file with examples.generation_configzPath to a local generation config file or to a HuggingFace repo containing a `generation_config.json` file. Other generation settings passed as CLI arguments will be applied on top of this generation config.r;)rr,typerArgumentlistOption)r-r.s"r/r0Chat.__annotate__1sOD'D'C5p!qqrD' $J,ef f D' " I  NN[    D'& $J LLk l n 'D'.!tU\\?O-P!PQ/D'0sELL6T$UUV1D'2!tU\\?c-d!de3D'6% $J LLg   7D'B CD'r2c  2W n\VP4p V P\R,8Xd8V P\R,8XdVP VP4WnWPnW`n\V4p V PRRR7V P!R /\V4BWn RVRVRVPP4/VnVeTM \4VnV'd9\#V4;_uu_4p \$P&!V 4VnR R R 4M \*Vn\-4'g \/R 4h\0P2!VP544R # +'giLQ;i) rrrT) do_samplemax_new_tokensr*r(rNzHYou need to install rich to use the chat interface. (`pip install rich`)r)r*rrDEFAULT_HTTP_ENDPOINTr check_healthr(rrload_generation_configrTparse_generate_flagsrto_dictsettings get_usernameropenyaml safe_loadexamplesDEFAULT_EXAMPLESr ImportErrorasynciorun _inner_run) r6r(r*rrrrrrparsedrfs &&&&&&&&& r/r7 Chat.__init__1s1F! $--( ??3J? ?FKKShioSpDp   dmm , *&((9: S 9 =,^<= #Xz8Xt{{ObObOde !,D,.  m$$ $q 1 %$-DM!""hi i  DOO%&%$s F F c\VR,R4p\P!V4pVP^8wd\ RV RVP R24hR# \P d\ RT R24hi;i)rhealthzThe server running on z returned status code z on health check (/health).zNo server currently running on z. To run a local server, please run `transformers serve` in aseparate shell. Find more information here: https://huggingface.co/docs/transformers/servingT)rhttpxr status_code ValueError ConnectError)url health_urloutputs& r/rChat.check_healthwsS3Y1  YYz*F!!S( ,SE1GHZHZG[[vw) !! 1#7op  s AA%Bc<V^8dQhRS[RS[RS[S[S[S[S[3,3,RS[RS[S[,RS[S[S[,S[3,/#)r' user_input interfacerrchatr;)r,r%dictr rr<)r-r.s"r/r0rstH+H+H+!H+sDcN*+ H+ ! H+ 4j H+ tDz++ ,H+r2c RpVR8Xd(\VP4pVP4EMVR8XdVP4EM|VP R4'd\ VP 44^8dVP 4p\ V4^8Xd V^,ML\PPVPVPR\P!R4 R24p\WVPR7VP!R V R 2R R 7EMVP R 4'doVR,P#4p V P 4p V F$p RV 9gK VP!RV R2RR 7EM; VP$!R /\'V 4BEMVP R4'd\ VP 44^8XdVP 4^,p W9dTVP4.pVP)W;,R,4VP+RRRW;,R,/4MwRV R\-VP/44 R2p VP!V RR 7MCVR8XdVP1VR7M)RpVP!RV R2RR 7VP4WVV3#)!z Handles all user commands except for `!exit`. May update the chat history (e.g. reset it) or the generation config (e.g. set a new flag). T!clear!help!savechat_%Y-%m-%d_%H-%M-%S.jsonfilenamer rChat saved to !greenrrn!setNN=(Invalid flag format, missing `=` after `;`. Please use the format `arg_1=value_1 arg_2=value_2 ...`.red!examplerrolerrKExample * not found in list of available examples: .!statusrF'/' is not a valid command. Showing help message.r)new_chat_historyrrgrrQrsplitospathrRrr(rHstrftime save_chatrrqrSrTrrkrPrkeysr) r6r r rrr  valid_command split_inputrnew_generate_flagsflag example_name example_errors &&&&&& r/handle_non_exit_user_commands"Chat.handle_non_exit_user_commandss  !#D$6$67D OO  7 "  "  " "7 + +J4D4D4F0G!0K$**,K{#q(AWW\\$"2"2DMMU4==YlKmJnnsCtu  xT]] K  ! !z'C7 ! S  " "6 * *",B!5!5!7 !3!9!9!; *d?))FtfMAA$ *+ I 45G HI  " ": . .3z7G7G7I3Ja3O%++-a0L'!,,X-CF-KL VVY8Nv8VWX|n,VW[\d\i\i\kWlVmmno%%=%F 9 $  " "& " 1"M  ! !:,6e'fns ! t  "F**r2c  "\VPVPVPR7pVP 4\ VP 4pVPRR7VPVP4VPp\VPR7;_uu_4GRjxL pRpVeTpRpVPV4MVP4pVR8XdEMVR8Xd(\ VP 4pVP 4KcVR8XdVP4K|VPR4'd\VP44^8dVP4p\V4^8Xd V^,ML\ P"P%VP&VPR \(P*!R 4 R 24p\-WVP.R 7VP1R V R2RR7EKXVPR4'doVR,P34p V P4p V F#p RV 9gK VP1RV R2RR7M VP4!R,/\7V 4BEKVPR4'd\VP44^8XdVP4^,p WP89djVP 4.pVPVP8V ,R,4VP;RRRVP8V ,R,/4MRV R\=VP8P?44 R2p VP1V RR7MrVR8XdVPAVR 7EKVPR4'd+VP1R!V R"2RR7VP4EK=VP;RRRV/4R#VPC4R$VP/p VPEVRVPV R%7pVPGV4GRjxL wppVP;RR&RV/4VR'8Xd2VP1R(R)4VPIR*4'dR+pEKEKEKRRR4GRjxL R#ELLl \JdK%i;iL +GRjxL 'giR#;i5i)-)r(r)r*T)r)r*Nz!exitrrrrrrrrrrrrrrrrr r!rr"rrKr#r$r%r&r'r(r)rr)r:r extra_body assistantlengthz2Generation stopped after reaching the token limit.yellowzContinue generating?u'Please continue. Do not repeat text.”r)&r%r(rr*rgr*rrrrr rkrdrQrr+r,r-rRrrHr.r/rrqrSrTrrrPrr0rto_json_stringchat_completionr^r~KeyboardInterrupt)r6r r rclientpending_user_inputr r2rr3r4r5r6r:r: model_outputrAs& r/rChat._inner_runs!4==$))VZVcVcd  2 23 T*""4==1'???6-1 f)5%7 -1*!44Z@%.__%6 "W,#x//0B0BC!) #w.!,,. #..w77C @P@P@RV^8dQhR\R,R\/#)r'rNr;)r,r )r-s"r/r0r0Is# C CcDj C=M Cr2cVf \4#RV9dU\PPV4p\PP V4p\P !W4#\P !V4#)Nr)r r,r-dirnamebasenamefrom_pretrained)rrIrs& r/rrIse !!##''//"3477##$56//BB//0ABBr2cTV^8dQhR\\,R,R\/#)r'rNr;)rr,r )r-s"r/r0r0Us#3$3$cT)93$d3$r2c DVe\V4^8Xd/#VUu/uF@pRVPR4^,,R,VPR4^,bKB ppVP4UUu/uF,wr4Y4P4R9dVP4MTbK. pppVP4UUu/uFwr4Y4R8XdRMTbK pppRRlpVP4UUu/uFwr4Y5!V4'gRV R2MTbK pppR P VP4UUu.uF wr4V R V 2NK upp4pR V,R ,pVP R R4pVP RR4pVP RR4pVP RR4pVP RR4pVP RR4p\ P!V4pV#uupiuuppiuuppiuuppiuuppi \ Pd \R4hi;i)zUParses the generate flags from the user input into a dictionary of `generate` kwargs."rtruefalseNonenullc0V^8dQhR\R\/#)r'sr;rv)r-s"r/r0*parse_generate_flags..__annotate__gs//S/T/r2cfVPR4pVPRR^4P4#)-r%r@) removeprefixreplaceisdigit)rTs&r/ is_number'parse_generate_flags..is_numbergs, NN3 yyb!$,,..r2z, z: {}z"null"z"true"z"false"z"[[z]"rprzFailed to convert `generate_flags` into a valid JSON object. `generate_flags` = {generate_flags} Converted JSON string = {generate_flags_string})rOrP) rr+rr{rRrYrrJSONDecodeErrorr)rr4generate_flags_as_dictkvr[generate_flags_stringprocessed_generate_flagss& r/rrUs<^!4!9 ^ll]kUYcDJJsOA$66PP]kl KaJfJfJhJh$! %661779A=JhKaJfJfJhiJh$!a;A=Jhi/ RhQmQmQopQoa11QCq1DQop !II?U?[?[?]&^?]tq!Bqc{?]&^_ "77#=299(FK199(FK199)WM199$D199$D299#sC #'::.C#D  $#Wmjq '_"     @   s*AG!62G&>G,0!G22G8 G>>!HcTV^8dQhR\R,R\\,/#)r'rNr;r,rr )r-s"r/r0r0s&SSC$JS$t*Sr2c$V'dRRRV/.#.#)z Returns a new chat conversation.r"systemrKr)rs&r/r*r*s=JVXy- 8 9RPRRr2c^V^8dQhR\R\\,R\R\/#)r'rr rr;rg)r-s"r/r0r0s,%%%4:%%#%r2cD\P!\PPV4RR7\ VR4;_uu_4p\ P !RVRV/V^R7RRR4\PPV4# +'giL/;i)z!Saves the chat history to a file.T)exist_okwr chat_history)indentN)r,makedirsr-rIrrdumpabspath)rr rrs&&& r/r/r/sfKK)D9 h   :x>!L  77??8 $$  s B B c$V^8dQhR\/#rar+)r-s"r/r0r0s11c1r2c\P!4R8Xd\P!4#\P !\P !44P#)z)Returns the username of the current user.r)platformrir,getloginpwdgetpwuidgetuidpw_namerr2r/rrs8I%{{}||BIIK(000r2__main__z meta-llama/Llama-3.2-3b-Instruct)r(r4)Crrr,rurMstringrHcollections.abcrrtypingrr urllib.parserrrrrrhuggingface_hubr r transformersr transformers.utilsr readlinerrirwrichr rich.consoler rich.liver rich.markdownr rich.progressrrrrr rich.textrrset ascii_letters whitespaceALLOWED_KEY_CHARSdigitsALLOWED_VALUE_CHARSrrrRr0rr%rrrr*r/rrrr2r/rs  4!*  L)0   ?? !$&``#[&$?,,v/@/@@A 6==(6+<+<?@A &DZZz C3$lS %1 z45w  sF F+*F+