o )j@s|ddlZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z e ej dZdd ZGd d d eZdS) N)ArgumentParser)model_file_download) CLICommand)HubApi) get_logger)Z log_levelcCst|S)z> Function which will be called for a specific sub parser. ) LlamafileCMD)argsr Y/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/modelscope/cli/llamafile.pysubparser_funcsr c@sBeZdZdZddZedefddZddZd d Z d d Z d S)rZ llamafilecCsv||_|jj|_|jdus|jddkrtd|jd|jjdur5d|j_|jjds5tdt |_ dS)N/zInvalid model id []. .llamafilez*file argument must ends with ".llamafile".) rmodelmodel_idcount ValueErrorfileaccuracylowerendswithrapi)selfrr r r __init__s   zLlamafileCMD.__init__parserscCs|tj}|jdtddd|}|jdtdddd |jd tdd d|jd td dd|jdtdddd |jtdd S)z. define args for clear-cache command. z--modelTzCThe id of the model, whose repo must contain at least one llamafile)typerequiredhelpz --accuracyFZq4_k_mzRSelected accuracy of GGUF files in the repo. Ignored when "file" is also provided.)rrdefaultrz--filez[The name of a specified llamafile in the model repo. This takes precedence over "accuracy".z --local_dirNzCDirectory where the selected llamafile would will be downloaded to.)rrrz--launchTruezGWhether to launch model with the downloaded llamafile, default to True.)func) add_parserrname add_argumentstradd_mutually_exclusive_group set_defaultsr )rparsergroupr r r define_args$sF   zLlamafileCMD.define_argsc Cs|jjrd|j_|jj|jdd}g}|D]}|d}|r/|dr/d|vr/||q|s;t d|jdt d|jd |d|d }d }|D]&}|jjrb||jjkrb|}d}n|jjrv|jj|vrv|}d}nqP|rt d |d nt d|dt jt|jj||jjd}tjdr||}|jjdkrt d|d||dSt d|ddS)NT) recursivePathrz-of-z(Cannot locate a valid llamafile in repo .zlist of llamafiles in repo z: rFz$llamafile matching criteria found: [rzKNo matched llamafile found in repo, choosing the first llamafile in repo: []) local_dirwintruez Launching model with llamafile [z]:z-No Launching. Llamafile model downloaded to [z!], you may execute it separately.)rrrrZget_model_filesrrrappendrloggerinfoprintospathabspathrrr/sysplatform startswith_rename_extensionZlaunch_execute_llamafile) r all_filesZ llamafilesr4 file_pathZ selected_filefoundfZdownloaded_filer r r executeUsb        zLlamafileCMD.executecCsvt|j}|dB}t|||}d}z ddl}|j}Wn ty(Ynw|r4td|d}t |dS)NIFrz;GPU detected, launching model with llamafile GPU option >>>z -ngl 999) r6statst_modechmodtorchcudaZ is_availableModuleNotFoundErrorr5system)rr?Z current_modeZnew_modeZ execute_cmdZhas_gpurGr r r r=s"    zLlamafileCMD._execute_llamafilecCsDtj|\}}tj|\}}tj||d}t|||S)Nz.exe)r6r7splitsplitextjoinrename)rZoriginal_file_name directoryfilename base_name_Z new_filenamer r r r<s  zLlamafileCMD._rename_extensionN) __name__ __module__ __qualname__r#r staticmethodrr*rBr=r<r r r r rs 01 r)loggingr6r9argparserZ modelscoperZmodelscope.cli.baserZmodelscope.hub.apirZmodelscope.utils.loggerrWARNINGr3r rr r r r s