o 0j6&@sRdZddlmZddlZddlmZddlmZddlm Z m Z m Z ddl m Z e d d Ze d d Zeeejd d fZeedBejd d fZeedBejd d fZejdddgd  d_dede ddfddZejddgdddddddddddedeeejdd fdeeejdd fd eeejd!d fd"eeejd#d fd$eeejd%d fd&eeejd'd fd(eeejd)d fded*eedBejd+d fde d,eeejd-d fd.eeejd/d fd0eedBejd1d fd2eedBejd3d fd4eedBejd5d fddf"d6dZejdd7gd    d`deeejdd fded eedBejd8d fdede ddf d9d:Z dade ddfd;d<Zejdd=gdeejd>d?d@eejedAdBejdCgd  d_dedede ddfdDdEZejdFgd              dbdededeedBejdd fd eedBejd!d fd"eedBejd#d fd$eedBejd%d fdeedBejdGd fdHeedBejdId fd*eedBejd+d fd,eedBejd-d fd.eedBejd/d fd0eedBejd1d fd2eedBejd3d fd4eedBejd5d fde ddf dJdKZejdLgd  M dcdededNee ejdOdPd fde ddf dQdRZ!ejdSgd  d_dedede ddfdTdUZ"ejdVgd  M dcdededWee ejdXdYd fde ddf dZd[Z#ejd\gd  d_dedede ddfd]d^Z$dS)dz2CLI commands for Hugging Face Inference Endpoints.) AnnotatedN)InferenceEndpointScalingMetric)HfHubHTTPError)TokenOpt get_hf_api typer_factory)outz(Manage Hugging Face Inference Endpoints.)helpz.Interact with the Inference Endpoints catalog.zEndpoint name.z_The namespace associated with the Inference Endpoint. Defaults to the current user's namespace.z list | lszhf endpoints lsz"hf endpoints ls --namespace my-org)examples namespacetokenreturnc Cslt|d}z |j||d}Wnty+}ztd|tj|jjd|d}~wwg}|D]|}|j }| di}| di} | di} | d i} | | d d t | t r_| d d nd t |t rk| d d nd t | t rw| dd nd t | t r| dd nd t | t r| dd nd t | t r| dd nd t | t r| dd nd dq0tj|d ddS)z6Lists all Inference Endpoints for the given namespace.r )r r zListing failed: codeNstatusmodelcomputeprovidername repositorystatetask frameworkZ instanceTypevendorregion)rrrrrinstancerr)Zid_key)rZlist_inference_endpointsrr errortyperExitresponse status_coderawgetappend isinstancedicttable) r r apiZ endpointsrresultsendpointr$rrrrr-h/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/huggingface_hub/cli/inference_endpoints.pyls$s6       r/deployzChf endpoints deploy my-endpoint --repo gpt2 --framework pytorch ...)rr )r rr min_replica max_replicascale_to_zero_timeoutscaling_metricscaling_thresholdrrepozeThe name of the model repository associated with the Inference Endpoint (e.g. 'openai/gpt-oss-120b').rz@The machine learning framework used for the model (e.g. 'vllm'). acceleratorz?The hardware accelerator to be used for inference (e.g. 'cpu'). instance_sizezNThe size or type of the instance to be used for hosting the model (e.g. 'x4'). instance_typezYThe cloud instance type where the Inference Endpoint will be deployed (e.g. 'intel-icl').rzTThe cloud region in which the Inference Endpoint will be created (e.g. 'us-east-1').rzVThe cloud provider or vendor where the Inference Endpoint will be hosted (e.g. 'aws').rzCThe task on which to deploy the model (e.g. 'text-classification').r1zVThe minimum number of replicas (instances) to keep running for the Inference Endpoint.r2zRThe maximum number of replicas (instances) to scale to for the Inference Endpoint.r3zFThe duration in minutes before an inactive endpoint is scaled to zero.r4z!The metric reference for scaling.r5zeThe scaling metric threshold used to trigger a scale up. Ignored when scaling metric is not provided.cCst| d}|jdid|d|d|d|d|d|d|d |d |d | d | d | d| d|d|d| }t|jdS)z3Deploy an Inference Endpoint from a Hub repository.rrrrr7r8r9rrr rr r1r2r4r5r3Nr-)rZcreate_inference_endpointr r(r$)rr6rr7r8r9rrr rr r1r2r3r4r5r*r,r-r-r.r0GsF V      zChf endpoints catalog deploy --repo meta-llama/Llama-3.2-1B-InstructzPThe hardware accelerator to be used for inference (e.g. 'cpu', 'gpu', 'neuron').c Csnt|d}z |j|||||d}Wnty.}ztd|tj|jjd|d}~wwt |j dS)z4Deploy an Inference Endpoint from the Model Catalog.r)Zrepo_idrr7r r zDeployment failed: rN) rZ&create_inference_endpoint_from_catalogrr rr r!r"r#r(r$)r6rr7r r r*r,rr-r-r.deploy_from_catalogs  r:c Csht|d}z|j|d}Wnty*}ztd|tj|jjd|d}~wwt d|idS)zList available Catalog models.rzCatalog fetch failed: rNmodels) rZlist_inference_catalogrr rr r!r"r#r()r r*r;rr-r-r. list_catalogs r<zhf endpoints catalog lsz list-catalogT)rZhiddencatalogrz!hf endpoints describe my-endpointc Cjt|d}z |j|||d}Wnty,}ztd|tj|jjd|d}~wwt |j dS)z+Get information about an existing endpoint.rrr r zFetch failed: rN) rZget_inference_endpointrr rr r!r"r#r(r$rr r r*r,rr-r-r.describe rBz/hf endpoints update my-endpoint --min-replica 2zBThe machine learning framework used for the model (e.g. 'custom').revisionzrThe specific model revision to deploy on the Inference Endpoint (e.g. '6c0e6080953db56375760c0471a8c5f2929baf11').cCst|d}z|j|||||||||| | | | | |d}Wnty8}ztd|tj|jjd|d}~wwt |j dS)zUpdate an existing endpoint.r)rr rrrDrr7r8r9r1r2r3r4r5r zUpdate failed: rN) rZupdate_inference_endpointrr rr r!r"r#r(r$)rr r6r7r8r9rrDrr1r2r3r4r5r r*r,rr-r-r.updates2 O rEzhf endpoints delete my-endpointFyesz--yeszSkip confirmation prompts.c Cstjd|d|dt|d}z |j|||dWnty7}ztd|tj|jj d|d}~wwtj d |d |d dS) z)Delete an Inference Endpoint permanently.zDelete endpoint 'z'?)rFrr@zDelete failed: rNz Deleted 'z'.r>) r ZconfirmrZdelete_inference_endpointrrr r!r"r#result)rr rFr r*rr-r-r.deleteds rHzhf endpoints pause my-endpointc Cr?)zPause an Inference Endpoint.rr@zPause failed: rN) rZpause_inference_endpointrr rr r!r"r#r(r$rAr-r-r.pause{rCrIzhf endpoints resume my-endpointfail_if_already_runningz--fail-if-already-runningzWIf `True`, the method will raise an error if the Inference Endpoint is already running.c Csnt|d}z |j|||| d}Wnty.}ztd|tj|jjd|d}~wwt |j dS)zResume an Inference Endpoint.r)rr r Z running_okzResume failed: rN) rZresume_inference_endpointrr rr r!r"r#r(r$)rr rJr r*r,rr-r-r.resumes  rKz&hf endpoints scale-to-zero my-endpointc Cr?)z$Scale an Inference Endpoint to zero.rr@zScale To Zero failed: rN) rZ scale_to_zero_inference_endpointrr rr r!r"r#r(r$rAr-r-r. scale_to_zerorCrL)NN)NNNN)N)NNNNNNNNNNNNNN)NFN)%__doc__typingrr Z$huggingface_hub._inference_endpointsrZhuggingface_hub.errorsrZ _cli_utilsrrr_outputr Zie_cliZ catalog_appstrZArgumentZNameArgOptionZNameOptZ NamespaceOptcommandr/intfloatr0r:r<Z add_typerrBrEboolrHrIrKrLr-r-r-r.s         ". &-.45;AGMS k #    !'-39?EKL g