o )j",@sddlZddlmZddlmZddlmZddlZddlZddl m Z m Z m Z m Z ddlmZmZddlmZmZddlmZmZmZmZmZmZdd lmZdd lmZeZGd d d e Z!Gd dde Z"Gddde Z#Gddde Z$Gddde Z%ddZ&e Gddde Z'e Gddde Z(e GdddeZ)e Gddde)Z*e Gdd d e)Z+e Gd!d"d"e Z,Gd#d$d$eZ-e Gd%d&d&e-Z.e Gd'd(d(e-Z/e Gd)d*d*e-Z0Gd+d,d,e Z1dS)-N)ABC) HTTPStatus)Optional)asdictdefinefield validators)HubApiModelScopeConfig)API_RESPONSE_FIELD_DATAAPI_RESPONSE_FIELD_MESSAGE)NotLoginExceptionNotSupportError RequestErrorhandle_http_responseis_okraise_for_http_status) get_endpoint) get_loggerc@eZdZdZdZdS) AcceleratorcpuZgpuN)__name__ __module__ __qualname__CPUGPUrrV/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/modelscope/hub/deploy.pyrrc@seZdZdZdS)VendorZeasN)rrrEASrrrrr sr c@r) EASRegionz cn-beijingz cn-hangzhouN)rrrZbeijingZhangzhourrrrr"!rr"c@ eZdZdZdZdZdZdZdS)EASCpuInstanceTypezTEAS Cpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.c6.2xlargezecs.c6.4xlargezecs.c6.6xlargezecs.c6.8xlargeNrrr__doc__ZtinyZsmallZmediumZlargerrrrr$& r$c@r#)EASGpuInstanceTypezTEAS Gpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.gn5-c28g1.7xlargezecs.gn5-c8g1.4xlargezecs.gn6i-c24g1.12xlargezecs.gn6e-c12g1.3xlargeNr%rrrrr(/r'r(cCs ||jkrtd||jfdS)NzG'min_replica' value: %s has to be smaller than 'max_replica' value: %s!) max_replica ValueError)instance attributevaluerrrmin_smaller_than_max8s r.c@sJeZdZUdZededdZee d<edede gdZ ee d<dS)ServiceScalingConfigzResource scaling config Currently we ignore max_replica Args: max_replica: maximum replica min_replica: minimum replica default validatorr) min_replicaN) rrrr&rrger)int__annotations__r.r4rrrrr/?s r/c@sFeZdZUdZeed<eed<eej e ej ej gdZ eed<dS)ServiceResourceConfigzEas Resource request. Args: accelerator: the accelerator(cpu|gpu) instance_type: the instance type. scaling: The instance scaling config. Z instance_typeZscalingr1 acceleratorN)rrrr&strr7r/rrrrin_rr9rrrrr8Ls r8c@s eZdZdS)ServiceProviderParametersN)rrrrrrrr<\sr<c@sZeZdZUdZeed<eed<eed<dZeeed<ee j e e j gdZ eed<dS) EASDeployParametersaAParameters for EAS Deployment. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' region access_key_idaccess_key_secretNresource_groupr1vendor)rrrr&r:r7rArrr r!rr;rBrrrrr=as  r=c@sZeZdZUdZeed<eed<dZeed<dZeed<ee j e e j gdZ eed<dS) EASListParametersa@EAS instance list parameters. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' r?r@Nr>rAr1rB)rrrr&r:r7r>rArr r!rr;rBrrrrrCts    rCc@s:eZdZUdZeed<eed<eed<eed<eed<dS)DeployServiceParametersa Deploy service parameters Args: instance_name: the name of the service. model_id: the modelscope model_id revision: the modelscope model revision resource: the resource requirement. provider: the cloud service provider. instance_namemodel_idrevisionresourceproviderN)rrrr&r:r7r8r<rrrrrDs   rDc@seZdZdZddZdS)AttrsToQueryStringz7Convert the attrs class to json string. Args: cCsDt|jddd}t|}t|tj|}t|d|}|S)NcSs|duS)Nr)attrr-rrrsz1AttrsToQueryString.to_query_str..)filterz provider=%s)rrIjsondumpsprinturllibparse quote_plus)selfZ self_dictZjson_strsafe_strZ query_paramrrr to_query_strs   zAttrsToQueryString.to_query_strN)rrrr&rVrrrrrJs rJc@s.eZdZUeed<dZeed<dZeed<dS)ListServiceParametersrIrskipdlimitN)rrrr<r7rXr6rZrrrrrWs  rWc@eZdZUeed<dS)GetServiceParametersrINrrrr<r7rrrrr\ r\c@r[)DeleteServiceParametersrINr]rrrrr_r^r_c @seZdZdZddeefddZdededed ed ef d d Z ded efd dZ ded efddZ  dd edee dee fddZ dS)ServiceDeployerzEFacilitate model deployment on to supported service provider(s). NtokencCs8|dur|nt|_dti|_tj|dd|_dS)Nz user-agentT)Z access_tokenZcookies_required)rendpointr Zget_user_agentheadersr Z get_cookiescookies)rTrbrarrr__init__s  zServiceDeployer.__init__rFrGrErHrIc Cs|jtjkr td|jt|||||d}|jd}t|}tj|||j |j d} t | t |j d| j tjkrU| j tjkrUt| rM| t} | St| tt| dS)aDeploy model to cloud, current we only support PAI EAS, this is an async API , and the deployment could take a while to finish remotely. Please check deploy instance status separately via checking the status. Args: model_id (str): The deployed model id revision (str): The model revision instance_name (str): The deployed model instance name. resource (ServiceResourceConfig): The service resource information. provider (ServiceProviderParameters): The service provider parameter Raises: NotSupportError: Not supported platform. RequestError: The server return error. Returns: ServiceInstanceInfo: The information of the deployed service instance. z1Not support vendor: %s ,only support EAS current.)rErFrGrHrIz/api/v1/deployer/endpoint)rNrdrcZcreate_serviceN)rBr r!rrDrbrrequestspostrdrcrlogger status_coderOKMULTIPLE_CHOICESrrNr rr r) rTrFrGrErHrIZ create_paramspathbodyrdatarrrcreates4     zServiceDeployer.createcCt|d}d|j||f}tj||j|jd}t|t|jd|j t j kr=t | r5| t}|St| tt|dS)aQuery the specified instance information. Args: instance_name (str): The deployed instance name. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed from server. Returns: Dict: The information of the requested service instance. rI!%s/api/v1/deployer/endpoint/%s?%srdrcZ get_serviceN)r\rbrVrfgetrdrcrrhrirrjrrNr rr rrTrErIparamsrlrnrorrrrus     zServiceDeployer.getcCrq)a Delete deployed model, this api send delete command and return, it will take some to delete, please check through the cloud console. Args: instance_name (str): The instance name you want to delete. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed. Returns: Dict: The deleted instance information. rrrsrtZdelete_serviceN)r_rbrVrfdeleterdrcrrhrirrjrrNr rr rrvrrrrxs     zServiceDeployer.deleterrYrXrZcCst|||d}d|j|f}tj||j|jd}t|t|jd|j t j kr>t | r6| t}|St| tt|dS)aList deployed model instances. Args: provider (ServiceProviderParameters): The cloud service provider parameter, for eas, need access_key_id and access_key_secret. skip (int, optional): start of the list, current not support. limit (int, optional): maximum number of instances return, current not support Raises: RequestError: The request is failed from server. Returns: List: List of instance information )rIrXrZz%s/api/v1/deployer/endpoint?%srtZlist_service_instancesN)rWrbrVrfrurdrcrrhrirrjrrNr rr r)rTrIrXrZrwrlrnrorrrlist/s   zServiceDeployer.list)NN)rrY)rrrr&rr:rer8r<rprurxr6ryrrrrr`s& . r`)2rQabcrhttprtypingrrNrfattrsrrrrZmodelscope.hub.apir r Zmodelscope.hub.constantsr r Zmodelscope.hub.errorsr rrrrrZmodelscope.hub.utils.utilsrZmodelscope.utils.loggerrrhobjectrr r"r$r(r.r/r8r<r=rCrDrJrWr\r_r`rrrrsN