o )j+@sddlZddlmZddlmZmZddlmZm Z m Z m Z m Z ddl mZddlmZddlmZmZddlmZmZmZddlmZmZdd lmZmZmZdd lm Z dd l!m"Z"dd l#m$Z$m%Z%e"Z&e d Z'GdddeZ(dS)N)ABCabstractmethod)AnyDictListOptionalUnion)snapshot_download)Tasks)build_backbone build_model)can_load_by_mscheck_model_from_owner_grouptry_to_load_hf_model)Config ConfigDict)DEFAULT_MODEL_REVISIONInvoke ModelFile) verify_device) get_logger)register_modelhub_reporegister_plugins_repo)z torch.Tensorz tf.Tensorc @seZdZdZddZdeeeffddZ  d de ed e efd d Z e deeeffd d Z deeefdeeeffddZ eddZeedddfdede ededede ef ddZ  d deeejfdeeeefde efddZdS)!ModelzBase model interface. cOs2||_|dd}t|||_|dd|_dS)Ndevicegputrust_remote_codeF) model_dirgetrZ _device_namer)selfrargskwargsZ device_namer"b/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/modelscope/models/base/base_model.py__init__s  zModel.__init__returncOs||j|i|S)N) postprocessforwardrr r!r"r"r#__call__$szModel.__call__Ninfo_strrcCs(|pd}t|ds|jsJ|dSdS)a"Check trust_remote_code if the model needs to import extra libs Args: info_str(str): The info showed to user if trust_remote_code is `False`. model_dir(`Optional[str]`): The local model directory. If is a trusted model, check remote code will pass. zThis model requires `trust_remote_code` to be `True` because it needs to import extra libs or execute the code in the model repo, setting this to true means you trust the files in it.)rN)rr)rr*rr"r"r#check_trust_remote_code's  zModel.check_trust_remote_codecOsdS)z Run the forward pass for a model. Returns: Dict[str, Any]: output from the model forward pass Nr"r(r"r"r#r'7sz Model.forwardinputscKs|S)a$ Model specific postprocess and convert model output to standard model outputs. Args: inputs: input data Return: dict of results: a dict containing outputs of model, each output should have the standard output name. r")rr,r!r"r"r#r&As zModel.postprocesscKs|di|S)a Define the instantiation method of a model,default method is by calling the constructor. Note that in the case of no loading model process in constructor of a task model, a load_model method is added, and thus this method is overloaded Nr"r")clsr!r"r"r# _instantiateNszModel._instantiateFmodel_name_or_pathrevisioncfg_dictrrcKs|d}|dur|d|tj}|dur|tjntj}|dd} t|r0|} n|dur8tddtj|f}t|||| d} t d| t | t j } d} |dur_|} n tj| rjt| } t| d d} d |vry|d } t| d t}t|d rt|d s|j|_t|d d}t|tr|d rd|dd}|dd}|durt| | |rd}d}|dvrt| | |fi|}|dur|dd}|dur|dur||}|S| durtdt j d| |_| d}|r|std|r |r t dt!| |di}|rd|i}t"||#D] \}}|||<q |dur2||_$| t%j&ur@d|_'t(|}nt)|| |d}t| drQ| j*|_*t|dsZ| |_+|dd||_,| |_|S)aInstantiate a model from local directory or remote model repo. Note that when loading from remote, the model revision can be specified. Args: model_name_or_path(str): A model dir or a model id to be loaded revision(str, `optional`): The revision used when the model_name_or_path is a model id of the remote hub. default `master`. cfg_dict(Config, `optional`): An optional model config. If provided, it will replace the config read out of the `model_name_or_path` device(str, `optional`): The device to load the model. trust_remote_code(bool, `optional`): Whether to trust and allow execution of remote code. Default is False. **kwargs: task(str, `optional`): The `Tasks` enumeration value to replace the task value read out of config in the `model_name_or_path`. This is useful when the model to be loaded is not equal to the model saved. For example, load a `backbone` into a `text-classification` model. Other kwargs will be directly fed into the `model` key, to replace the default configs. use_hf(bool, `optional`): If set to True, it will initialize the model using AutoModel or AutoModelFor* from hf. If set to False, the model is loaded using the modelscope mode. If set to None, the loading mode will be automatically selected. ignore_file_pattern(List[str], `optional`): This parameter is passed to snapshot_download device_map(str | Dict[str, str], `optional`): This parameter is passed to AutoModel or AutoModelFor* torch_dtype(torch.dtype, `optional`): This parameter is passed to AutoModel or AutoModelFor* config(PretrainedConfig, `optional`): This parameter is passed to AutoModel or AutoModelFor* Returns: A model instance. Examples: >>> from modelscope.models import Model >>> Model.from_pretrained('damo/nlp_structbert_backbone_base_std', task='text-classification') Zmodel_prefetchedNignore_file_patternTz9Expecting model is pre-fetched locally, but is not found.z%s/%s) user_agentr2zinitialize model from taskmodel model_typetypercudause_hfF>TN device_map`z` file not found.pluginsaDetected plugins field in the model configuration file, but trust_remote_code=True was not explicitly set. To prevent potential execution of malicious code, loading has been refused. If you trust this model repository, please pass trust_remote_code=True to from_pretrained.zUse trust_remote_code=True. Will invoke codes or install plugins from remote model repo. Please make sure that you can trust the external codes.)Z allow_remoter) task_name default_argspipelinecfgr)-rpoprZKEYZ PRETRAINEDospexists RuntimeErrorr loggerinfojoinrZ CONFIGURATIONospathr from_filegetattrrhasattrr6r7 isinstancestr startswithr rtoFileNotFoundErrorrZsafe_getwarningrritemsrr ZbackboneZ init_backboner r r@rAname)r-r/r0r1rrr!Z prefetchedZ invoked_byr2Zlocal_model_dirZconfiguration_pathrAr>Z model_cfgr6r:r5r;r=r?kvr"r"r#from_pretrainedWs ,                        zModel.from_pretrained target_foldersave_checkpoint_namesconfigcKstd)a save the pretrained model, its configuration and other related files to a directory, so that it can be re-loaded Args: target_folder (Union[str, os.PathLike]): Directory to which to save. Will be created if it doesn't exist. save_checkpoint_names (Union[str, List[str]]): The checkpoint names to be saved in the target_folder config (Optional[dict], optional): The config for the configuration.json, might not be identical with model.config z>save_pretrained method need to be implemented by the subclass.)NotImplementedError)rrYrZr[r!r"r"r#save_pretrainedszModel.save_pretrained)NN)__name__ __module__ __qualname____doc__r$rrOrr)rr+rr'r& classmethodr.rrboolrXrrIPathLikerdictr]r"r"r"r#rsT "    r))rIZos.pathrJrCabcrrtypingrrrrrZ modelscope.hub.snapshot_downloadr Zmodelscope.metainfor Zmodelscope.models.builderr r Z modelscope.utils.automodel_utilsr rrZmodelscope.utils.configrrZmodelscope.utils.constantrrrZmodelscope.utils.devicerZmodelscope.utils.loggerrZmodelscope.utils.pluginsrrrFZTensorrr"r"r"r#s