o 0jA @s2ddlmZddlmZddlmZddlmZddlm Z m Z m Z m Z m Z ddlmZddlmZmZd d lmZd d lmZd d lmZmZmZmZmZd dlmZmZm Z d dl!m"Z"d dl#m$Z$d dl%m&Z&d dl'm(Z(d dl)m*Z*d dl+m,Z,d dl-m.Z.d dl/m0Z0d dl1m2Z2d dl3m4Z4d dl5m6Z6d dl7m8Z8d dl9m:Z:d dl;mZ>d dl?m@Z@d dlAmBZBmCZCmDZDd d lEmFZFd d!lGmHZHd d"lImJZJd d#lKmLZLd d$lMmNZNd d%lOmPZPd d&lQmRZRd d'lSmTZTd d(lUmVZVd d)lWmXZXd d*lYmZZZd d+l[m\Z\d d,l]m^Z^d d-l_m`Z`d d.lambZbdd3d4Zcdd7d8Zdd d9lemfZfd:d;dd?d@ZgddAdBZhddDdEZiddGdHZjed:ddJdKZkd:d:dLddQdRZled dSddUdVZmddWdXZnddZd[Zodd_d`ZpddadbZqddfdgZrddjdkZsddodpZtddudvZud:d:d:d:d d:dwd:d:dx dd~dZvd:S)) annotations)Mapping) lru_cache)Path)AnyDictOptionalTupleUnion) BaseModel)errorslogging)official_models) UadPredictor)BindingUnknownModelErrorUnsupportedEngineError get_bindingget_supported_engines) GenAIConfigneed_local_modeluses_server_backend)DocVLMPredictor)InferenceEngine)FaceFeaturePredictor)FormulaRecPredictor) ClasPredictor)ImageFeaturePredictor)MLClasPredictor) WarpPredictor)InstanceSegPredictor) KptPredictor)LayoutAnalysisPredictor)BEVDet3DPredictor)WhisperPredictor) DetPredictor)OVDetPredictor)OVSegPredictor) BasePredictorLocalModelPredictorRunnerPredictor) HPIConfig)PaddlePredictorOption) SegPredictor)TablePredictor)TextDetPredictor)TextRecPredictor)TextToPinyinPredictor)Fastspeech2Predictor)PwganPredictor) TSAdPredictor)TSClsPredictor) TSFcPredictor)&resolve_paddle_engine_from_model_files)VideoClasPredictor)VideoDetPredictor model_namestrreturnTuple[str, ...]c Cs6zt|WSty}z td|d|d}~wwNz(No engine bindings registered for model .)rr ValueError)r=erEb/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/paddlex/inference/models/__init__.py_get_supported_enginesEs  rGenginerc Cs\zt||WSty}z td|d|d}~wty-}ztt||d}~wwrA)rrrCrr>)r=rHrDrErErF_get_predictor_bindingNs  rI)resolve_model_nameN model_formats model_dir Optional[str]rcCs<|dur ttj||dSt|}|st|d|S)NrKz does not exist!)rrZget_model_pathexistsFileNotFoundError)r=rMrLresolvedrErErF_resolve_model_dir\srRcCs<t|}dD] }||vr|Sqtd|dt|d)N) paddle_staticZpaddle_dynamiczModel z6 does not support engine 'paddle'. Supported engines: rB)rGrClist)r= supportedrHrErErF_resolve_default_paddle_engineosrVtuple[str, Optional[Path]]cCsV|dkr|dfS|durt|dfSt||}t|}|dur'td|d||fS)Npaddlez$No Paddle model files were found in rB)rVrRr:rC)r=rHrMmodel_dir_resolvedZresolved_enginerErErF_resolve_requested_enginezs  rZboolcCs$zt|dkWStyYdSw)N)flexibleF)rGrC)r=rErErF_is_flexible_only_models  r]rc Cs<zt|WStjy}z td|d|d}~ww)NzUnsupported engine: rB)rgetr ZClassNotFoundExceptionrC)rHrDrErErF_get_inference_engines r_r=devicecfgAOptional[Union[Dict[str, Any], PaddlePredictorOption, BaseModel]]raDict[str, Any]cCst|j|||dS)zIParse, validate and normalize engine-specific config to a canonical dict.r`)r_Znormalize_config)rHrbr=rarErErFnormalize_engine_configs re)maxsize frozensetcCsttS)z.Registered inference engine ids (bucket keys).)rgrallkeysrErErErF#_engine_config_bucket_key_allowlistsrjc stt|}fdd|D}||}|r)|r)tdt|dt|d|s-|S|D]\}}t|tsHtd|dt|j dq1| |}t|trWt |ni}||vrct d||S) a Resolve bucketed engine_config to a single dict for the resolved engine. Bucketed form: every top-level key must be a registered engine name, and every value must be a mapping. Mixing those keys with any other top-level key is not allowed (strict). csh|]}|vr|qSrErE).0kZ allowlistrErF sz2_flatten_bucketed_engine_config..zengine_config cannot mix per-engine bucket keys with flat config keys. Use either a flat dict for the resolved engine only, or a dict whose top-level keys are exclusively inference engine names. Flat-like keys: z; bucket-like keys: rBzJBucketed engine_config requires each top-level value to be a mapping; key z has type zbBucketed engine_config has no entry for resolved engine %r; using an empty config for that engine.)rjsetrirCsorteditems isinstancertype__name__r^dictrwarning) rHrbriZ allowlistedotherrlvZbucketZflat_for_enginerErmrF_flatten_bucketed_engine_configs@   ryNOptional[Union[Dict[str, Any], PaddlePredictorOption, HPIConfig, GenAIConfig]]cCs |dus t|ts |St||S)N)rrrury)rHrbrErErF%_maybe_flatten_bucketed_engine_configs r{use_hpip genai_config,Optional[Union[Dict[str, Any], GenAIConfig]]cCs0|dur|St|r dS|rdSt|rdSdS)N genai_clienthpir\rX)rr])r=rHr|r}rErErF_resolve_effective_enginesrcCs4|dur|S|dkr |S|dkr|S|dkr|SdS)NrSrrrErH engine_config pp_option hpi_configr}rErErF_select_engine_config_sourcesrinference_enginerYOptional[Path]cCs$|dus|js |St|||dS)NrK)needs_local_modelrRZget_supported_model_formatsrr=rMrYrErErF_resolve_local_model_dirsrrOptional[Dict[str, Any]]cCs.|sdSt|}||ddkrtd|S)NGlobalr=u9Model name mismatch，please input the correct model dir.)r+Z load_configrC)rr=rMconfigrErErF_load_local_model_configs  rbinding model_configrcCsNt|tsdSddlm}t||stdt|jd|j|||||dS)Nr) RunnerEnginezInferenceEngine z& does not support runner construction.)r=rMrrr) issubclassr-enginesrrr RuntimeErrorrsrtZ build_runner) predictor_clsrrr=rMrrrrErErF_build_predictor_runner&s   r batch_sizeintnormalized_engine_configpredictor_engine_configc Cs`|j}||d} |r|| d<t|||||||d} | dur!| | d<t|tr.|| d<|| d<| S)N)r=rr)rrrr=rMrrrunnerrMr) predictorrrr,) rrr=rrrrMrr create_kwargsrrErErF_build_predictor_kwargsAs*   rF) rMrarHrrrr|rr}rOptional[PaddlePredictorOption]r*Optional[Union[Dict[str, Any], HPIConfig]]r+c  Ks|r |dur td|t||d\}} } t|||| }t|||\}} t|} t||}| j}t| ||| d} t ||||| d}t ||}t ||||d}|rU| | | | r`|r`| }nt||| d}| |}t|||||| || d}|jd i|| S) aX Create a predictor for the given model and engine. Args: model_name: Model name. model_dir (Optional[str]): Path to model directory. Required for local engines when the model is not official. Ignored when a local model is not needed. device (Optional[str]): Device to run on (e.g. `'gpu'`, `'cpu'`). Used by local engines. engine (Optional[str]): Inference engine. One of `'paddle'` (resolved to `paddle_static` or `paddle_dynamic` from local model files when `model_dir` is provided; otherwise resolved from predictor support, preferring `paddle_static`), `'paddle_static'`, `'paddle_dynamic'`, `'hpi'`, `'flexible'`, `'transformers'`, `'onnxruntime'`, `'genai_client'`, or `None`. When `None`: if `genai_config.backend` is a server backend, engine becomes `'genai_client'`; else if `use_hpip=True` and model supports hpi, engine becomes `'hpi'`; else if model is flexible-only, engine becomes `'flexible'`; otherwise defaults to `'paddle'`. engine_config (Optional[Dict[str, Any]]): Engine-specific config for the resolved engine (flat dict), **or** a bucketed dict whose top-level keys are only registered engine names (e.g. ``hpi``, ``paddle_static``), each mapping to a nested dict. Bucketed and flat keys must not be mixed at the same level; use either form exclusively. batch_size (int): Batch size for inference. Defaults to 1. pp_option (Optional[PaddlePredictorOption]): Paddle predictor options. Used when `engine='paddle_static'` and `engine_config` is not specified. Prefer `engine_config` for new code. use_hpip: When `engine` is `None`, if `True`, resolves to `engine='hpi'`. Ignored when `engine` is set. hpi_config (Optional[Union[Dict[str, Any], HPIConfig]]): HPI configuration. Used when `engine='hpi'` and `engine_config` is not specified. Prefer `engine_config` for new code. genai_config (Optional[Union[Dict[str, Any], GenAIConfig]]): GenAI configuration. Mainly used when `engine='genai_client'` and `engine_config` is not specified. Prefer `engine_config` for new code. Returns: A predictor instance. Nz`use_hpip` only takes effect when `engine` is None. Since engine=%r is explicitly set, use_hpip will be ignored. To use HPI, pass engine='hpi' instead.)r=rMrrr`)rr=rM)rr=rrrrMrrrE)rrvrJrrZr_rIrrrr{reZensure_model_filesZensure_environmentrZto_predictor_configrr)r=rMrarHrrrr|rr}kwargsrYZresolved_configZrequested_engineZpredictor_bindingZ need_localZconfig_to_validaterrrrrErErFcreate_predictords| 5    r)r=r>r?r@)r=r>rHr>r?r)r=r>rMrNr?r)r=r>r?r>)r=r>rHr>rMrNr?rW)r=r>r?r[)rHr>r?r) rHr>rbrcr=rNrarNr?rd)r?rg)rHr>rbrdr?rd)rHr>rbrzr?rz) r=r>rHrNr|r[r}r~r?r>)rHr>r?rz) rrr=r>rMrNrYrr?r)rr[r=r>rMrr?r) rrrrr=r>rMrrrrrd)rrrrr=r>rrrrdrrdrMrrrr?rd)r=r>rMrNrarNrHrNrrrrrrr|r[rrr}r~r?r+)w __future__rcollections.abcr functoolsrpathlibrtypingrrrr r Zpydanticr utilsr rZutils.official_modelsrZanomaly_detectionrZbindingsrrrrrZ common.genairrrZdoc_vlmrrrZ face_featurerZformula_recognitionrZimage_classificationrZ image_featurer Zimage_multilabel_classificationr!Zimage_unwarpingr"Zinstance_segmentationr#Zkeypoint_detectionr$Zlayout_analysisr%Zm_3d_bev_detectionr&Zmultilingual_speech_recognitionr'Zobject_detectionr(Zopen_vocabulary_detectionr)Zopen_vocabulary_segmentationr*Z predictorsr+r,r-Z runners.hpir.Zrunners.paddle_static.configr/Zsemantic_segmentationr0Ztable_structure_recognitionr1Ztext_detectionr2Ztext_recognitionr3Ztext_to_pinyinr4Ztext_to_speech_acousticr5Ztext_to_speech_vocoderr6Zts_anomaly_detectionr7Zts_classificationr8Zts_forecastingr9Zutils.model_pathsr:Zvideo_classificationr;Zvideo_detectionr<rGrIZutils.model_resolverrJrRrVrZr]r_rerjryr{rrrrrrrrErErErFs                                               +     &