o )j$M @sddlZddlZddlZddlZddlZddlZddlmZddlmZddl m Z m Z m Z m Z ddlmZmZmZmZddlmZmZmZmZmZmZmZddlmZeZdd Zd d Zdod dZ de e!e e!ffddZ"  dpde e e!de e e!de e!fddZ#ddZ$de%de!fddZ&de!de%fddZ'de!de!fdd Z(dqd!e e!fd"d#Z)d$d%Z*dod&d'Z+  drd(e e!d)e,de!fd*d+Z-d,d-Z.de,fd.d/Z/  0dsd1e!d2e e!d3e e!ddfd4d5Z0d6Z1d7e2de!fd8d9Z3d:e e e e!e%fd;e e!de!fdd?Z5ej6dd@dAe e!efdBe e2de eddffdCdDZ7 EdtdFe e%e!efdGe!de efdHdIZ8idJdKdLdMdNdOdPdQdRdSdTdSdUdVdWdXdYdZd[d\d]d^d_d^d`dadbdcdddedfdgdhdidjdkiZ9dle!de!fdmdnZ:dS)uN)datetime)Path) GeneratorListOptionalUnion) BaseFileLockFileLock SoftFileLockTimeout)DEFAULT_MODELSCOPE_DOMAINDEFAULT_MODELSCOPE_GROUPDEFAULT_MODELSCOPE_INTL_DOMAINMODEL_ID_SEPARATORMODELSCOPE_DOMAINMODELSCOPE_SDK_DEBUGMODELSCOPE_URL_SCHEME) get_loggercCs<t|vr|td}|td}||fSt}|}||fS)Nr)rsplitr )model_idZgroup_or_ownernamer[/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/modelscope/hub/utils/utils.pymodel_id_to_group_owner_namesrcCstj|d}|dkS)Ntrue)osenvirongetstriplower)var_namevaluerrr is_env_true$sr$TcCs*ttjvrttrttS|rtStSN)rrrgetenvr rcn_siterrr get_domain)s  r) raw_inputcCsd}t|tr#t}d|vrdd|dD}|S|||St|trNt}|D] }t|trMd|vrF|dd|dDq-||q-|S)N,cSg|]}|qSrr ).0srrr 7z$convert_patterns..cSr,rr-)r.ssrrrr0?r1) isinstancestrlistrappendr extend)r*outputr/rrrconvert_patterns2s"    r9allow_file_patternallow_patternsreturnc sg}|r |||r|||sdSg}|D]>}t|}dD]}||}|dkr0t||}q |d|}|d} | dkrV|d| tfdddDsV|q|s[dSt|dkre|dSd d |D} g} t| D]} tt| dkr| | dqr| sdSd | S) aZExtract common directory prefix from include patterns for server-side filtering. Only processes allow/include patterns (ignore/exclude is irrelevant for prefix). Returns None if no meaningful prefix can be extracted. Algorithm: 1. Merge allow_file_pattern and allow_patterns into one list 2. For each pattern, find position of first wildcard char (* ? [) 3. Extract text before that position, then take directory part (up to last '/') 4. Find longest common directory prefix (path-segment-aware) 5. Return None if no valid common prefix Examples: ['TacExo/*'] -> 'TacExo' ['data/train/*.parquet'] -> 'data/train' ['data/train/*', 'data/valid/*'] -> 'data' ['*.safetensors'] -> None ['TacExo/*', 'OtherDir/*'] -> None (no common prefix) ['data/*/train.csv'] -> 'data' N)*?[/rc3s|]}|vVqdSr%r)r.cZdir_partrr xsz-extract_root_from_patterns..rcSsg|]}|dqS)rA)r)r.drrrr0sz.extract_root_from_patterns..) r7lenfindminrfindanyr6zipsetjoin) r:r;patternsZextracted_dirspatternZfirst_wildcardwcposprefixZlast_sep split_pathsZcommon_segmentssegmentsrrCrextract_root_from_patternsEsF           rUcCsDtjdr |dd}n|dd}tj|d|dd}|S)Nwin\rAr.Z___)sysplatform startswithrsplitrpathrMreplace) directoryrpartsZmasked_directoryrrrget_model_masked_directorys  rb size_bytescCsZddl}|dkr dSd}t|||d}|d|}t||d}|d||S)NrZ0B) BZKBMBGBTBPBEBZBYBirX )mathintfloorlogpowround)rcrmZ size_nameipr/rrrconvert_readable_sizes ru folder_pathcCs2d}t|dD] }|r||j7}q |S)Nrr=)rrglobis_filestatst_size)rvZ total_sizer^rrrget_folder_sizes r{cCstt|dS)Nrv)rur{r|rrrget_readable_folder_sizesr}rcCsDtdd}tdtj|d}|dur|Stj||dS)zcache dir precedence: function parameter > environment > ~/.cache/modelscope/hub Args: model_id (str, optional): The model id. Returns: str: the model_id dir if model_id not None, otherwise cache root dir. z.cache modelscopeZMODELSCOPE_CACHEZhubNrA)rhomejoinpathrr&r^rM)rZdefault_cache_dir base_pathrrr get_cache_dirs rcCsLttjvrttt}|Sddlm }ttt |j d}|S)Nr)version%Y-%m-%d %H:%M:%S) rrrrnrrrnow timestampr~rstrptimeZ__release_datetime__)rtrrrrget_release_datetimes  rcCs tt|Sr%)rr)r'rrr get_endpoints r cli_endpointr(cCsN|dur t|dS|d}|st|dS|ds%|ds%t|}|S)aResolve the ModelScope API endpoint with automatic scheme completion. Priority (highest to lowest): 1. ``cli_endpoint`` (explicit CLI --endpoint argument) 2. Environment variable ``MODELSCOPE_DOMAIN`` 3. Built-in default (https://www.modelscope.cn) Scheme auto-completion: If the resolved value does not start with ``http://`` or ``https://``, ``https://`` is prepended automatically so that callers may pass bare domain names such as ``modelscope.ai``. Args: cli_endpoint: Value from the CLI ``--endpoint`` flag. When *None*, the function falls back to :func:`get_endpoint`. cn_site: Forwarded to :func:`get_endpoint` when *cli_endpoint* is *None*. ``True`` selects the Chinese site, ``False`` the international site. Returns: A fully-qualified endpoint URL, e.g. ``https://www.modelscope.cn``. Nr'rAzhttp://zhttps://)rr rstripr\r)rr(Zendpointrrrresolve_endpoints  rcCsbd}t}t|d} ||}|sn||q Wd|S1s(wY|S)Nirb)hashlibsha256openreadupdate hexdigest) file_path BUFFER_SIZEZ sha256_hashfdatarrr compute_hashs    rcCs:t|}||kst|d|||f}t|dSdS)zValidate the file hash is expected, if not, delete the file Args: file_path (str): The file to validate expected_sha256 (str): The expected sha256 hash Returns: bool: True if the file is valid, False otherwise zFile %s integrity check failed, expected sha256 signature is %s, actual is %s, the download may be incomplete, please try again.FT)rrremoveloggererror)rZexpected_sha256Z file_sha256msgrrrfile_integrity_validations   rF file_namerNcommit_messagec Csbt|tr|g}|durd|dd|}|j}tj||}tj|rBt|ddd }|}Wdn1s..)max)r.colrrrr0bsztabulate..z{{:{}}} cSsg|]}d|qS)-r)r.rrrrr0fr1r)rKrFformatr6rM)rrZ col_widthsZ row_formatlinesrowrrrtabulate[s rcCs.|}|dvr dS|dvrdStd|)N>1yesonytrr>offnfalseno0rrzinvalid truth value )r! ValueError)valrrr strtoboolms rtimeout lock_filerccsd}t||d}t} t|}|dur"||kr"tt|z|j|r.t|||n|dWnityMtd|dt|ddYnQtyq}zdt|vrlt d |t ||d}WYd}~q d}~wt y}z |j t j t jt jfvrt d |j |t ||d}WYd}~q d}~wwnqz*|VWz|WdSt yz t|WYdSt yYnwYdSwz|Wwt yz t|WYwt yYYwww) NrrTz!Still waiting to acquire lock on z (elapsed: z.1fz seconds)zuse SoftFileLock insteadzPFileSystem does not appear to support flock. Falling back to SoftFileLock for %szCEncountered OSError (errno=%d) on %s, Falling back to SoftFileLock.)r rr r4acquirerHrinfoNotImplementedErrorwarningr OSErrorerrnoZESTALEENOENTZ EREMOTEIOreleaserunlink)rrZdefault_intervallock start_timeZ elapsed_timerrrrweak_file_lockvs|          !     r Asia/Shanghai time_stamp time_zonec Csddl}|sdSt|tr|St|trzv|dr`d|vr'|ddd}n|ddd\}}|dddd}|d|d}t|d j| d d }|d kr]| | |}|WSgd }|D]}zt||j| |d WWSt yYqfwt d |dt y}z t d|d|d}~wwt|t rztj || d d | |WSt tfy}z t d|d|d}~wwtdt|d)a>Convert a UNIX/string timestamp to a timezone-aware datetime object. Args: time_stamp: UNIX timestamp (int), ISO string, or datetime object time_zone: Target timezone for non-UTC timestamps (default: 'Asia/Shanghai') Returns: Timezone-aware datetime object or None if input is None rNZrYr@z.000000Zrrz%Y-%m-%dT%H:%M:%S.%fZUTC)tzinfo)z%Y-%m-%dT%H:%M:%S.%fz%Y-%m-%dT%H:%M:%Sz%Y-%m-%d %H:%M:%S.%frzUnsupported timestamp format: ''zCannot parse 'zr' as a datetime. Expected formats: 'YYYY-MM-DDTHH:MM:SS[.ffffff]Z' (UTC) or 'YYYY-MM-DDTHH:MM:SS[.ffffff]' (local))tzzCannot convert 'z2' to datetime. Ensure it's a valid UNIX timestamp.zUnsupported type 'z"'. Expected int, str, or datetime.)zoneinfor3rr4rrljustrr_ZZoneInfo astimezonerrn fromtimestampr TypeErrortype) rrrbaseZfractiondtformatsfmtrrrrconvert_timestamps           rz.webpz image/webpz.avifz image/avifz.heicz image/heicz.heifz image/heifz.jpgz image/jpegz.jpegz.pngz image/pngz.gifz image/gifz.bmpz image/bmpz.svgz image/svg+xmlz.tiffz image/tiffz.tifz.icoz image/x-iconz.mp4z video/mp4z.webmz video/webmz.avizvideo/x-msvideoz.movzvideo/quicktimez.mkvzvideo/x-matroskamedia_file_pathcCsddl}ddl}tj|}tj|std|tj|s(td|| |\}}|s>t tj |d }|sGtd|t|d}|}||d}Wdn1scwYd |d |S) aB Encode image or video file to base64 string. Args: media_file_path (str): Path to the image or video file Returns: str: Base64 encoded string with data URL prefix Raises: FileNotFoundError: If image/video file doesn't exist ValueError: If file is not a valid format rNzImage file not found: zPath is not a file: rzFile is not a valid format: rrzdata:z;base64,)base64 mimetypesrr^ expanduserrFileNotFoundErrorisfiler guess_type_FALLBACK_MIME_TYPESrsplitextr!rr b64encodedecode)rrrZ mime_type_Z media_fileZ image_dataZ base64_datarrrencode_media_to_base64s&    r )T)NNr%)NT)NF)r); contextlibrrrrZrrpathlibrtypingrrrrfilelockrr r r Zmodelscope.hub.constantsr r rrrrrZmodelscope.utils.loggerrrrr$r)r4r9rUrbrnrur{r}rrrboolrrrrrfloatrrrcontextmanagerrrrr rrrrs  $      O      #  ( *    6 Q