o )j@shddlZddlZddlZddlmZddlmZmZmZddl Z ddl m Z e Z dZ GdddZdS)N)Path)DictOptionalUnion) get_loggerz.ms_upload_cachec @seZdZdZdeeeffddZedede de defd d Z dede de de e fd d Zdede de d e fddZddZddZdS)UploadHashCachearPersistent local hash cache for upload_folder resume. Stores SHA256 hashes keyed by (relative_path, mtime, size) to skip re-hashing unchanged files on retry/resume. Thread-safe for concurrent put() calls from multiple upload threads. Cache is stored as JSON at {folder_path}/.ms_upload_cache, co-located with the upload source for portability. cache_pathcCs&t||_i|_t|_|dS)z}Initialize cache. Args: cache_path: Path to the cache file (typically folder/.ms_upload_cache). N)r _cache_path_cache threadingLock_lock_load)selfrr\/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/modelscope/hub/upload_cache.py__init__s   zUploadHashCache.__init__rel_pathmtimesizereturncCs|d|d|S)z*Build cache lookup key from file metadata.|r)rrrrrr _make_key(szUploadHashCache._make_keycCs`||||}|j|j|}Wdn1swY|dur&dS||d|ddS)aFReturn cached hash info or None if not cached / stale. Args: rel_path: Relative path of the file within the upload folder. mtime: File modification time (os.stat st_mtime). size: File size in bytes. Returns: Dict with file_hash and file_size, or None. N file_hash file_size)Zfile_path_or_objrr)rr r get)rrrrkeyentryrrrr-s zUploadHashCache.get hash_infocCsV||||}|d|dd}|j||j|<WddS1s$wYdS)aStore hash info for a file. Thread-safe. Args: rel_path: Relative path of the file. mtime: File modification time. size: File size in bytes. hash_info: Dict from compute_file_hash with file_hash and file_size. rr)rrN)rr r )rrrrrrrrrrputDs  "zUploadHashCache.putc CsNz|jjjddd|j t|j}Wdn1swYtjt|jjdd\}}z)t j |ddd}t ||Wdn1sIwYt |t|jWn tyet |wtd t|d |j|jstd |jWdSWdSty}ztd |jd |WYd}~dSd}~ww)zPersist cache to disk via atomic write (temp file + rename). Safe against crashes -- either the old or new file is present, never a partial write. T)parentsexist_okNz.ms_upload_cache_tmp_)dirprefixwzutf-8)encodingzHash cache saved: z entries -> z&Hash cache file not found after save: zFailed to save hash cache to z: )r parentmkdirr dictr tempfilemkstempstrosfdopenjsondumpreplace BaseExceptionunlinkloggerinfolenexistswarning Exception)rdatafdZtmp_pathferrrsaveUs@        zUploadHashCache.savec Cs|jsdSz.t|jd}t||_Wdn1swYtdt|jd|jWdSt yS}zt d|i|_WYd}~dSd}~ww)z8Load cache from disk. Tolerates missing or corrupt file.NrzHash cache loaded: z entries from z+Failed to load hash cache, starting fresh: ) r r6openr.loadr r3r4r5r8r7)rr;r<rrrrss  zUploadHashCache._loadN)__name__ __module__ __qualname____doc__rr+rr staticmethodfloatintrrr(rrr=rrrrrrs   r)r,r)r pathlibrtypingrrrr.Zmodelscope.utils.loggerrr3ZUPLOAD_HASH_CACHE_FILErrrrrs