o viP@s\ddlZddlmZddlmZddlmZmZmZm Z ddl m Z ddl m Z dd lmZmZer8dd lmZed ZGd d d e ZedZeddGdddZdedeeeffddZdedeedefddZdededefddZdeed fd!eeefded"edef d#d$Zd%ed&edeed'eed(eedeeeff d)d*ZdS)+N) dataclass)Path) TYPE_CHECKINGLiteralOptional TypedDict) constants)repo_folder_name)git_hash sha_fileobj)RepoFilez^[0-9a-f]{40}$c@s.eZdZUeed<eed<eed<eed<dS)Mismatchpathexpectedactual algorithmN)__name__ __module__ __qualname__str__annotations__rrb/home/air/biblejyuku/back/venv/lib/python3.10/site-packages/huggingface_hub/utils/_verification.pyrs  r)sha256git-sha1T)frozenc@sJeZdZUeed<eed<eeed<eeed<eeed<eed<dS)FolderVerificationrevision checked_count mismatches missing_paths extra_paths verified_pathN) rrrrrintlistrrrrrrrs     rrootreturncsfdddDS)z] Return a mapping of repo-relative path -> absolute path for all files under `root`. cs$i|]}|r||qSr)is_file relative_toas_posix.0pr'rr +s$z'collect_local_files..*)rglobr/rr/rcollect_local_files'sr3storage_folderrcCs|r t|r |S|d}|d}|r.||}|r#|jddStd|d|d|d}|r>|jddS|sJtd |d d d |D}t|d kr]|dStd)zR Resolve a commit hash from a cache repo folder and an optional revision. refs snapshotszutf-8)encodingz Revision 'z1' could not be resolved in cache (expected file 'z').mainz+Cache repo is missing snapshots directory: z . Provide --revision explicitly.cSs&g|]}|rt|jr|jqSr)is_dir_REGEX_COMMIT_HASH fullmatchnamer,rrr Fs&z3_resolve_commit_hash_from_cache..r rzhAmbiguous cached revision: multiple snapshots found and no refs to disambiguate. Please pass --revision.) r:r;r) read_textstrip ValueErrorr9iterdirlen)r4rrefs_dir snapshots_dirref_pathmain_ref candidatesrrr_resolve_commit_hash_from_cache.s( rHrrcCsr|d*}|dkrt|WdS|dkr(t|WdStd|1s2wYdS)zM Compute the checksum of a local file using the requested algorithm. rbrNrzUnsupported hash algorithm: )openr hexr readr@)rrstreamrrrcompute_file_hashOs   rNremote_by_pathr local_by_pathr$c Cst|}t|}t||}t||}t||@}g} |D]T} || } || } t| dd} | dur8t| ddnd}|durHt| trH| d}|rSd}t|}n | j}d}t|}t | |}||krr| t | |||dqt |t || |||dS)zHCompare remote entries and local files and return a verification result.lfsNrr)rrrr)rr r!r"r#r$)setsortedgetattr isinstancedictgetrlowerblob_idrNappendrrrB)rOrPrr$ remote_paths local_pathsmissingextrabothr!rel_path remote_entry local_pathrQlfs_sharrrYrrrr verify_maps\s>       rdrepo_id repo_type cache_dir local_dirc Cs|durt|}|std|||ptjfSt|p#tj}|t||d}| s=td|dt ||}|d|} | sWtd|d| d | |fS) zW Resolve the root directory to scan locally and the remote revision to verify. Nz6Local directory does not exist or is not a directory: )rerfzRepo is not present in cache: z.. Use 'hf download' first or pass --local-dir.r6z0Snapshot directory does not exist for revision 'z': .) r expanduserresolver9r@r DEFAULT_REVISION HF_HUB_CACHEr existsrH) rerfrrgrhr' cache_rootr4commit snapshot_dirrrrresolve_local_roots     rr) re dataclassesrpathlibrtypingrrrrr file_downloadr shar r hf_apircompiler:rHashAlgorrVrr3rHrNrdtuplerrrrrrsR       !   0