o \h @s@ddlZddlmZddlmZddlmZGdddeZdS) N)AbstractFileSystem)infer_storage_options) MemoryFilecseZdZdZdZdZdZ     dfdd Zedd Z d d Z d d Z e ddZ eddZdddZdddZdddZZS) GistFileSystema9 Interface to files in a single GitHub Gist. Provides read-only access to a gist's files. Gists do not contain subdirectories, so file listing is straightforward. Parameters ---------- gist_id : str The ID of the gist you want to access (the long hex value from the URL). filenames : list[str] (optional) If provided, only make a file system representing these files, and do not fetch the list of all files for this gist. sha : str (optional) If provided, fetch a particular revision of the gist. If omitted, the latest revision is used. username : str (optional) GitHub username for authentication (required if token is given). token : str (optional) GitHub personal access token (required if username is given). timeout : (float, float) or float, optional Connect and read timeouts for requests (default 60s each). kwargs : dict Stored on `self.request_kw` and passed to `requests.get` when fetching Gist metadata or reading ("opening") a file. gistz&https://api.github.com/gists/{gist_id}z,https://api.github.com/gists/{gist_id}/{sha}Nc srt||_||_||_|du|duAr|s|rtd||_||_||_|dur-|nd|_ | |j d<dS)Nz2Auth requires both username and token, or neither.)<r ) super__init__gist_id filenamessha ValueErrorusernametoken request_kwtimeout_fetch_file_listdircache)selfr rrrrrkwargs __class__^/home/air/segue/gemini/backup/venv/lib/python3.10/site-packages/fsspec/implementations/gist.pyr (s zGistFileSystem.__init__cCs0|jdur|jdurd|j|jfi|jS|jS)z?Auth parameters passed to 'requests' if we have username/token.Nauth)rrr)rrrrkwCszGistFileSystem.kwcCs||jr|jj|j|jd}n|jj|jd}tj|fd|ji|j}|j dkr6t d|jd|jp2d| | S)z[ Fetch the JSON metadata for this gist (possibly for a specific revision). )r r)r rzGist not found: @latest) r gist_rev_urlformatr gist_urlrequestsgetrr status_codeFileNotFoundErrorraise_for_statusjson)rurlrrrr_fetch_gist_metadataJs z#GistFileSystem._fetch_gist_metadatac Cs|}|jr$|di}i}|jD]}||vrt|||||<qn|di}g}|D]\}}|dur9q0||d|dd|ddq0|S)zz Returns a list of dicts describing each file in the gist. These get stored in self.dircache[""]. filesNfilesizerraw_url)nametyper0r1)r-rr&r(itemsappend)rmetaavailable_filesr.fnoutfnamefinforrrr[s,    zGistFileSystem._fetch_file_listcCst|d|}|dS)z= Remove 'gist://' from the path, if present. path/)rr&lstrip)clsr<rrr_strip_protocol{s zGistFileSystem._strip_protocolcCst|}i}d|vr|dr|d|d<d|vr"|dr"|d|d<d|vr0|dr0|d|d<d|vr_|dr_|dddd d }t|dkr_|d rT|d |d <|d r_|d g|d<|S)z Parse 'gist://' style URLs into GistFileSystem constructor kwargs. For example: gist://:TOKEN@/file.txt gist://username:TOKEN@/file.txt rpasswordrhostr r<r=rNrrrr)rrsplitlen)r<sor9 path_partsrrr_get_kwargs_from_urlss      z$GistFileSystem._get_kwargs_from_urlsr Fc sd|pddkr|jd}n|jd}fdd|D}|s%t|r)|Stdd|DS)a List files in the gist. Gists are single-level, so any 'path' is basically the filename, or empty for all files. Parameters ---------- path : str, optional The filename to list. If empty, returns all files in the gist. detail : bool, default False If True, return a list of dicts; if False, return a list of filenames. r cg|] }|dkr|qSr2r.0fr<rr z%GistFileSystem.ls..css|]}|dVqdS)r2NrrKrrr sz$GistFileSystem.ls..)r@rr(sorted)rr<detailrresults all_filesrrNrlss   zGistFileSystem.lsrbc  s|dkrtd|fdd|jdD}|st|d}|d}|s1tdtj|fd |ji|j}|jd krGt| t d |j S) z3 Read a single file from the gist. rWz'GitHub Gist FS is read-only (no write).crIrJrrKrNrrrOrPz(GistFileSystem._open..r rr1zNo raw_url for file: rrN) NotImplementedErrorr@rr(r&r%rrr'r)rcontent) rr<mode block_sizermatchesr;r1r,rrNr_opens   zGistFileSystem._openraisec Ks|j||d}i}|D]A}z||d}|||<Wdn1s%wYWq tyL} z|dkr9| |dkr>n| ||<WYd} ~ q d} ~ ww|S)z Return {path: contents} for the given file or files. If 'recursive' is True, and path is empty, returns all files in the gist. ) recursiverWNr^omit) expand_pathopenreadr() rr<r_on_errorrpathsr9prMerrrcats"zGistFileSystem.cat)NNNNN)r F)rWN)Fr^)__name__ __module__ __qualname____doc__protocolr$r"r propertyrr-r classmethodr@ staticmethodrHrVr]rh __classcell__rrrrrs,     r)r%specrutilsrmemoryrrrrrrs