o 3Ih@sdZddlZddlmZmZddlmZmZmZm Z ddl m Z gdZ GdddeZ Gd d d eZiZGd d d eZdS) z pygments.lexers.special ~~~~~~~~~~~~~~~~~~~~~~~ Special lexers. :copyright: Copyright 2006-2025 by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. N)Lexerline_re)TokenErrorTextGeneric)get_choice_opt) TextLexer OutputLexer RawTokenLexerc@sBeZdZdZdZdgZdgZdgZdZdZ dZ dd Z d d Z d S) r z3 "Null" lexer, doesn't highlight anything. z Text onlytextz*.txtz text/plaing{Gz?ccsdt|fVdSNr)rselfr rW/home/air/sanwanet/gpt-api/venv/lib/python3.10/site-packages/pygments/lexers/special.pyget_tokens_unprocessed"sz TextLexer.get_tokens_unprocessedcCstjS)N)r priority)r rrr analyse_text%szTextLexer.analyse_textN) __name__ __module__ __qualname____doc__namealiases filenames mimetypesurl version_addedrrrrrrrr s r c@s.eZdZdZdZdgZdZdZdZddZ d S) r zN Simple lexer that highlights everything as ``Token.Generic.Output``. z Text outputoutputr z2.10z output/outputccsdtj|fVdSr)rOutputrrrrr3sz"OutputLexer.get_tokens_unprocessedN) rrrrrrrr_examplerrrrrr )s r c@sBeZdZdZdZgZgZdgZdZdZ ddZ dd Z d d Z d S) r a Recreate a token stream formatted with the `RawTokenFormatter`. Additional options accepted: `compress` If set to ``"gz"`` or ``"bz2"``, decompress the token stream with the given compression algorithm before lexing (default: ``""``). zRaw token datazapplication/x-pygments-tokensz7https://pygments.org/docs/formatters/#RawTokenFormatterr cKs*t|dgdd|_tj|fi|dS)Ncompress)r nonegzbz2r )rr#r__init__)roptionsrrrr'KszRawTokenLexer.__init__ccs|jr?t|tr|d}z|jdkrddl}||}n|jdkr,ddl}||}Wnty>t| dfVYnwt|t rI| d}| dd}| |D] \}}}||fVqUdS)Nlatin1r%rr& ) r# isinstancestrencodegzip decompressr&OSErrorrdecodebytesstripr)rr r.r&itvrrr get_tokensPs*          zRawTokenLexer.get_tokensc csd}t|D]h}zH|dd\}}t|}|sCt}|ddd}|D]}|r5|ds9t dt ||}q+|t|<t |}t |tsQt dWntt fyc|}t}Ynw|||fV|t|7}qdS)Nr .zmalformed token namez expected str)rfinditergrouprstripsplit _ttype_cachegetrisupper ValueErrorgetattrast literal_evalr+r, SyntaxErrorrlen) rr lengthmatchttypestrvalttypettypesttype_rrrres2     z$RawTokenLexer.get_tokens_unprocessedN) rrrrrrrrrrr'r7rrrrrr :s  r )rrDpygments.lexerrrpygments.tokenrrrr pygments.utilr__all__r r r?r rrrrs