o 3Ih$@s:ddlZddlmZmZmZmZddlmZmZddl m Z m Z ddl m mZddlmZddlmZddlmZmZmZddlZddlmZddlZdd lmZmZmZmZm Z dd l!m"Z"dd l#m$Z$ddl%Z%dd l&m'Z'dd l(m)Z)ddl*m+Z+ddl,m-Z-e.e/Z0Gdddej1Z1GdddeeeZ2dS)N) ConnectionLockPool PerThreadPoolPool) MigratableDB Migration)SystemSettings)SqlEmbeddingsQueue)SqlSysDB)OpenTelemetryClientOpenTelemetryGranularity trace_method)override)SequencecastOptionalTypeAny)Literal) TracebackTypeUUID)local)files) Traversablec @sveZdZUeed<eed<dedefddZede j fdd Z ed e e ed e ed e eded fddZdS) TxWrapper_conn_pool conn_poolstackcCs||_||_||_dSN) _tx_stackconnectrr)selfrr r%W/home/air/sanwanet/gpt-api/venv/lib/python3.10/site-packages/chromadb/db/impl/sqlite.py__init__ s  zTxWrapper.__init__returncCs@t|jjdkr|jd|jd|jj||jS)NrPRAGMA case_sensitive_like = ONzBEGIN;)lenr"r rexecuteappendcursorr$r%r%r& __enter__%s    zTxWrapper.__enter__exc_type exc_value tracebackFcCsZ|jjt|jjdkr|dur|jn|j|j|j |jdS)NrF) r"r popr*rcommitrollbackr-closerreturn_to_pool)r$r0r1r2r%r%r&__exit__-s   zTxWrapper.__exit__N)__name__ __module__ __qualname__r__annotations__rrr'rbaseCursorr/rr BaseExceptionrrr8r%r%r%r&rs  rcseZdZUeed<eed<eeed<eed<e ed<e ed<de ffdd Z e d ejed3fd d Ze dejed3fdd Zeed eejfddZeed efddZeed efddZed eefddZed efddZe dejed3fdd Ze dejed3ddZe dejed e fddZe d ejed!ed ee fd"d Z!ed#e"j#d$e d d fd%d&Z$eed'e%e&d e%e'fd(d)Z(eed*e%e'd e%e&fd+d,Z)eed ee*fd-d.Z+d4d0e,d d fd1d2Z-Z.S)5SqliteDB _conn_pool _settings_migration_imports_db_filer"_is_persistentsystemcs|j|_tdtdtdg|_|jd|_|t|_|js,d|_t |jdd|_ n"|jdd |_t j |jsHt jt j |jdd t|j|_ t|_t|dS) Nz$chromadb.migrations.embeddings_queuezchromadb.migrations.sysdbzchromadb.migrations.metadb is_persistentzfile::memory:?cache=sharedT)is_uripersist_directoryz/chroma.sqlite3)exist_ok)settingsrBrrCrequirerEr _opentelemetry_clientrDrrAospathexistsmakedirsdirnamerrr"superr')r$rF __class__r%r&r'Gs"  zSqliteDB.__init__zSqliteDB.startr(Ncst|}|d|dWdn1swY||jddkr?|jdj durAt ddSdSdS)NzPRAGMA foreign_keys = ONr) migrationsapplyautomatically_purgeFu⚠️ It looks like you upgraded from a version below 0.5.6 and could benefit from vacuuming your database. Run chromadb utils vacuum --help for more information.) rSstarttxr+initialize_migrationsrBrLconfig get_parametervalueloggerwarnr$currTr%r&rYas    z SqliteDB.stopcst|jdSr!)rSstoprAr6r.rTr%r&rcss cCtjSr!)pypikaQueryr%r%r%r& querybuilderyzSqliteDB.querybuildercCdS)N?r%r%r%r%r&parameter_format~zSqliteDB.parameter_formatcCri)Nsqliter%r%r%r%r&migration_scoperlzSqliteDB.migration_scopecCs|jSr!)rCr.r%r%r&migration_dirsszSqliteDB.migration_dirscCs$t|jds g|j_t|j|jdS)Nr )r )hasattrr"r rrAr.r%r%r&rZs z SqliteDB.txzSqliteDB.reset_statecs|jds td|}|d|D] }|d|dqWdn1s/wY|j|t dS)N allow_resetzResetting the database is not allowed. Set `allow_reset` to true in the config in tests or other non-production environments where reset should be permitted.zo SELECT name FROM sqlite_master WHERE type='table' zDROP TABLE IF EXISTS r) rBrL ValueErrorrZr+fetchallrAr6rYrS reset_state)r$rbrowrTr%r&rts    zSqliteDB.setup_migrationscCs8|}|dWddS1swYdS)Na~ CREATE TABLE IF NOT EXISTS migrations ( dir TEXT NOT NULL, version INTEGER NOT NULL, filename TEXT NOT NULL, sql TEXT NOT NULL, hash TEXT NOT NULL, PRIMARY KEY (dir, version) ) )rZr+rar%r%r&setup_migrationss "zSqliteDB.migrations_initializedcCs\| }|d|ddkr WddS WddS1s'wYdS)Nz[SELECT count(*) FROM sqlite_master WHERE type='table' AND name='migrations'rFT)rZr+fetchonerar%r%r&migrations_initializeds  $zSqliteDB.db_migrationsdirc Cs|M}|d|jfg}|D]4}tt|d}tt|d}tt|d}tt|d}tt|d} |t||||| | dq|WdS1sTwYdS)Nz SELECT dir, version, filename, sql, hash FROM migrations WHERE dir = ? ORDER BY version ASC r)ryversionfilenamesqlhashscope) rZr+namersrstrintr,rrn) r$ryrbrVru found_dir found_versionfound_filename found_sql found_hashr%r%r& db_migrationss0   $rb migrationc Cs<||d|d|d|d|d|d|dfdS)Nrzw INSERT INTO migrations (dir, version, filename, sql, hash) VALUES (?, ?, ?, ?, ?) ryr~rr) executescriptr+)r$rbrr%r%r&apply_migrationszSqliteDB.apply_migrationr^cC|durt|SdSr!r)r^r%r%r& uuid_from_dbzSqliteDB.uuid_from_dbuuidcCrr!)r)rr%r%r& uuid_to_dbrzSqliteDB.uuid_to_dbcCrdr!)sqlite3IntegrityErrorr%r%r%r&unique_constraint_errorrhz SqliteDB.unique_constraint_errortimeoutcCs:|j}|dt|d|d|ddS)zdRuns VACUUM on the database. `timeout` is the maximum time to wait for an exclusive lock in seconds.zPRAGMA busy_timeout = iVACUUMz} INSERT INTO maintenance_log (operation, timestamp) VALUES ('vacuum', CURRENT_TIMESTAMP) N)rAr#r+r)r$rconnr%r%r&vacuums  zSqliteDB.vacuum)r(N)r)/r9r:r;rr<r rrrrboolrr'rr ALLrrYrc staticmethodrrerfrgrkrnrorrZrtrvrxrrr=r>rrrrrrr?rrr __classcell__r%r%rTr&r@?sf        r@)3loggingchromadb.db.impl.sqlite_poolrrrrchromadb.db.migrationsrrchromadb.configrr chromadb.db.basedbr=#chromadb.db.mixins.embeddings_queuer chromadb.db.mixins.sysdbr chromadb.telemetry.opentelemetryr r rr overridesrretypingrrrrrtyping_extensionsrtypesrrNrr threadingrimportlib_resourcesrimportlib_resources.abcr getLoggerr9r_rr@r%r%r%r&s,          #