o
Rh6
@ s d Z dZdZz>ddlmZmZmZmZmZm Z m
Z
m Z m Z m
Z
mZmZmZmZmZmZmZmZmZmZmZmZmZmZm Z m Z m Z dZ W n e yX Z! ze!Z W Y dZ![!ndZ![!ww ddl"m#Z# e rce ddl$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z* zdd l+m,Z, W n e-y Y nw e#. \Z/Z0Z1e0re0Ze#2 d
e3fd d Z4dd
e3d
e3dB fddZ5d de6de6de6fddZ7dd Z8d de6de6de6fddZ9dS ) a
ONNX Runtime is a performance-focused scoring engine for Open Neural Network Exchange (ONNX) models.
For more information on ONNX Runtime, please see `aka.ms/onnxruntime `_
or the `Github project `_.
z1.22.0 Microsoft )
ExecutionModeExecutionOrderGraphOptimizationLevel LoraAdapter
ModelMetadataNodeArgOrtAllocatorType OrtArenaCfg
OrtMemoryInfo
OrtMemTypeOrtSparseFormat
RunOptionsSessionIOBindingSessionOptions create_and_register_allocator create_and_register_allocator_v2disable_telemetry_eventsenable_telemetry_eventsget_all_providersget_available_providersget_build_info
get_deviceget_version_stringhas_collective_opsset_default_logger_severity set_default_logger_verbosityset_seedN)onnxruntime_validation)
AdapterFormatInferenceSession IOBinding OrtDeviceOrtValue SparseTensor ) experimental package_namec C s8 ddl m}m} z|| }W |S |y d }Y |S w )Nr )PackageNotFoundErrorversion)importlib.metadatar( r) )r' r( r) package_version r, V/home/air/sanwanet/backup_V2/venv/lib/python3.10/site-packages/onnxruntime/__init__.py_get_package_versionW s
r. directory_namec C s ddl m}m} |p | }z<|| }|jpg }|D ]}|jdr-||jv r-| j W S q|sC|D ]}|jdrB| j W S q2W d S W d S |yR Y d S w )Nr )r( distributionz __init__.py) r* r( r0 filesnameendswithpartslocateparent)r' r/ r( r0 root_directory_namedistr1 filer, r, r- _get_package_roota s,
r: T
is_windowscudacudnnc C s> | r g d}g d}ng d}dg}|r|ng |r | S g S )N))nvidiacublasbinzcublasLt64_12.dll)r> r? r@ zcublas64_12.dll)r> cufftr@ zcufft64_11.dll)r> cuda_runtimer@ zcudart64_12.dll))r> r= r@ z&cudnn_engines_runtime_compiled64_9.dll)r> r= r@ z!cudnn_engines_precompiled64_9.dll)r> r= r@ zcudnn_heuristic64_9.dll)r> r= r@ zcudnn_ops64_9.dll)r> r= r@ zcudnn_adv64_9.dll)r> r= r@ zcudnn_graph64_9.dll)r> r= r@ z
cudnn64_9.dll))r> r? libzlibcublasLt.so.12)r> r? rC zlibcublas.so.12)r>
cuda_nvrtcrC zlibnvrtc.so.12)r> curandrC zlibcurand.so.10)r> rA rC zlibcufft.so.11)r> rB rC zlibcudart.so.12)r> r= rC z
libcudnn.so.9r, )r; r< r= cuda_dll_pathscudnn_dll_pathsr, r, r- _get_nvidia_dll_pathsy s
rH c C s< ddl } ddl}ddl}ddlm} tt dt tr$tdt td| td g }| D ]-}|j d }|d ksD|
d
rat |d }|ra||vra| | t| d |j
d | q4t|d
krltd trg d}|D ](}|
dr}dnd} t|}
|
rt| d |
d t || qtt| d qt| dkrtd|jd n| dkrtd|jd | jdrdtfdd } ddl} | | }
td |
D ]}| |j rt|j qtr| jd r| jd rd
d lm } td! t| dS td" dS dS td# dS )$z$Print information to help debugging.r N)
distributionsz
version: z CUDA version used in build: z platform:z&
Python package, version and location:Name onnxruntime)z onnxruntime-zort-z==z at r% z[33mWARNING: multiple onnxruntime packages are installed to the same location. Please 'pip uninstall` all above packages, then `pip install` only one of them.[0m)torchznvidia-cuda-runtime-cu12znvidia-cudnn-cu12znvidia-cublas-cu12znvidia-cufft-cu12znvidia-curand-cu12znvidia-cuda-nvrtc-cu12znvidia-nvjitlink-cu12znvidia-r> z not installedWindowsz
Environment variable:
PATH=PATHLinuxz'
Environment variable:
LD_LIBRARY_PATH=LD_LIBRARY_PATHpsutilpathc s6 ddg}t rddddddg|}t fd d
|D S ) N vcruntime140msvcp140rA r? cudartnvrtcrE r= c 3 s | ]}| v V qd S Nr, ).0keywordrR r, r- s z:print_debug_info..is_target_dll..) cuda_versionany)rR target_keywordsr, rZ r-
is_target_dll s z'print_debug_info..is_target_dllz
List of loaded DLLs:cpuinfopy3nvml)get_device_infoz
Device information:zCplease `pip install py-cpuinfo py3nvml` to show device information.z0please `pip install psutil` to show loaded DLLs.) importlib.utilosplatformr* rI printr' __version__r\ metadata
startswithr: appendr) lenr. systemenvironutil find_specstrrQ Processgetpid memory_mapsrR lowertransformers.machine_inforb ) importlibrd re rI ort_packagesr8 packagelocationpackagesr/ r) r_ rQ prC rb r, r, r- print_debug_info sf
r| msvcc C s ddl }ddl}ddl}ddl}| dvrdS | dk}|rK|rKz|d |d | dkr8|d W n tyJ td td
Y nw t rRt
d s`| sV|r`td t d
dS t rkt
d rk| sm|smdS d} |rt d}
|
ozd|
v } d|j
v r| } |
rd|
v r| std|
dt d | r|du rtdd} | r|j| d}|pd}
|j|
s|j|jt|
}
|j|
}
|j|
std| d| rtd dS t|| |}g }|D ]J}|r|j|
|d n |jj|
g|R }|j|r.z||}||d W q ty- } ztd| d | W Y d}~qd}~ww qd}|D ]5}|d }||vrgz||}W q3 tyf } zd }td| d | W Y d}~q3d}~ww q3|rrtd dS dS ) aE Preload CUDA 12.x and cuDNN 9.x DLLs in Windows or Linux, and MSVC runtime DLLs in Windows.
When the installed PyTorch is compatible (using same major version of CUDA and cuDNN),
there is no need to call this function if `import torch` is done before `import onnxruntime`.
Args:
cuda (bool, optional): enable loading CUDA DLLs. Defaults to True.
cudnn (bool, optional): enable loading cuDNN DLLs. Defaults to True.
msvc (bool, optional): enable loading MSVC DLLs in Windows. Defaults to True.
directory(str, optional): a directory contains CUDA or cuDNN DLLs. It can be an absolute path,
or a path relative to the directory of this file.
If directory is None (default value), the search order: the lib directory of compatible PyTorch in Windows,
nvidia site packages, default DLL loading paths.
If directory is empty string (""), the search order: nvidia site packages, default DLL loading paths.
If directory is a path, the search order: the directory, default DLL loading paths.
r N)rM rO rM zvcruntime140.dllz msvcp140.dllARM64zvcruntime140_1.dllz]Microsoft Visual C++ Redistributable is not installed, this may lead to the DLL load failure.zGIt can be downloaded at https://aka.ms/vs/17/release/vc_redist.x64.exe.z12.z[33mWARNING: z is not built with CUDA 12.x support. Please install a version that supports CUDA 12.x, or call preload_dlls with cuda=False and cudnn=False.[0mFrL z+cu12z+cuz$[33mWARNING: The installed PyTorch zX does not support CUDA 12.x. Please install PyTorch for CUDA 12.x to be compatible with z.[0mrC z..z Invalid parameter of directory=z . The directory does not exist!z9Skip loading CUDA and cuDNN DLLs since torch is imported.zFailed to load z: Tz\Please follow https://onnxruntime.ai/docs/install/#cuda-and-cudnn to install CUDA and CuDNN.)ctypesrd re sysrl CDLLmachineOSErrorrf r\ ri r' r. modulesr: rR joinisabsdirname__file__normpathisdir RuntimeErrorrH isfilerj Exception)r< r= r} directoryr rd re r r; is_cuda_cudnn_imported_by_torch
torch_versionis_torch_for_cuda_12
torch_rootbase_directory dll_paths loaded_dlls
relative_pathdll_path_e has_failure dll_filenamer, r, r- preload_dlls s
" r rW )TT)TTTN):__doc__rg
__author__ onnxruntime.capi._pybind_stater r r r r r r r
r r r
r r r r r r r r r r r r r r r r import_capi_exceptionr r onnxruntime.capir 1onnxruntime.capi.onnxruntime_inference_collectionr r r! r" r# r$ r& ImportError!get_package_name_and_version_infor' r) r\ check_distro_inforp r. r: boolrH r| r r, r, r, r- s8 t
% S