o vik@sdZddlZddlZddlZddlmZddZ          ddeejBej Bd eejBd e d e d e d edBde de de edBde edBde e eefdBde de fddZedkreZeejejejejejejejejejejejejd dSdS)z@Provide entry point to preprocess ONNX model especially for QNN.N)qnncCstjdd}|jddddd|jdd dd d|jd d d d|jdd dd|jddd|jddtdd|jdd dd|jdd dd|jddddd |jd!ddd"d |jd#d$d%tdd&d'|jd(d d)d|S)*zParse cmdline arguments.z#Arguments for QNN model preprocess.) descriptionz--input_model_pathz-iTzPath to the input ONNX model.)requiredhelpz--output_model_pathz-ozPath to the output ONNX model.z--save_as_external_data store_truez;Whether the output model would be saved with external data.)actionrz--all_tensors_to_one_filezgWhether to save all external data in one file or save each tensor to a file named with the tensor name.z--external_data_locationzbFilename of the external file where all tensors are saved. The path is relative to the model path.)rz--external_data_size_thresholdzQTensors with data size larger than this threshold are converted to external data.)defaulttyperz!--external_data_convert_attributezKWhether to save all tensors, including attribute tensors, to external data.z--fuse_layernormzLWhether to fuse matched sequences into LayerNormalization nodes if possible.z--inputs_to_make_channel_last+Nz=List of graph input names to be transposed into channel-last.)nargsr rz--outputs_to_make_channel_lastz>List of graph output names to be transposed into channel-last.z--dynamic_input_shapesappendzdModel input name and desired static shape in comma seprated format, for example: 'input' 1,3,256,256)r rr r rz --exclude_initializer_from_inputzBWhether to exclude initializer from input if model.ir_version >= 4)argparseArgumentParser add_argumentintstr parse_args)parserr_/home/air/biblejyuku/back/venv/lib/python3.10/site-packages/onnxruntime/tools/qnn/preprocess.py_parse_argumentssv  rFr model_input model_outputfuse_layernormsave_as_external_dataall_tensors_to_one_fileexternal_data_locationexternal_data_size_thresholdexternal_data_convert_attributeinputs_to_make_channel_lastoutputs_to_make_channel_lastdynamic_input_shapesexclude_initializer_from_inputreturnc Cs"tj|||||||||| | | d S)a<Preprocess ONNX model for QNN. Args: model_input: A path or ONNX ModelProto specifiying the model to be preprocessed. model_output: A path specifying where the preprocessed model to be saved. fuse_layernorm: A bool specifying whether to fuse the matched sequence into a single LayerNormalization node. Defaults to False. save_as_external_data: A bool specifying whether to save model with external data. Defaults to False. all_tensors_to_one_file: A bool specifying whether to save all external data in one file or save each tensor to a file named with the tensor name. This argument is effective only when `save_as_external_data` is True. Defaults to False. external_data_location: A str specifying where to save the external data. The path is relative to the model path. This argument is effective only when `save_as_external_data` is True. Defaults to the model name. external_data_size_threshold: An int specifying the threshold of data size for tensors be saved as external data. This argument is effective only when `save_as_external_data` is True. Defaults to 1024. external_data_convert_attribute: A bool specifying whether to save all tensors including attributes as external data. This argument is effective only when `save_as_external_data` is True. Defaults to False. inputs_to_make_channel_last: A list of strs specifying graph input names to be transposed into channel-last. Defaults to None. outputs_to_make_channel_last: A list of strs specifying graph output names to be transposed into channel-last. Defaults to None. dynamic_input_shapes: A list of tuples specifying model input name to and its static shape in comma seprated format, for example: [('input', '1,3,256,256')]. Defaults to None. exclude_initializer_from_input: A bool specifying whether to exclude initializer from input. Defaults to False. Returns: A bool indicating whether the model is modified. rrrrrr r!r"r#r$)rqnn_preprocess_model) rrrrrrrr r!r"r#r$rrrr'\s*r'__main__r&) FFFNrFNNNF)__doc__rpathlibonnx,onnxruntime.quantization.execution_providersrrrPath ModelProtoboolrlisttupler'__name__argsinput_model_pathoutput_model_pathrrrrrr r!r"r#r$rrrrsx O     :