o ?HhR@svdZddlZddlZddlZddlmZddlZddlZ ddl m Z m Z m Z mZmZmZmZddlmZmZddlmZgdZejd kZdZdZd Zd Zd Zd ZededededededdgdddiZ eeeeeeeeeeed Z!dZ"dZ#d Z$ddddddZ%e"de#de$d iZ&e'ej(j)Z*Gd!d"d"Z+Gd#d$d$Z,Gd%d&d&e Z-d.d(d)Z.Gd*d+d+Z/Gd,d-d-Z0dS)/z1 Classes for read / write of matlab (TM) 4 files N)mul) MatFileReader docfillermatdims read_dtypeconvert_dtypes arr_to_charsarr_dtype_number)squeeze_elementchars_to_strings)reduce)MatFile4ReaderMatFile4WriterSYS_LITTLE_ENDIAN VarHeader4 VarReader4 VarWriter4 arr_to_2d mclass_infomdtypes_templatemiDOUBLEmiINT16miINT32miSINGLEmiUINT16miUINT8 mxCHAR_CLASS mxFULL_CLASSmxSPARSE_CLASS np_to_mtypes order_codeslittlef8f4i4i2u2u1header))moptr))mrowsr))ncolsr))imagfr))namlenr)U1) r'c32c24c16r(c8r)r*r+r,S1<>z VAX D-floatz VAX G-floatCray)rrr#r$r%doublecharsparsec@seZdZdZdZddZdS)rFcCs"||_||_||_||_||_dSN)namedtypemclassdims is_complex)selfr@rArBrCrDrFU/home/air/sanwanet/gpt-api/venv/lib/python3.10/site-packages/scipy/io/matlab/_mio4.py__init__^s  zVarHeader4.__init__N)__name__ __module__ __qualname__ is_logical is_globalrHrFrFrFrGrYs rc@sTeZdZdZddZddZdddZdd d Zd d Zd dZ ddZ ddZ dS)rz" Class to read matlab 4 variables cCs*||_|j|_|j|_|j|_|j|_dSr?) file_reader mat_streamdtypeschars_as_strings squeeze_me)rErNrFrFrGrHns  zVarReader4.__init__c Cst|j|jd}|jt|dd}|ddks"|ddkr&tdt|dd\}}|d vrAtj d t |d t d d t|d\}}|dkrPtdt|d\}}|}|d|df}|ddk} |j|} t || ||| S)z% Read and return header for variable r-r2r.rz.Mat 4 mopt wrong format, byteswapping problem?)rrz!We do not support byte ordering 'z'; returned data may be corruptr$) stackleveldz,O in MOPT integer should be 0, wrong format? r/r0r1r) rrOrPreadintstrip ValueErrordivmodwarningswarnr! UserWarningr) rEdatar@MrestOPTrCrDrArFrFrG read_headerus0  zVarReader4.read_headerTcCsv|j}|tkr ||}n#|tkr ||}|r|jrt|}n|tkr)||St d||r9|j r9t |S|S)NNo reader for class code ) rBrread_full_arrayrread_char_arrayrQr rread_sparse_array TypeErrorrRr )rEhdrprocessrBarrrFrFrGarray_from_headers     zVarReader4.array_from_headercCs|j}tt|jt|j}|tkrtd|j dd|j |}t ||kr6td|j ddtj|j||dd}|rF|}|S)a Mat4 read using header `hdr` dtype and dims Parameters ---------- hdr : object object with attributes ``dtype``, ``dims``. dtype is assumed to be the correct endianness copy : bool, optional copies array before return if True (default True) (buffer is usually read only) Returns ------- arr : ndarray of dtype given by `hdr` ``dtype`` and shape given by `hdr` ``dims`` z Variable 'latin1zL' has byte length longer than largest possible NumPy array on this platform.z!Not enough bytes to read matrix 'z'; is this a badly-formed file? Consider listing matrices with `whosmat` and loading named matrices with `variable_names` kwarg to `loadmat`F)shaperAbufferorder)rAr rrCnpint64itemsize _MAX_INTPr\r@decoderOrYlenndarraycopy)rErmr}dt num_bytesrtrorFrFrGread_sub_arrays*   zVarReader4.read_sub_arraycCs8|jr|j|dd}|j|dd}||dS||S)aM Full (rather than sparse) matrix getter Read matrix (array) can be real or complex Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : ndarray complex array if ``hdr.is_complex`` is True, otherwise a real numeric array F)r}y?)rDr)rErmresres_jrFrFrGris   zVarReader4.read_full_arraycCsB||tj}|d}tj|jtdt |d S)z latin-1 text matrix (char matrix) reader Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : ndarray with dtype 'U1', shape given by `hdr` ``dims`` latin-1r3rsrArt) rastypervuint8tobytesrzr|rCrAarrayr})rErmroSrFrFrGrjs zVarReader4.read_char_arraycCs||}|ddddf}t|dt|df}tj|dddfdd}tj|dddfdd}|d8}|d8}|jdd krRtj|ddd fd d}ntj|ddd fd d}|ddd f|_tj|||ff|S) a Read and return sparse matrix type Parameters ---------- hdr : ``VarHeader4`` instance Returns ------- arr : coo_array with dtype ``float`` and shape read from the sparse array data Notes ----- MATLAB 4 real sparse arrays are saved in a N+1 by 3 array format, where N is the number of non-zero values. Column 1 values [0:N] are the (1-based) row indices of the each non-zero value, column 2 [0:N] are the column indices, column 3 [0:N] are the (real) values. The last values [-1,0:2] of the rows, column indices are shape[0] and shape[1] respectively of the output matrix. The last value for the values column is a padding 0. mrows and ncols values from the header give the shape of the stored matrix, here [N+1, 3]. Complex data are saved as a 4 column matrix, where the fourth column contains the imaginary component; the last value is again 0. Complex sparse data do *not* have the header ``imagf`` field set to True; the fact that the data are complex is only detectable because there are 4 storage columns. N)rr)rrrintcrArr$r#floatcomplex) rrZrvascontiguousarrayrsimagscipyr> coo_array)rErmrtmprCIJVrFrFrGrks zVarReader4.read_sparse_arraycCs0|j}|tkrttt|j}nz|tkr&ttt|j}|jr%|dd}nd|tkr|j }|j}t |dkrB|ddkrB|ddksDdS|j |j |dddtjd||j |j d}|j |j |dddtjd||j |j d}t|t|f}ntd||jrtd d |D}|S) zwRead the shape of the array described by the header. The file position after this call is unspecified. Nrr#rrrFrrhcSsg|]}|dkr|qS)rrF).0xrFrFrG 8sz0VarReader4.shape_from_header..)rBrtuplemaprZrCrrQrrAr{rOseekrxrvr|rYrlrR)rErmrBrsr~rCrowscolsrFrFrGshape_from_headers4 $  zVarReader4.shape_from_headerNT) rIrJrK__doc__rHrgrprrirjrkrrFrFrFrGrks  ' *rcsXeZdZdZefddZddZddZdd Zdd d Z dddZ ddZ Z S)rz Reader for Mat4 files cs$tj|g|Ri|d|_dS)zR Initialize matlab 4 file reader %(matstream_arg)s %(load_args)s N)superrH_matrix_reader)rErOargskwargs __class__rFrGrH>s zMatFile4Reader.__init__cCs^|jdt|jtd}|jd|dkrdS|dks#|dkr)tr'dp(dStr-dp.dS)Nrr)r9rTr:)rOrrrvrAr)rEr.rFrFrGguess_byte_orderHs    zMatFile4Reader.guess_byte_ordercCstt|j|_t||_dS)za Run when beginning read of variables Sets up readers from parameters in `self` N)rr byte_orderrPrr)rErFrFrGinitialize_readTszMatFile4Reader.initialize_readcCsP|j}tt|jt|jj}|j r|j t ks|d9}|j |}||fS)ab Read and return header, next position Parameters ---------- None Returns ------- header : object object that can be passed to self.read_var_array, and that has attributes ``name`` and ``is_global`` next_position : int position in stream of next variable r#)rrgr rrCrvrwrArxrDrBrrOtell)rErmremaining_bytes next_positionrFrFrGread_var_header\s zMatFile4Reader.read_var_headerTcCs|j||S)a Read array, given `header` Parameters ---------- header : header object object with fields defining variable header process : {True, False}, optional If True, apply recursive post-processing during loading of array. Returns ------- arr : array array with post-processing applied or not according to `process`. )rrp)rEr-rnrFrFrGread_var_arraysszMatFile4Reader.read_var_arrayNcCst|tr |g}n|durt|}|jd|i}|sf|\}}|jdur.dn|j d}|durC||vrC|j|q| |||<|j||durb| |t |dkrb |S|r!|S)a, get variables from stream as dictionary Parameters ---------- variable_names : None or str or sequence of str, optional variable name, or sequence of variable names to get from Mat file / file stream. If None, then get all variables in file. NrNonerq) isinstancestrlistrOrr end_of_streamrr@rzrremover{)rEvariable_namesmdictrmrr@rFrFrG get_variabless,        zMatFile4Reader.get_variablescCs|jd|g}|sB|\}}|jdurdn|jd}|j|}t |j d}| |||f|j||r|S)z list variables from stream rNrrqunknown) rOrrrrr@rzrrrgetrBappend)rEvarsrmrr@rsinforFrFrGlist_variabless    zMatFile4Reader.list_variablesrr?) rIrJrKrrrHrrrrrr __classcell__rFrFrrGr<s    rrowcCs(t||}t|dkrtd||S)a Make ``arr`` exactly two dimensional If `arr` has more than 2 dimensions, raise a ValueError Parameters ---------- arr : array oned_as : {'row', 'column'}, optional Whether to reshape 1-D vectors as row vectors or column vectors. See documentation for ``matdims`` for more detail Returns ------- arr2d : array 2-D version of the array r#z=Matlab 4 files cannot save arrays with more than 2 dimensions)rr{r\reshape)rooned_asrCrFrFrGrs   rc@sTeZdZddZddZddZeedfdd Zd d Z d d Z ddZ ddZ dS)rcCs|j|_|j|_dSr?) file_streamr)rE file_writerrFrFrGrHs zVarWriter4.__init__cCs|j|jdddS)Nrr)ru)rwriter)rErorFrFrG write_bytesszVarWriter4.write_bytescCs|j|dSr?)rr)rEsrFrFrG write_stringszVarWriter4.write_stringrc Cstdtd}t }d}|d|d|d||d<|d|d<|d |d <||d <t|d |d <|||d } || ddS)a) Write header for given data options Parameters ---------- name : str name of variable shape : sequence Shape of array as it will be read in matlab P : int, optional code for mat4 data type, one of ``miDOUBLE, miSINGLE, miINT32, miINT16, miUINT16, miUINT8`` T : int, optional code for mat4 matrix class, one of ``mxFULL_CLASS, mxCHAR_CLASS, mxSPARSE_CLASS`` imagf : int, optional flag indicating complex rFr-rrUrWrXr.r/rr0r1r2rqN)rvemptyrrr{rrencode) rEr@rsrerfr1r-rbrdrarFrFrG write_headers"   zVarWriter4.write_headercCstj|r|||dSt|}|j}|js!|| d}|j }|tj ur-t d|tj ur6t d|tjtjfvrF|||dS|||dS)z Write matrix `arr`, with name `name` Parameters ---------- arr : array_like array to write name : str name in matlab workspace N=z!Cannot save object arrays in Mat4zCannot save void type arrays)rr>issparse write_sparservasarrayrAisnativer newbyteordertypeobject_rlvoidstr_bytes_ write_char write_numeric)rEror@r~dttrFrFrGrs     zVarWriter4.writecCst||j}|jjdk}z t|jjdd}Wnty0|r'|d}n|d}t}Ynw|j ||j |t |d|rL| |j | |jdS| |dS)Ncrc128r')rerfr1)rrrAkindr rKeyErrorrrrrsrrrealr)rEror@r1rerFrFrGrs(      zVarWriter4.write_numericcCs|jjtjkr|jjtdjkrt|}t||j}|j}|j ||t t d|jj dkrLt |}tjdt|||d}|d}tj|d|d}||dS)Nr3rerfUrFrrr8)rArrvrrxr rrrsrrrrmathprodr|r itemrr)rEror@rCn_charsst_arrstrFrFrGr,s&"   zVarWriter4.write_charcCs|}|jjdk}tj|jdd|fdd}|j|dddf<|j|dddf<|dddd fd7<|rO|jj |ddd f<|jj |dddf<n |j|ddd f<|j |ddd f<|j ||j t td ||dS) zY Sparse matrices are 2-D See docstring for VarReader4.read_sparse_array rrr$r'rNrrr#r)tocoorArrvzerosnnzrcolrarrrsrrrr)rEror@Ar1ijvrFrFrGr@s$ zVarWriter4.write_sparseN) rIrJrKrHrrrrrrrrrrFrFrFrGrs! rc@s$eZdZdZdddZdddZdS)rz) Class for writing matlab 4 format files NcCs"||_|dur d}||_d|_dS)Nr)rr_matrix_writer)rErrrFrFrGrH[s  zMatFile4Writer.__init__cCs.t||_|D] \}}|j||q dS)a Write variables in `mdict` to stream Parameters ---------- mdict : mapping mapping with method ``items`` return name, contents pairs where ``name`` which will appeak in the matlab workspace in file load, and ``contents`` is something writeable to a matlab file, such as a NumPy array. write_header : {None, True, False} If True, then write the matlab file header before writing the variables. If None (the default) then write the file header if we are at position 0 in the stream. By setting False here, and setting the stream position to the end of the file, you can append variables to a matlab file N)rritemsr)rErrr@varrFrFrG put_variablesbs zMatFile4Writer.put_variablesr?)rIrJrKrrHrrFrFrFrGrYs r)r)1rsysr^roperatorrnumpyrv scipy.sparser_miobaserrrrrr r _mio_utilsr r functoolsr __all__ byteorderrrrrrrrrr rrrr!riinfointpmaxryrrrrrrrFrFrFrGsz $   R y