FM / __pycache_

/var/opt/nydus/ops/mysql/ai/utils/__pycache__/

/var/opt/nydus/ops/mysql/ai/utils/__pycache__

Name	Size	Mode	Actions
atomic_cursor.cpython-312.pyc	2642	0644	edit dl rm
dependencies.cpython-312.pyc	2294	0644	edit dl rm
utils.cpython-312.pyc	19922	0644	edit dl rm
__init__.cpython-312.pyc	733	0644	edit dl rm

Edit: /var/opt/nydus/ops/mysql/ai/utils/__pycache__/utils.cpython-312.pyc (19922B)

� N�j�E� � �dZddlZddlZddlZddlZddlZddlmZddlm Z m Z mZmZm Z mZmZmZddlZddlZddlmZddlmZddlmZddlmZd Zd Zddd ddd�Zd Z dee!de!fd�Z"ededee#e$e%e%ffd��Z& d1dede%deddfd�Z'de%fd�Z(d2de e%ge)fde*de%fd�Z+de dee%e e ffd�Z,dedejZfd �Z.ded!e%d"e%dejZfd#�Z/ded!e%d"e%de)fd$�Z0ded!e%d"e%ddfd%�Z1 d1ded!e%d"e%d&ejZd'ee%e%fddfd(�Z2ded!e%d&ejZdee%e%ffd)�Z3d*e%de%fd+�Z4dede%fd,�Z5ded!e%d"e%de)fd-�Z6 d3d.eeejZejnejpfd/e%deejZfd0�Z9y)4a.General utilities for AI features in MySQL Connector/Python. Includes helpers for: - defensive dict copying - temporary table lifecycle management - SQL execution and result conversions - DataFrame to/from SQL table utilities - schema/table/column name validation - array-like to DataFrame conversion �N)�contextmanager)�Any�Callable�Dict�Iterator�List�Optional�Tuple�Union)�atomic_transaction)�MySQLConnectionAbstract)�MySQLCursorAbstract)�ParamsSequenceOrDictType�mysql_ai� �BIGINT�DOUBLE�LONGTEXT�BOOLEAN�DATETIME)�int64�float64�object�boolzdatetime64[ns]�options�returnc�4�|�iStj|�S)z� Make a defensive copy of a dictionary, or return an empty dict if None. Args: options: param dict or None Returns: dict )�copy�deepcopy)rs �E/opt/nydus/tmp/pip-target-a90h98xg/lib/python/mysql/ai/utils/utils.py� copy_dictr!Is�� =�=��!�!�� db_connectionc #�K�g} |��t|�5}|D]\}}t|||�� ddd�y#1swYyxYw#t|�5}|D]\}}t|||�� ddd�w#1swYwxYwxYw�w)a Context manager to track and automatically clean up temporary SQL tables. Args: db_connection: Database connection object used to create and delete tables. Returns: None Raises: DatabaseError: If a database connection issue occurs. If an operational error occurs during execution. Yields: temporary_tables: List of (schema_name, table_name) tuples created during the context. All tables in this list are deleted on context exit. N)r�delete_sql_table)r#�temporary_tables�cursor�schema_name� table_names r �temporary_sql_tablesr*Ys{��,/1��B�� .�&�+;�'��Z� ��j�A�,<�/� .� .�� .�&�+;�'��Z� ��j�A�,<�/� .� .�sF�B�A�B�7� B�A�B�A=�A1�( A=�1A:�6A=�=Br'�query�paramsc�0�|j||xsd�y)aB Execute an SQL query with optional parameters using the given cursor. Args: cursor: MySQLCursorAbstract object to execute the query. query: SQL query string to execute. params: Optional sequence or dict providing parameters for the query. Raises: DatabaseError: If the provided SQL query/params are invalid If the query is valid but the sql raises as an exception If a database connection issue occurs. If an operational error occurs during execution. Returns: None �N)�execute)r'r+r,s r �execute_sqlr0xs��*�N�N�5�&�,�B�'r"c�v�tj}djtj|t ��S)z� Generate a random uppercase string of fixed length for table names. Returns: Random string of length RANDOM_TABLE_NAME_LENGTH. �)�k)�string�ascii_uppercase�join�random�choices�RANDOM_TABLE_NAME_LENGTH)�char_sets r � _get_namer;�s*��%�%�H� �7�7�6�>�>�(�.F�G�H�Hr"� condition� max_callsc�d�t|�D]}|t�x}�s�|cStd��)a� Generate a random string name that satisfies a given condition. Args: condition: Callable that takes a generated name and returns True if it is valid. max_calls: Maximum number of attempts before giving up (default 100). Returns: A random string that fulfills the provided condition. Raises: RuntimeError: If the maximum number of attempts is reached without success. z._json_processor�s��#'�#3�t�z�z�$��=��=r"c��|SrPr.rRs r �_default_processorz.sql_response_to_df.._default_processor�s��r"��)�columns)r �strrGr� enumerate�description�fetchallrH�append�pd� DataFrame�column_names)r'rSrU�idx_to_processor�idx�col�rows�processed_rows�row� processed_rowrNs r �sql_response_to_dfrh�s��">�h�s�m�>��>��f�0�0�1��S��q�6�S�=�$3��S�!�$6��S�!�2��?�?��D��N��S� � �"�3��I�C��!6�!1�#�!6�t�!<�M�#��(� ��m�,� ��<�<��0C�0C�D�Dr"r(r)c�h�t|�t|�t|d|�d|��t|�S)aD Load the entire contents of a SQL table into a pandas DataFrame. Args: cursor: MySQLCursorAbstract to execute the query. schema_name: Name of the schema containing the table. table_name: Name of the table to fetch. Returns: DataFrame containing all rows from the specified table. Raises: DatabaseError: If the table does not exist If a database connection issue occurs. If an operational error occurs during execution. ValueError: If the schema or table name is not valid zSELECT * FROM �.)� validate_namer0rh�r'r(r)s r �sql_table_to_dfrm�s6��*�+��*��.�� Q�z�l�C�D��f�%�%r"c�z�t|�t|�|jd||f�|j�duS)a� Check whether a table exists in a specific schema. Args: cursor: MySQLCursorAbstract object to execute the query. schema_name: Name of the database schema. table_name: Name of the table. Returns: True if the table exists, False otherwise. Raises: DatabaseError: If a database connection issue occurs. If an operational error occurs during execution. ValueError: If the schema or table name is not valid z� SELECT 1 FROM information_schema.tables WHERE table_schema = %s AND table_name = %s LIMIT 1 N�rkr/�fetchonerls r �table_existsrqsC��(�+��*�� N�N� � �j�!��?�?��D�(�(r"c�T�t|�t|�t|d|�d|��y)a� Drop a table from the SQL database if it exists. Args: cursor: MySQLCursorAbstract to execute the drop command. schema_name: Name of the schema. table_name: Name of the table to delete. Returns: None Raises: DatabaseError: If a database connection issue occurs. If an operational error occurs during execution. ValueError: If the schema or table name is not valid zDROP TABLE IF EXISTS rjN)rkr0rls r r%r%6s,��(�+��*��/��}�A�j�\�J�Kr"�df�col_name_to_placeholder_stringc ��|�i}t|�t|�|jD]}tt|��|�d|��}|jD]�}gg} }t ||j�D]i\} }t| d�r| j �n| } ||vr||t| �g}}nt| �\}}|j|�| j|��kdj|jD�cgc] }t|��c}�} dj|�}d|�d| �d|�d�}t||| � ��ycc}w) a� Insert all rows from a pandas DataFrame into an existing SQL table. Args: cursor: MySQLCursorAbstract for execution. schema_name: Name of the database schema. table_name: Table to insert new rows into. df: DataFrame containing the rows to insert. col_name_to_placeholder_string: Optional mapping of column names to custom SQL value/placeholder strings. Returns: None Raises: DatabaseError: If the rows could not be inserted into the table, e.g., a type or shape issue If a database connection issue occurs. If an operational error occurs during execution. ValueError: If the schema or table name is not valid Nrj�item�, zINSERT INTO � (z ) VALUES (�))r,)rkrXrY�values�zip�hasattrrvrLr]�extendr6r0)r'r(r)rsrtrc�qualified_table_namerf�placeholdersr,rN�elem_placeholder�elem_params�cols_sql�placeholders_sql� insert_sqls r �extend_sql_tabler�PsV��:&�-�)+�&��+��*��z�z��c�#�h��*�]�!�J�<�8��y�y��!�2�f��S�"�*�*�-�I�D�#�")�$��"7�4�9�9�;�T�D��4�4�0N�s�0S��I�V�+� �1A��0F�-� �+�� 0�1��M�M�+�&�.��9�9�"�*�*�=�*�3�c�#�h�*�=�>��9�9�\�2��/�0�1��z��$4�#5�Q� 8� � �F�J�v�6�+��>s�5D< c�p��t��fd��}��d|��}t��t|�|jD]}tt|��g}|jj�D]N\}}tjt|�d�}tt|��|j|�d|��Pdj|�} td�|jD��} | r| dz } d|�d | �d �}t�|� t��||�||fS#t$rt��|��wxYw)a Create a new SQL table with a random name, and populate it with data from a DataFrame. If an 'id' column is defined in the dataframe, it will be used as the primary key. Args: cursor: MySQLCursorAbstract for executing SQL. schema_name: Schema in which to create the table. df: DataFrame containing the data to be inserted. Returns: Tuple (qualified_table_name, table_name): The schema-qualified and unqualified table names. Raises: RuntimeError: If a random available table name could not be found. ValueError: If any schema, table, or a column name is invalid. DatabaseError: If a database connection issue occurs. If an operational error occurs during execution. c� ��t��|�SrP)rq)r)r'r(s ��r �z#sql_table_from_df..�s��|�F�K��L�Lr"rjr� rwc3�BK�|]}|j�dk(��y�w)�idN)�lower)�.0rcs r � z$sql_table_from_df..�s��?�J�S�S�Y�Y�[�D�(�J�s�z, PRIMARY KEY (id)z CREATE TABLE rxry)rCrkrXrY�dtypes�items�PD_TO_SQL_DTYPE_MAPPING�getr]r6�anyr0r�� Exceptionr%)r'r(rsr)r~rc�columns_sql�dtype�sql_type�columns_str� has_id_col�create_table_sqls`` r �sql_table_from_dfr��s@��0!�L��J�*�]�!�J�<�8��+��*��z�z��c�#�h��K��i�i�o�o�'� ��U�*�.�.�s�5�z�:�F��c�#�h��c�U�!�H�:�.�/� (��)�)�K�(�K��?�B�J�J�?�?�J��+�+��'�';�&<�B�{�m�1�M��(�)��j�"�=� ��+�+�� j�9� ��s�D�D5rBc�n�t|t�rtjd|�st d|��|S)a Validate that the string is a legal SQL identifier (letters, digits, underscores). Args: name: Name (schema, table, or column) to validate. Returns: The validated name. Raises: ValueError: If the name does not meet format requirements. z^[A-Za-z0-9_]+$zUnsupported name format )rFrY�re�match� ValueError)rBs r rkrk�s4�� t�S�!�b�h�h�/A�4�&H��3�D�6�:�;�;��Kr"c��|j}|�+t}t|�5}d|��}t||�ddd�t |�|S#1swY�xYw)a� Retrieve the name of the currently selected schema, or set and ensure the default schema. Args: db_connection: MySQL connector database connection object. Returns: Name of the schema (database in use). Raises: ValueError: If the schema name is not valid DatabaseError: If a database connection issue occurs. If an operational error occurs during execution. NzCREATE DATABASE IF NOT EXISTS )�database�DEFAULT_SCHEMArr0rk)r#�schemar'�create_database_stmts r � source_schemar��sX�� #� #�F� �~�� .�&�%C�F�8�#L� �� 4�5�/��&��M� /� .�s�A�Ac��t|�t|�|jd|�d|�d��|j�duS)a+ Determine if a given SQL table is empty. Args: cursor: MySQLCursorAbstract with access to the database. schema_name: Name of the schema containing the table. table_name: Name of the table to check. Returns: True if the table has no rows, False otherwise. Raises: DatabaseError: If the table does not exist If a database connection issue occurs. If an operational error occurs during execution. ValueError: If the schema or table name is not valid zSELECT 1 FROM rjz LIMIT 1Nrorls r �is_table_emptyr��sA��*�+��*�� N�N�^�K�=��*��X�F�G��?�?��$�$r"�arr� col_prefixc��|�yt|tj�rtj|�St|tj�r|j �S|j dk(r|j dd�}t|jd�D�cgc] }|�d|��}}tj||d��Scc}w)a$ Convert input data to a pandas DataFrame if necessary. Args: arr: Input data as a pandas DataFrame, NumPy ndarray, pandas Series, or None. Returns: If the input is None, returns None. Otherwise, returns a DataFrame backed by the same underlying data whenever possible (except in cases where pandas or NumPy must copy, such as for certain views or non-contiguous arrays). Notes: - If an ndarray is passed, column names will be integer indices (0, 1, ...). - If a DataFrame is passed, column names and indices are preserved. - The returned DataFrame is a shallow copy and shares data with the original input when possible; however, copies may still occur for certain input types or memory layouts. NrV��rAF)rXr) rFr^r_�Series�to_frame�ndim�reshaper?�shape)r�r�rb� col_namess r � convert_to_dfr�s��.�{��#�r�|�|�$��|�|�C� � ��#�r�y�y�!��|�|�~�� x�x�1�}��k�k�"�a� ��27�� !��2E�F�2E�3�J�<�q��&�2E�I�F� �<�<��Y�U�;�;��Gs�CrP)�d)�feature):�__doc__rrJr7r�r4� contextlibr�typingrrrrrr r r�numpy�np�pandasr^�mysql.ai.utils.atomic_cursorr�mysql.connector.abstractsr �mysql.connector.cursorr�mysql.connector.typesr�VAR_NAME_SPACEr9r�r�rGr!rH�tuplerYr*r0r;r�intrCrLr_rhrmrqr%r�r�rkr�r�r��ndarrayr�r.r"r �r�s��8 �� %�N�N�N��;�=�6�:�� "�x��~� "�$� "� �B�*�B� �d�5��c��?�#�$�B��B�>QU�(��(�(+�(�5M�(� �(�0I�3�I�W�x��t��4�W��W�s�W�0�C��E�#�t�C�y�.�$9��&+E�2�+E�r�|�|�+E�\&��&�.1�&�?B�&��\�\�&�> )�� )�.1� )�?B� )� � )�FL��L�.1�L�?B�L� �L�>6:�=7��=7��=7��=7� �� =7� %)��c��N�=7� � =7�@:,��:,�.1�:,�79�|�|�:,� �3��8�_�:,�z��(�!8��S��:%��%�.1�%�?B�%� �%�< �#<� �%��b�i�i��;�<� =�#<��#<��b�l�l��#