2025-10-16 14:38:51,048 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-10-16 14:38:51,048 - INFO - ya.test - pytest_runtest_setup: test_parquet_format
2025-10-16 14:38:51,048 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-10-16 14:38:51,049 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-10-16 14:38:51,055 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_types_and_formats.py::TestTypesAndFormats, test_name: test_parquet_format)
2025-10-16 14:38:51,056 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:51,056 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, bc7ab8fd-bd2c-4b01-a104-d57e1f10fd09, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:38:51,058 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, bc7ab8fd-bd2c-4b01-a104-d57e1f10fd09, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE TABLE olap_table (\n                \n            c_int8 Int8,\n            c_int16 Int16,\n            c_int32 Int32 NOT NULL,\n            c_int64 Int64,\n            c_uint8 Uint8,\n            c_uint16 Uint16,\n            c_uint32 Uint32,\n            c_uint64 Uint64,\n            c_float Float,\n            c_double Double,\n            c_string String,\n            c_utf8 Utf8,\n            c_json Json,\n            c_date Date,\n            c_date32 Date32,\n            c_datetime Datetime,\n            c_datetime64 Datetime64,\n            c_timestamp Timestamp,\n            c_timestamp64 Timestamp64,\n            c_decimal Decimal(22, 9)\n        ,\n                PRIMARY KEY (c_int32)\n            ) WITH (\n                STORE = COLUMN\n            );\n        " } stats_mode: STATS_MODE_NONE }
2025-10-16 14:38:51,060 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, bc7ab8fd-bd2c-4b01-a104-d57e1f10fd09, ghrun-jsansdhc2i.auto.internal:15469): response = { <_MultiThreadedRendezvous object> }
2025-10-16 14:38:54,109 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:54,109 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:54,110 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 56ba2a39-15df-41f4-91ae-0550a2bd2f2c, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:38:54,111 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 56ba2a39-15df-41f4-91ae-0550a2bd2f2c, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            UPSERT INTO olap_table (\n                c_int8,\n                c_int16,\n                c_int32,\n                c_int64,\n                c_uint8,\n                c_uint16,\n                c_uint32,\n                c_uint64,\n                c_float,\n                c_double,\n                c_string,\n                c_utf8,\n                c_json,\n                c_date,\n                c_date32,\n                c_datetime,\n                c_datetime64,\n                c_timestamp,\n                c_timestamp64,\n                c_decimal\n            ) VALUES\n                (\n                    1,\n                    1,\n                    1,\n                    1,\n                    1,\n                    1,\n                    1,\n                    1,\n                    Float(\"0.5\"),\n                    Double(\"-0.5\"),\n                    \"hello\",\n                    \"world\",\n                    Json(\"[10, 20, 30]\"),\n                    Date(\"2025-08-25\"),\n                    Date32(\"2025-08-25\"),\n                    Datetime(\"2025-08-25T10:00:00Z\"),\n                    Datetime64(\"2025-08-25T10:00:00Z\"),\n                    Timestamp(\"2025-08-25T10:00:00Z\"),\n                    Timestamp64(\"2025-08-25T10:00:00Z\"),\n                    CAST(\"12.34\" AS Decimal(22, 9))\n                ),\n                (\n                    NULL,\n                    NULL,\n                    2,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL,\n                    NULL\n                )\n        " } stats_mode: STATS_MODE_NONE }
2025-10-16 14:38:54,113 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 56ba2a39-15df-41f4-91ae-0550a2bd2f2c, ghrun-jsansdhc2i.auto.internal:15469): response = { <_MultiThreadedRendezvous object> }
2025-10-16 14:38:54,531 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:54,532 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7c38f15336b0>
2025-10-16 14:38:54,532 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c38f1530e70>
2025-10-16 14:38:54,533 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b98f1f1d530>>
2025-10-16 14:38:54,533 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7c38f1533b10>
2025-10-16 14:38:54,533 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c38f1534c90>
2025-10-16 14:38:54,534 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b98f1f1d530>>
2025-10-16 14:38:54,534 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'parquet_bucket', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:13360', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-10-16 14:38:54,536 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:13360/parquet_bucket
2025-10-16 14:38:54,536 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-10-16 14:38:54,537 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-10-16 14:38:54,538 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7c38f1533bf0>
2025-10-16 14:38:54,538 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7c38f1533f70>
2025-10-16 14:38:54,538 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7c38f15374d0>
2025-10-16 14:38:54,539 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80'}, 'body': b'', 'auth_path': '/parquet_bucket/', 'url': 'http://localhost:13360/parquet_bucket', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7b98f1f137b0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'parquet_bucket', 'params': {'Bucket': 'parquet_bucket'}}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-10-16 14:38:54,540 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b98f1f13930>>
2025-10-16 14:38:54,540 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b98f1ef35f0>>
2025-10-16 14:38:54,541 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7c38f1534050>
2025-10-16 14:38:54,541 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7c38f1534bb0>
2025-10-16 14:38:54,542 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-10-16 14:38:54,542 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/parquet_bucket

host:localhost:13360
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251016T143854Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-10-16 14:38:54,543 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251016T143854Z
20251016/us-east-1/s3/aws4_request
243705b0683542d45e6d4036da51ef26058041a65a687c1e128040e43380b0d8
2025-10-16 14:38:54,543 - DEBUG - botocore.auth - add_auth: Signature:
5de1f5667d97ef055ed5dd5a02be8f63b15bedb06ce831a8854a60f81b4d7f9f
2025-10-16 14:38:54,544 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7c38f1537230>
2025-10-16 14:38:54,544 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:13360/parquet_bucket, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'X-Amz-Date': b'20251016T143854Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=fake_key_id/20251016/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=5de1f5667d97ef055ed5dd5a02be8f63b15bedb06ce831a8854a60f81b4d7f9f', 'amz-sdk-invocation-id': b'c96cc459-e2ac-45ef-9709-3a502557c5bb', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-10-16 14:38:54,546 - DEBUG - urllib3.connectionpool - _get_conn: Resetting dropped connection: localhost
2025-10-16 14:38:54,580 - DEBUG - urllib3.connectionpool - _make_request: http://localhost:13360 "PUT /parquet_bucket HTTP/1.1" 200 168
2025-10-16 14:38:54,581 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Thu, 16 Oct 2025 14:38:54 GMT', 'x-amzn-requestid': 'dS26XQBOffT8JzQ3cU7tTBblfYGzEdqisoJL1vC9EgBdBmmE3HJ1', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '168', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-10-16 14:38:54,582 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>parquet_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-10-16 14:38:54,583 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7b98f1f1b5f0>
2025-10-16 14:38:54,583 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-10-16 14:38:54,584 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b98f1f1d530>>
2025-10-16 14:38:54,584 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:54,585 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 396bb6b2-6344-4974-aaca-278641a5c204, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:38:54,587 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 396bb6b2-6344-4974-aaca-278641a5c204, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "CREATE OBJECT parquet_bucket_key_id (TYPE SECRET) WITH value=\'fake_key_id\'" } stats_mode: STATS_MODE_NONE }
2025-10-16 14:38:54,588 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 396bb6b2-6344-4974-aaca-278641a5c204, ghrun-jsansdhc2i.auto.internal:15469): response = { <_MultiThreadedRendezvous object> }
2025-10-16 14:38:56,277 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:56,278 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:56,279 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, e12aaba1-e6ad-4fe0-b1f5-4db6d59fc57b, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:38:56,280 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, e12aaba1-e6ad-4fe0-b1f5-4db6d59fc57b, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "CREATE OBJECT parquet_bucket_key_secret (TYPE SECRET) WITH value=\'fake_key_secret\'" } stats_mode: STATS_MODE_NONE }
2025-10-16 14:38:56,281 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, e12aaba1-e6ad-4fe0-b1f5-4db6d59fc57b, ghrun-jsansdhc2i.auto.internal:15469): response = { <_MultiThreadedRendezvous object> }
2025-10-16 14:38:58,179 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:58,180 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:58,181 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 3f0daba6-a337-4d4c-8f3e-6eb400760f4f, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:38:58,182 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 3f0daba6-a337-4d4c-8f3e-6eb400760f4f, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE EXTERNAL DATA SOURCE s3_source WITH (\n                SOURCE_TYPE = \"ObjectStorage\",\n                LOCATION = \"http://localhost:13360/parquet_bucket\",\n                AUTH_METHOD=\"AWS\",\n                AWS_ACCESS_KEY_ID_SECRET_NAME=\"parquet_bucket_key_id\",\n                AWS_SECRET_ACCESS_KEY_SECRET_NAME=\"parquet_bucket_key_secret\",\n                AWS_REGION=\"us-east-1\"\n            );\n\n            CREATE EXTERNAL TABLE s3_table (\n                \n            c_int8 Int8,\n            c_int16 Int16,\n            c_int32 Int32 NOT NULL,\n            c_int64 Int64,\n            c_uint8 Uint8,\n            c_uint16 Uint16,\n            c_uint32 Uint32,\n            c_uint64 Uint64,\n            c_float Float,\n            c_double Double,\n            c_string String,\n            c_utf8 Utf8,\n            c_json Json,\n            c_date Date,\n            c_date32 Date32,\n            c_datetime Datetime,\n            c_datetime64 Datetime64,\n            c_timestamp Timestamp,\n            c_timestamp64 Timestamp64,\n            c_decimal Decimal(22, 9)\n        \n            ) WITH (\n                DATA_SOURCE=\"s3_source\",\n                LOCATION=\"/test_folder/\",\n                FORMAT=\"parquet\"\n            );\n        " } stats_mode: STATS_MODE_NONE }
2025-10-16 14:38:58,183 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 3f0daba6-a337-4d4c-8f3e-6eb400760f4f, ghrun-jsansdhc2i.auto.internal:15469): response = { <_MultiThreadedRendezvous object> }
2025-10-16 14:38:58,795 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:58,795 - INFO - __tests__.test_types_and_formats - test_parquet_format: Exporting into s3...
2025-10-16 14:38:58,796 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:58,796 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 5d605fa9-1742-4602-8145-f3da5f85414d, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:38:58,797 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 5d605fa9-1742-4602-8145-f3da5f85414d, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            PRAGMA s3.UseBlocksSink = \"true\";\n\n            INSERT INTO s3_table SELECT * FROM olap_table;\n        " } stats_mode: STATS_MODE_NONE }
2025-10-16 14:38:58,799 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 5d605fa9-1742-4602-8145-f3da5f85414d, ghrun-jsansdhc2i.auto.internal:15469): response = { <_MultiThreadedRendezvous object> }
2025-10-16 14:38:59,588 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:59,589 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-10-16 14:38:59,590 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-10-16 14:38:59,594 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7c38f27ffcf0>
2025-10-16 14:38:59,594 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'parquet_bucket'}
2025-10-16 14:38:59,595 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7c38f15328b0>
2025-10-16 14:38:59,596 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7c38f15336b0>
2025-10-16 14:38:59,596 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c38f1530e70>
2025-10-16 14:38:59,596 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b98f1ed85f0>>
2025-10-16 14:38:59,597 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7c38f1533b10>
2025-10-16 14:38:59,597 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c38f1534c90>
2025-10-16 14:38:59,597 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b98f1ed85f0>>
2025-10-16 14:38:59,598 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'parquet_bucket', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:13360', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-10-16 14:38:59,600 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:13360/parquet_bucket
2025-10-16 14:38:59,600 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-10-16 14:38:59,600 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-10-16 14:38:59,601 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7c38f1533bf0>
2025-10-16 14:38:59,602 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7c38f1533f70>
2025-10-16 14:38:59,602 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7c38f15374d0>
2025-10-16 14:38:59,603 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/parquet_bucket/', 'url': 'http://localhost:13360/parquet_bucket?encoding-type=url', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7b98f1e79930>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'parquet_bucket', 'params': {'Bucket': 'parquet_bucket', 'EncodingType': 'url'}}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-10-16 14:38:59,604 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b98f1e79830>>
2025-10-16 14:38:59,604 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b98f36fb630>>
2025-10-16 14:38:59,604 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7c38f1534050>
2025-10-16 14:38:59,605 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7c38f1534bb0>
2025-10-16 14:38:59,606 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-10-16 14:38:59,606 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/parquet_bucket
encoding-type=url
host:localhost:13360
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251016T143859Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-10-16 14:38:59,607 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251016T143859Z
20251016/us-east-1/s3/aws4_request
4c8723dcd41c77f751dae5f5c8d5f1ebe5718d5c99046e2fbc82dea4ab1e5673
2025-10-16 14:38:59,607 - DEBUG - botocore.auth - add_auth: Signature:
1b6c01100798e5974bb5415908c17616abc7a88cc7cc8b7ccd86226955f584df
2025-10-16 14:38:59,607 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7c38f1537230>
2025-10-16 14:38:59,608 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:13360/parquet_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251016T143859Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=fake_key_id/20251016/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=1b6c01100798e5974bb5415908c17616abc7a88cc7cc8b7ccd86226955f584df', 'amz-sdk-invocation-id': b'908b7f8e-1c0b-456b-ae2e-955be04daffc', 'amz-sdk-request': b'attempt=1'}>
2025-10-16 14:38:59,609 - DEBUG - urllib3.connectionpool - _get_conn: Resetting dropped connection: localhost
2025-10-16 14:38:59,618 - DEBUG - urllib3.connectionpool - _make_request: http://localhost:13360 "GET /parquet_bucket?encoding-type=url HTTP/1.1" 200 973
2025-10-16 14:38:59,619 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Thu, 16 Oct 2025 14:38:59 GMT', 'x-amzn-requestid': 'am5cfAdnkuc0qARnPJR7WzjFHWF0ZNwbO5awpq8FMwBjdZsklKM7', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '973', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-10-16 14:38:59,620 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>parquet_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>test_folder/4ZNZmD1TekONLFQsK3EtJo1HdppFUjxT.parquet</Key><LastModified>2025-10-16T14:38:59.000Z</LastModified><ETag>&#34;4f269a5c11b274d269ac6b100802b2a5&#34;</ETag><Size>5727</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>test_folder/_LH9dS3DAE25kSIBmLrM9LYrzjOgonuf.parquet</Key><LastModified>2025-10-16T14:38:59.000Z</LastModified><ETag>&#34;bb4d5dbfdb5991acc67d7fa6a9c50cc0&#34;</ETag><Size>3853</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-10-16 14:38:59,623 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7b98f1ed5c30>
2025-10-16 14:38:59,623 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-10-16 14:38:59,623 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b98f1ed85f0>>
2025-10-16 14:38:59,624 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7c38f1532530>
2025-10-16 14:38:59,624 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-10-16 14:38:59,625 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-10-16 14:38:59,626 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7c38f28067b0>
2025-10-16 14:38:59,627 - INFO - __tests__.test_types_and_formats - test_parquet_format: Exporting finished, bucket stats: (2, 9580)
2025-10-16 14:38:59,628 - INFO - __tests__.test_types_and_formats - test_parquet_format: Importing into ydb...
2025-10-16 14:38:59,628 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:38:59,629 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, f9f8c9f1-de33-4181-9e6e-19892cea0ae6, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:38:59,630 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, f9f8c9f1-de33-4181-9e6e-19892cea0ae6, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE TABLE from_s3 (\n                PRIMARY KEY (c_int32)\n            ) WITH (\n                STORE = COLUMN\n            ) AS SELECT * FROM s3_table\n        " } stats_mode: STATS_MODE_NONE }
2025-10-16 14:38:59,631 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, f9f8c9f1-de33-4181-9e6e-19892cea0ae6, ghrun-jsansdhc2i.auto.internal:15469): response = { <_MultiThreadedRendezvous object> }
2025-10-16 14:39:04,076 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:39:04,076 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:39:04,080 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 9a8ddd5d-3ea1-453c-9bd1-15bec916073b, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:39:04,081 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 9a8ddd5d-3ea1-453c-9bd1-15bec916073b, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            SELECT\n                String::Hex(Sum(Digest::MurMurHash32(Pickle(TableRow())))) AS check_hash,\n                COUNT(*) AS check_size\n            FROM from_s3;\n\n            SELECT\n                String::Hex(Sum(Digest::MurMurHash32(Pickle(TableRow())))) AS olap_hash,\n                COUNT(*) AS olap_size\n            FROM olap_table;\n        " } stats_mode: STATS_MODE_NONE }
2025-10-16 14:39:04,083 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 9a8ddd5d-3ea1-453c-9bd1-15bec916073b, ghrun-jsansdhc2i.auto.internal:15469): response = { <_MultiThreadedRendezvous object> }
2025-10-16 14:39:06,198 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==
2025-10-16 14:39:06,200 - INFO - ya.test - pytest_runtest_teardown: Test teardown
2025-10-16 14:39:07,204 - DEBUG - ydb.connection - _prepare_call: RpcState(DeleteSession, e9d37700-5156-4945-a80f-9d0d010cc34e, ghrun-jsansdhc2i.auto.internal:15469): creating call state
2025-10-16 14:39:07,205 - DEBUG - ydb.connection - _log_request: RpcState(DeleteSession, e9d37700-5156-4945-a80f-9d0d010cc34e, ghrun-jsansdhc2i.auto.internal:15469): request = { session_id: "ydb://session/3?node_id=1&id=MmNhMjY3NmUtYmJmZGJmYTAtOTkxNTRkOS1kZWJhZTc4MQ==" }
2025-10-16 14:39:07,210 - DEBUG - ydb.connection - _log_response: RpcState(DeleteSession, e9d37700-5156-4945-a80f-9d0d010cc34e, ghrun-jsansdhc2i.auto.internal:15469): response = { status: SUCCESS }
2025-10-16 14:39:07,211 - DEBUG - ydb.query.pool - stop: All session were deleted.
2025-10-16 14:39:07,212 - DEBUG - ydb.topic - close: Close topic client
2025-10-16 14:39:07,213 - DEBUG - ydb.topic - close: Topic client was closed
2025-10-16 14:39:07,215 - INFO - ydb.connection - close: Closing channel for endpoint localhost:15469
2025-10-16 14:39:07,215 - INFO - ydb.connection - close: Closing channel for endpoint ghrun-jsansdhc2i.auto.internal:15469
2025-10-16 14:39:07,223 - INFO - ydb.pool.Discovery - run: Successfully terminated discovery process
2025-10-16 14:39:34,228 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:15469/1
2025-10-16 14:39:34,229 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/28129
2025-10-16 14:39:34,229 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/12629
2025-10-16 14:39:34,230 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/26336
2025-10-16 14:39:34,230 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/15469
2025-10-16 14:39:34,230 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/14221
