2025-11-11 20:50:36,151 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-11 20:50:36,152 - INFO - ya.test - pytest_runtest_setup: test_different_types_and_formats[lz4-json_each_row]
2025-11-11 20:50:36,152 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-11 20:50:36,152 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-11 20:50:36,154 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_types_and_formats.py::TestTypesAndFormats, test_name: test_different_types_and_formats[lz4-json_each_row])
2025-11-11 20:50:36,155 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:36,156 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 289d6b05-cba3-4356-902b-66d3331ed0dd, ghrun-qykcqbcpue.auto.internal:20865): creating call state
2025-11-11 20:50:36,156 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 289d6b05-cba3-4356-902b-66d3331ed0dd, ghrun-qykcqbcpue.auto.internal:20865): request = { session_id: "ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE TABLE olap_table_json_each_row_lz4 (\n                \n            c_int8 Int8,\n            c_int16 Int16,\n            c_int32 Int32 NOT NULL,\n            c_int64 Int64,\n            c_uint8 Uint8,\n            c_uint16 Uint16,\n            c_uint32 Uint32,\n            c_uint64 Uint64,\n            c_float Float,\n            c_double Double,\n            c_string String,\n            c_utf8 Utf8,\n            c_json Json,\n            c_date Date,\n            c_datetime Datetime,\n            c_timestamp Timestamp\n        ,\n                PRIMARY KEY (c_int32)\n            ) WITH (\n                STORE = COLUMN\n            );\n        " } stats_mode: STATS_MODE_NONE }
2025-11-11 20:50:36,157 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 289d6b05-cba3-4356-902b-66d3331ed0dd, ghrun-qykcqbcpue.auto.internal:20865): response = { <_MultiThreadedRendezvous object> }
2025-11-11 20:50:40,858 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:40,859 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:40,859 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, b7cf7a0e-1b0c-4c0c-8632-78349ff84f45, ghrun-qykcqbcpue.auto.internal:20865): creating call state
2025-11-11 20:50:40,860 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, b7cf7a0e-1b0c-4c0c-8632-78349ff84f45, ghrun-qykcqbcpue.auto.internal:20865): request = { session_id: "ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            UPSERT INTO olap_table_json_each_row_lz4 (\n                c_int8, c_int16, c_int32, c_int64, c_uint8, c_uint16, c_uint32, c_uint64, c_float, c_double, c_string, c_utf8, c_json, c_date, c_datetime, c_timestamp\n            ) VALUES\n                (1, 1, 1, 1, 1, 1, 1, 1, Float(\"0.5\"), Double(\"-0.5\"), \"hello\", \"world\", Json(\"[10, 20, 30]\"), Date(\"2025-08-25\"), Datetime(\"2025-08-25T10:00:00Z\"), Timestamp(\"2025-08-25T10:00:00Z\")),\n                (NULL, NULL, 2, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL);\n        " } stats_mode: STATS_MODE_NONE }
2025-11-11 20:50:40,862 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, b7cf7a0e-1b0c-4c0c-8632-78349ff84f45, ghrun-qykcqbcpue.auto.internal:20865): response = { <_MultiThreadedRendezvous object> }
2025-11-11 20:50:41,282 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:41,283 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7c3539ede550>
2025-11-11 20:50:41,283 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c3539ed8270>
2025-11-11 20:50:41,284 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b953a30dff0>>
2025-11-11 20:50:41,284 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7c3539ee05b0>
2025-11-11 20:50:41,285 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c3539ed7d30>
2025-11-11 20:50:41,286 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b953a30dff0>>
2025-11-11 20:50:41,286 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'json_each_row_lz4_bucket', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:26209', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 20:50:41,288 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:26209/json_each_row_lz4_bucket
2025-11-11 20:50:41,288 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 20:50:41,289 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 20:50:41,290 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7c3539edd750>
2025-11-11 20:50:41,291 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7c3539ee1ff0>
2025-11-11 20:50:41,291 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7c3539ed87b0>
2025-11-11 20:50:41,292 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80'}, 'body': b'', 'auth_path': '/json_each_row_lz4_bucket/', 'url': 'http://localhost:26209/json_each_row_lz4_bucket', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7b953a270230>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'json_each_row_lz4_bucket', 'params': {'Bucket': 'json_each_row_lz4_bucket'}}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 20:50:41,293 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b953a26fcb0>>
2025-11-11 20:50:41,293 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b953a2df0b0>>
2025-11-11 20:50:41,294 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7c3539edea90>
2025-11-11 20:50:41,294 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7c3539ed7ef0>
2025-11-11 20:50:41,295 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 20:50:41,296 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/json_each_row_lz4_bucket

host:localhost:26209
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251111T205041Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-11 20:50:41,297 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T205041Z
20251111/us-east-1/s3/aws4_request
4d77a60708478ac23829ea314823fe0e5a12f48f71b64276279e29729aa1c33c
2025-11-11 20:50:41,297 - DEBUG - botocore.auth - add_auth: Signature:
1119b31b474d54948022641f2ec46107d2250c04dde6c3e2ac5a4e552b06b8c8
2025-11-11 20:50:41,298 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7c3539ed8430>
2025-11-11 20:50:41,298 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:26209/json_each_row_lz4_bucket, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'X-Amz-Date': b'20251111T205041Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=fake_key_id/20251111/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=1119b31b474d54948022641f2ec46107d2250c04dde6c3e2ac5a4e552b06b8c8', 'amz-sdk-invocation-id': b'd73f572b-9312-4e44-a954-fb24c17e0459', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-11 20:50:41,301 - DEBUG - urllib3.connectionpool - _get_conn: Resetting dropped connection: localhost
2025-11-11 20:50:41,335 - DEBUG - urllib3.connectionpool - _make_request: http://localhost:26209 "PUT /json_each_row_lz4_bucket HTTP/1.1" 200 178
2025-11-11 20:50:41,336 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 20:50:41 GMT', 'x-amzn-requestid': 'XbG8Tt1yEfFZ4POjeEA32fVKrxkJtwuBrDQoZKGQ7HO2VnfZIIpQ', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '178', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 20:50:41,337 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>json_each_row_lz4_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-11 20:50:41,338 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7b953a32b0b0>
2025-11-11 20:50:41,339 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 20:50:41,339 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b953a30dff0>>
2025-11-11 20:50:41,340 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:41,340 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 575aeb38-7811-49be-9801-6190680488bf, ghrun-qykcqbcpue.auto.internal:20865): creating call state
2025-11-11 20:50:41,341 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 575aeb38-7811-49be-9801-6190680488bf, ghrun-qykcqbcpue.auto.internal:20865): request = { session_id: "ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "CREATE OBJECT json_each_row_lz4_bucket_key_id (TYPE SECRET) WITH value=\'fake_key_id\'" } stats_mode: STATS_MODE_NONE }
2025-11-11 20:50:41,343 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 575aeb38-7811-49be-9801-6190680488bf, ghrun-qykcqbcpue.auto.internal:20865): response = { <_MultiThreadedRendezvous object> }
2025-11-11 20:50:43,564 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:43,565 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:43,566 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 3026bfc3-4747-48c4-b8b7-e4a1ece7a75f, ghrun-qykcqbcpue.auto.internal:20865): creating call state
2025-11-11 20:50:43,567 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 3026bfc3-4747-48c4-b8b7-e4a1ece7a75f, ghrun-qykcqbcpue.auto.internal:20865): request = { session_id: "ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "CREATE OBJECT json_each_row_lz4_bucket_key_secret (TYPE SECRET) WITH value=\'fake_key_secret\'" } stats_mode: STATS_MODE_NONE }
2025-11-11 20:50:43,569 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 3026bfc3-4747-48c4-b8b7-e4a1ece7a75f, ghrun-qykcqbcpue.auto.internal:20865): response = { <_MultiThreadedRendezvous object> }
2025-11-11 20:50:45,827 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:45,828 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:45,829 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 88a03bbf-e236-462f-a168-28cbabc34f0e, ghrun-qykcqbcpue.auto.internal:20865): creating call state
2025-11-11 20:50:45,831 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 88a03bbf-e236-462f-a168-28cbabc34f0e, ghrun-qykcqbcpue.auto.internal:20865): request = { session_id: "ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE EXTERNAL DATA SOURCE s3_source_json_each_row_lz4 WITH (\n                SOURCE_TYPE = \"ObjectStorage\",\n                LOCATION = \"http://localhost:26209/json_each_row_lz4_bucket\",\n                AUTH_METHOD=\"AWS\",\n                AWS_ACCESS_KEY_ID_SECRET_NAME=\"json_each_row_lz4_bucket_key_id\",\n                AWS_SECRET_ACCESS_KEY_SECRET_NAME=\"json_each_row_lz4_bucket_key_secret\",\n                AWS_REGION=\"us-east-1\"\n            );\n\n            CREATE EXTERNAL TABLE s3_table_json_each_row_lz4 (\n                \n            c_int8 Int8,\n            c_int16 Int16,\n            c_int32 Int32 NOT NULL,\n            c_int64 Int64,\n            c_uint8 Uint8,\n            c_uint16 Uint16,\n            c_uint32 Uint32,\n            c_uint64 Uint64,\n            c_float Float,\n            c_double Double,\n            c_string String,\n            c_utf8 Utf8,\n            c_json Json,\n            c_date Date,\n            c_datetime Datetime,\n            c_timestamp Timestamp\n        \n            ) WITH (\n                DATA_SOURCE=\"s3_source_json_each_row_lz4\",\n                LOCATION=\"/test_folder/\",\n                FORMAT=\"json_each_row\",\n                COMPRESSION=\"lz4\"\n            );\n        " } stats_mode: STATS_MODE_NONE }
2025-11-11 20:50:45,833 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 88a03bbf-e236-462f-a168-28cbabc34f0e, ghrun-qykcqbcpue.auto.internal:20865): response = { <_MultiThreadedRendezvous object> }
2025-11-11 20:50:46,379 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:46,380 - INFO - __tests__.test_types_and_formats - test_different_types_and_formats: Exporting into s3...
2025-11-11 20:50:46,381 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:46,382 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 3a42f015-06d5-4283-8b18-f00a5dda23dc, ghrun-qykcqbcpue.auto.internal:20865): creating call state
2025-11-11 20:50:46,383 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 3a42f015-06d5-4283-8b18-f00a5dda23dc, ghrun-qykcqbcpue.auto.internal:20865): request = { session_id: "ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "INSERT INTO s3_table_json_each_row_lz4 SELECT * FROM olap_table_json_each_row_lz4" } stats_mode: STATS_MODE_NONE }
2025-11-11 20:50:46,385 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 3a42f015-06d5-4283-8b18-f00a5dda23dc, ghrun-qykcqbcpue.auto.internal:20865): response = { <_MultiThreadedRendezvous object> }
2025-11-11 20:50:47,766 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:47,767 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-11 20:50:47,773 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-11 20:50:47,776 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7c353abbfe10>
2025-11-11 20:50:47,782 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'json_each_row_lz4_bucket'}
2025-11-11 20:50:47,787 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7c3539ed9bd0>
2025-11-11 20:50:47,793 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7c3539ede550>
2025-11-11 20:50:47,794 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c3539ed8270>
2025-11-11 20:50:47,794 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b953a2bfc30>>
2025-11-11 20:50:47,796 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7c3539ee05b0>
2025-11-11 20:50:47,796 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c3539ed7d30>
2025-11-11 20:50:47,797 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b953a2bfc30>>
2025-11-11 20:50:47,797 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'json_each_row_lz4_bucket', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:26209', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 20:50:47,800 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:26209/json_each_row_lz4_bucket
2025-11-11 20:50:47,800 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 20:50:47,801 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 20:50:47,806 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7c3539edd750>
2025-11-11 20:50:47,807 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7c3539ee1ff0>
2025-11-11 20:50:47,814 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7c3539ed87b0>
2025-11-11 20:50:47,815 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/json_each_row_lz4_bucket/', 'url': 'http://localhost:26209/json_each_row_lz4_bucket?encoding-type=url', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7b953a1689b0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'json_each_row_lz4_bucket', 'params': {'Bucket': 'json_each_row_lz4_bucket', 'EncodingType': 'url'}}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 20:50:47,816 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b953a178bf0>>
2025-11-11 20:50:47,817 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b953a20b570>>
2025-11-11 20:50:47,821 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7c3539edea90>
2025-11-11 20:50:47,826 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7c3539ed7ef0>
2025-11-11 20:50:47,828 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 20:50:47,828 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/json_each_row_lz4_bucket
encoding-type=url
host:localhost:26209
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251111T205047Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-11 20:50:47,829 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T205047Z
20251111/us-east-1/s3/aws4_request
cf611e9135c30b58a2afa6470d75f3efe74c43e3b61b186b8cf0f58494190a50
2025-11-11 20:50:47,835 - DEBUG - botocore.auth - add_auth: Signature:
c250113c7b6e69a0d40398951195b3fa2ea1887a6fbb9b651ccab0d7f08c002a
2025-11-11 20:50:47,835 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7c3539ed8430>
2025-11-11 20:50:47,841 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:26209/json_each_row_lz4_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251111T205047Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=fake_key_id/20251111/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=c250113c7b6e69a0d40398951195b3fa2ea1887a6fbb9b651ccab0d7f08c002a', 'amz-sdk-invocation-id': b'95161849-ff99-4df9-aae7-45f065d2c08e', 'amz-sdk-request': b'attempt=1'}>
2025-11-11 20:50:47,843 - DEBUG - urllib3.connectionpool - _get_conn: Resetting dropped connection: localhost
2025-11-11 20:50:47,853 - DEBUG - urllib3.connectionpool - _make_request: http://localhost:26209 "GET /json_each_row_lz4_bucket?encoding-type=url HTTP/1.1" 200 615
2025-11-11 20:50:47,856 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 20:50:47 GMT', 'x-amzn-requestid': 'n2V5EPH8LpGptDdiHIwgAP1TcOcQXhBNzj7opgZdH2oRzHOEjsPD', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '615', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 20:50:47,857 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>json_each_row_lz4_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>test_folder/EVg2bxfSEUqMOT1XKBo8pAHbD_H7OZ2H.json.lz4</Key><LastModified>2025-11-11T20:50:47.000Z</LastModified><ETag>&#34;94a8a6264cdec6121061de3b2823792b&#34;</ETag><Size>292</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-11 20:50:47,860 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7b953a2ad2b0>
2025-11-11 20:50:47,860 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 20:50:47,860 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b953a2bfc30>>
2025-11-11 20:50:47,862 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7c3539ed9cb0>
2025-11-11 20:50:47,863 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-11 20:50:47,863 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-11 20:50:47,866 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7c353abc68d0>
2025-11-11 20:50:47,867 - INFO - __tests__.test_types_and_formats - test_different_types_and_formats: Exporting finished, bucket stats: (1, 292)
2025-11-11 20:50:47,867 - INFO - __tests__.test_types_and_formats - test_different_types_and_formats: Importing into ydb...
2025-11-11 20:50:47,868 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:47,869 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 430f8742-cd9a-4d97-9fcd-a3a178ac8205, ghrun-qykcqbcpue.auto.internal:20865): creating call state
2025-11-11 20:50:47,870 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 430f8742-cd9a-4d97-9fcd-a3a178ac8205, ghrun-qykcqbcpue.auto.internal:20865): request = { session_id: "ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE TABLE from_s3_json_each_row_lz4 (\n                PRIMARY KEY (c_int32)\n            ) WITH (\n                STORE = COLUMN\n            ) AS SELECT * FROM s3_table_json_each_row_lz4\n        " } stats_mode: STATS_MODE_NONE }
2025-11-11 20:50:47,871 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 430f8742-cd9a-4d97-9fcd-a3a178ac8205, ghrun-qykcqbcpue.auto.internal:20865): response = { <_MultiThreadedRendezvous object> }
2025-11-11 20:50:52,414 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:52,415 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:52,416 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, ce6f6858-1230-4b91-8dc1-f1a67f3cac02, ghrun-qykcqbcpue.auto.internal:20865): creating call state
2025-11-11 20:50:52,418 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, ce6f6858-1230-4b91-8dc1-f1a67f3cac02, ghrun-qykcqbcpue.auto.internal:20865): request = { session_id: "ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            SELECT\n                String::Hex(Sum(Digest::MurMurHash32(Pickle(TableRow())))) AS check_hash,\n                COUNT(*) AS check_size\n            FROM from_s3_json_each_row_lz4;\n\n            SELECT\n                String::Hex(Sum(Digest::MurMurHash32(Pickle(TableRow())))) AS olap_hash,\n                COUNT(*) AS olap_size\n            FROM olap_table_json_each_row_lz4;\n        " } stats_mode: STATS_MODE_NONE }
2025-11-11 20:50:52,419 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, ce6f6858-1230-4b91-8dc1-f1a67f3cac02, ghrun-qykcqbcpue.auto.internal:20865): response = { <_MultiThreadedRendezvous object> }
2025-11-11 20:50:53,801 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-11-11 20:50:53,802 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-11-11 20:50:53,816 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database /Root
2025-11-11 20:50:53,817 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, deaf9e0c-5e23-442b-8079-a1e5202c35f8, localhost:20865): creating call state
2025-11-11 20:50:53,818 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, deaf9e0c-5e23-442b-8079-a1e5202c35f8, localhost:20865): request = { database: "/Root" }
2025-11-11 20:50:53,824 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, deaf9e0c-5e23-442b-8079-a1e5202c35f8, localhost:20865): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-qykcqbcpue.auto.internal" port: 20865 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-11-11 20:50:53,825 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database /Root: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-qykcqbcpue.auto.internal:20865, location 1, ssl: False>]>
2025-11-11 20:50:53,825 - INFO - ydb.connection - close: Closing channel for endpoint localhost:20865
2025-11-11 20:50:54,743 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=OTQ3ZDljMGQtMjM3ZGU4LWEyZmZkNTRlLWJiNTM5NmY3
2025-11-11 20:50:54,746 - INFO - ya.test - pytest_runtest_teardown: Test teardown
