2025-12-08 21:34:33,647 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-08 21:34:33,647 - INFO - ya.test - pytest_runtest_setup: test_different_types_and_formats[zstd-csv_with_names]
2025-12-08 21:34:33,647 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-08 21:34:33,648 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-12-08 21:34:33,650 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_types_and_formats.py::TestTypesAndFormats, test_name: test_different_types_and_formats[zstd-csv_with_names])
2025-12-08 21:34:33,651 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:33,652 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, ede0ee20-e7ed-41fe-af49-8cdb07dbd61a, ghrun-kcja2ts4ve.auto.internal:23724): creating call state
2025-12-08 21:34:33,653 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, ede0ee20-e7ed-41fe-af49-8cdb07dbd61a, ghrun-kcja2ts4ve.auto.internal:23724): request = { session_id: "ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE TABLE olap_table_csv_with_names_zstd (\n                \n            c_int8 Int8,\n            c_int16 Int16,\n            c_int32 Int32 NOT NULL,\n            c_int64 Int64,\n            c_uint8 Uint8,\n            c_uint16 Uint16,\n            c_uint32 Uint32,\n            c_uint64 Uint64,\n            c_float Float,\n            c_double Double,\n            c_string String,\n            c_utf8 Utf8,\n            c_json Json,\n            c_date Date,\n            c_datetime Datetime,\n            c_timestamp Timestamp\n        ,\n                PRIMARY KEY (c_int32)\n            ) WITH (\n                STORE = COLUMN\n            );\n        " } stats_mode: STATS_MODE_NONE }
2025-12-08 21:34:33,655 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, ede0ee20-e7ed-41fe-af49-8cdb07dbd61a, ghrun-kcja2ts4ve.auto.internal:23724): response = { <_MultiThreadedRendezvous object> }
2025-12-08 21:34:37,085 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:37,086 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:37,087 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 0b1dfa6d-63ca-469b-be6f-b07ffe12e03c, ghrun-kcja2ts4ve.auto.internal:23724): creating call state
2025-12-08 21:34:37,091 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 0b1dfa6d-63ca-469b-be6f-b07ffe12e03c, ghrun-kcja2ts4ve.auto.internal:23724): request = { session_id: "ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            UPSERT INTO olap_table_csv_with_names_zstd (\n                c_int8, c_int16, c_int32, c_int64, c_uint8, c_uint16, c_uint32, c_uint64, c_float, c_double, c_string, c_utf8, c_json, c_date, c_datetime, c_timestamp\n            ) VALUES\n                (1, 1, 1, 1, 1, 1, 1, 1, Float(\"0.5\"), Double(\"-0.5\"), \"hello\", \"world\", Json(\"[10, 20, 30]\"), Date(\"2025-08-25\"), Datetime(\"2025-08-25T10:00:00Z\"), Timestamp(\"2025-08-25T10:00:00Z\")),\n                (NULL, NULL, 2, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL);\n        " } stats_mode: STATS_MODE_NONE }
2025-12-08 21:34:37,093 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 0b1dfa6d-63ca-469b-be6f-b07ffe12e03c, ghrun-kcja2ts4ve.auto.internal:23724): response = { <_MultiThreadedRendezvous object> }
2025-12-08 21:34:37,476 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:37,477 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7bdf934b8fb0>
2025-12-08 21:34:37,477 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7bdf934b5a50>
2025-12-08 21:34:37,477 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b3f94cd5370>>
2025-12-08 21:34:37,478 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7bdf934b9250>
2025-12-08 21:34:37,478 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7bdf934b57b0>
2025-12-08 21:34:37,479 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b3f94cd5370>>
2025-12-08 21:34:37,479 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'csv_with_names_zstd_bucket', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:28691', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-12-08 21:34:37,481 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:28691/csv_with_names_zstd_bucket
2025-12-08 21:34:37,481 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-12-08 21:34:37,482 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-12-08 21:34:37,483 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7bdf934b8a70>
2025-12-08 21:34:37,483 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7bdf934b9790>
2025-12-08 21:34:37,488 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7bdf934b5cf0>
2025-12-08 21:34:37,489 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80'}, 'body': b'', 'auth_path': '/csv_with_names_zstd_bucket/', 'url': 'http://localhost:28691/csv_with_names_zstd_bucket', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7b3f94cbc370>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'csv_with_names_zstd_bucket', 'params': {'Bucket': 'csv_with_names_zstd_bucket'}}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-12-08 21:34:37,490 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b3f94cbc330>>
2025-12-08 21:34:37,490 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b3f94cab0b0>>
2025-12-08 21:34:37,491 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7bdf934b9410>
2025-12-08 21:34:37,491 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7bdf934b5890>
2025-12-08 21:34:37,494 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-12-08 21:34:37,494 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/csv_with_names_zstd_bucket

host:localhost:28691
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251208T213437Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-12-08 21:34:37,495 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251208T213437Z
20251208/us-east-1/s3/aws4_request
9336d83a3b3c5b6989971bc77f1ff7f2405b6960a2bd555f9594b932873a6759
2025-12-08 21:34:37,495 - DEBUG - botocore.auth - add_auth: Signature:
7b450540e56d8d2e4909dbc31c1d54557a2a31961f216c7f84cc2d7cbb65a0bf
2025-12-08 21:34:37,496 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7bdf934b5b30>
2025-12-08 21:34:37,496 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:28691/csv_with_names_zstd_bucket, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'X-Amz-Date': b'20251208T213437Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=fake_key_id/20251208/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=7b450540e56d8d2e4909dbc31c1d54557a2a31961f216c7f84cc2d7cbb65a0bf', 'amz-sdk-invocation-id': b'f98283ce-0b80-4a1f-93f6-fd16dc5d4853', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-12-08 21:34:37,498 - DEBUG - urllib3.connectionpool - _get_conn: Resetting dropped connection: localhost
2025-12-08 21:34:37,530 - DEBUG - urllib3.connectionpool - _make_request: http://localhost:28691 "PUT /csv_with_names_zstd_bucket HTTP/1.1" 200 180
2025-12-08 21:34:37,531 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Mon, 08 Dec 2025 21:34:37 GMT', 'x-amzn-requestid': 'blKLnqxiUYvksQUYKeHPVK3HfwlZf9i7WA77Pux1inGXsfAU3eYe', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '180', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-12-08 21:34:37,532 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>csv_with_names_zstd_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-12-08 21:34:37,533 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7b3f94cd3770>
2025-12-08 21:34:37,533 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-12-08 21:34:37,534 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b3f94cd5370>>
2025-12-08 21:34:37,536 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:37,537 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 456d504a-cca0-4e17-94a7-2dc91ca24804, ghrun-kcja2ts4ve.auto.internal:23724): creating call state
2025-12-08 21:34:37,538 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 456d504a-cca0-4e17-94a7-2dc91ca24804, ghrun-kcja2ts4ve.auto.internal:23724): request = { session_id: "ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "CREATE OBJECT csv_with_names_zstd_bucket_key_id (TYPE SECRET) WITH value=\'fake_key_id\'" } stats_mode: STATS_MODE_NONE }
2025-12-08 21:34:37,540 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 456d504a-cca0-4e17-94a7-2dc91ca24804, ghrun-kcja2ts4ve.auto.internal:23724): response = { <_MultiThreadedRendezvous object> }
2025-12-08 21:34:39,445 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:39,446 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:39,447 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 7a772cbd-4fe8-4376-8c2f-80892b2a5c5b, ghrun-kcja2ts4ve.auto.internal:23724): creating call state
2025-12-08 21:34:39,447 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 7a772cbd-4fe8-4376-8c2f-80892b2a5c5b, ghrun-kcja2ts4ve.auto.internal:23724): request = { session_id: "ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "CREATE OBJECT csv_with_names_zstd_bucket_key_secret (TYPE SECRET) WITH value=\'fake_key_secret\'" } stats_mode: STATS_MODE_NONE }
2025-12-08 21:34:39,449 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 7a772cbd-4fe8-4376-8c2f-80892b2a5c5b, ghrun-kcja2ts4ve.auto.internal:23724): response = { <_MultiThreadedRendezvous object> }
2025-12-08 21:34:41,365 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:41,366 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:41,366 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 4c57bc75-f520-4cf1-af32-51e064b925c5, ghrun-kcja2ts4ve.auto.internal:23724): creating call state
2025-12-08 21:34:41,367 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 4c57bc75-f520-4cf1-af32-51e064b925c5, ghrun-kcja2ts4ve.auto.internal:23724): request = { session_id: "ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE EXTERNAL DATA SOURCE s3_source_csv_with_names_zstd WITH (\n                SOURCE_TYPE = \"ObjectStorage\",\n                LOCATION = \"http://localhost:28691/csv_with_names_zstd_bucket\",\n                AUTH_METHOD=\"AWS\",\n                AWS_ACCESS_KEY_ID_SECRET_NAME=\"csv_with_names_zstd_bucket_key_id\",\n                AWS_SECRET_ACCESS_KEY_SECRET_NAME=\"csv_with_names_zstd_bucket_key_secret\",\n                AWS_REGION=\"us-east-1\"\n            );\n\n            CREATE EXTERNAL TABLE s3_table_csv_with_names_zstd (\n                \n            c_int8 Int8,\n            c_int16 Int16,\n            c_int32 Int32 NOT NULL,\n            c_int64 Int64,\n            c_uint8 Uint8,\n            c_uint16 Uint16,\n            c_uint32 Uint32,\n            c_uint64 Uint64,\n            c_float Float,\n            c_double Double,\n            c_string String,\n            c_utf8 Utf8,\n            c_json Json,\n            c_date Date,\n            c_datetime Datetime,\n            c_timestamp Timestamp\n        \n            ) WITH (\n                DATA_SOURCE=\"s3_source_csv_with_names_zstd\",\n                LOCATION=\"/test_folder/\",\n                FORMAT=\"csv_with_names\",\n                COMPRESSION=\"zstd\"\n            );\n        " } stats_mode: STATS_MODE_NONE }
2025-12-08 21:34:41,369 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 4c57bc75-f520-4cf1-af32-51e064b925c5, ghrun-kcja2ts4ve.auto.internal:23724): response = { <_MultiThreadedRendezvous object> }
2025-12-08 21:34:41,823 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:41,824 - INFO - __tests__.test_types_and_formats - test_different_types_and_formats: Exporting into s3...
2025-12-08 21:34:41,824 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:41,825 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 9d326bf8-2405-43b2-bfc5-e1203fb921af, ghrun-kcja2ts4ve.auto.internal:23724): creating call state
2025-12-08 21:34:41,826 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 9d326bf8-2405-43b2-bfc5-e1203fb921af, ghrun-kcja2ts4ve.auto.internal:23724): request = { session_id: "ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "INSERT INTO s3_table_csv_with_names_zstd SELECT * FROM olap_table_csv_with_names_zstd" } stats_mode: STATS_MODE_NONE }
2025-12-08 21:34:41,828 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 9d326bf8-2405-43b2-bfc5-e1203fb921af, ghrun-kcja2ts4ve.auto.internal:23724): response = { <_MultiThreadedRendezvous object> }
2025-12-08 21:34:42,509 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:42,509 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-12-08 21:34:42,510 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-12-08 21:34:42,514 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7bdf93e8e310>
2025-12-08 21:34:42,515 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'csv_with_names_zstd_bucket'}
2025-12-08 21:34:42,517 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7bdf934b7110>
2025-12-08 21:34:42,517 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7bdf934b8fb0>
2025-12-08 21:34:42,517 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7bdf934b5a50>
2025-12-08 21:34:42,518 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b3f93785af0>>
2025-12-08 21:34:42,518 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7bdf934b9250>
2025-12-08 21:34:42,518 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7bdf934b57b0>
2025-12-08 21:34:42,518 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b3f93785af0>>
2025-12-08 21:34:42,519 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'csv_with_names_zstd_bucket', 'Region': 'us-east-1', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:28691', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-12-08 21:34:42,520 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:28691/csv_with_names_zstd_bucket
2025-12-08 21:34:42,521 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-12-08 21:34:42,521 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-12-08 21:34:42,522 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7bdf934b8a70>
2025-12-08 21:34:42,523 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7bdf934b9790>
2025-12-08 21:34:42,523 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7bdf934b5cf0>
2025-12-08 21:34:42,523 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/csv_with_names_zstd_bucket/', 'url': 'http://localhost:28691/csv_with_names_zstd_bucket?encoding-type=url', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7b3f9374b9b0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'csv_with_names_zstd_bucket', 'params': {'Bucket': 'csv_with_names_zstd_bucket', 'EncodingType': 'url'}}, 'signing': {'region': 'us-east-1', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-12-08 21:34:42,524 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b3f9374b970>>
2025-12-08 21:34:42,525 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b3f94ad9ef0>>
2025-12-08 21:34:42,525 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7bdf934b9410>
2025-12-08 21:34:42,526 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7bdf934b5890>
2025-12-08 21:34:42,527 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-12-08 21:34:42,527 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/csv_with_names_zstd_bucket
encoding-type=url
host:localhost:28691
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251208T213442Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-12-08 21:34:42,528 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251208T213442Z
20251208/us-east-1/s3/aws4_request
b00ce704fdbe09d4330208879ddf118610520ac22ba278389277d36dfc95de1b
2025-12-08 21:34:42,528 - DEBUG - botocore.auth - add_auth: Signature:
c1ea301fdf596f71fbfadc3a0405e99c7c7dd3cb8d7a802220a98efb5464665a
2025-12-08 21:34:42,529 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7bdf934b5b30>
2025-12-08 21:34:42,529 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:28691/csv_with_names_zstd_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251208T213442Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=fake_key_id/20251208/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=c1ea301fdf596f71fbfadc3a0405e99c7c7dd3cb8d7a802220a98efb5464665a', 'amz-sdk-invocation-id': b'86713cc6-225e-4dcd-9e7f-05dbaea12020', 'amz-sdk-request': b'attempt=1'}>
2025-12-08 21:34:42,531 - DEBUG - urllib3.connectionpool - _get_conn: Resetting dropped connection: localhost
2025-12-08 21:34:42,559 - DEBUG - urllib3.connectionpool - _make_request: http://localhost:28691 "GET /csv_with_names_zstd_bucket?encoding-type=url HTTP/1.1" 200 983
2025-12-08 21:34:42,560 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Mon, 08 Dec 2025 21:34:42 GMT', 'x-amzn-requestid': 'zhU1HrnVcwvde73W0AkrP2dPNmsa3vUyv4k00nBFqhcdFySpnQz5', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '983', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-12-08 21:34:42,561 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>csv_with_names_zstd_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>test_folder/m6vOt-lTe0OHk8_RDIFyia8ilk9iiSAP.csv.zst</Key><LastModified>2025-12-08T21:34:42.000Z</LastModified><ETag>&#34;e1be56597cde8629f823f1241d890ef0&#34;</ETag><Size>119</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>test_folder/zfOMqF1sAUyyBPN6o-p-aaw6pjNe_jwo.csv.zst</Key><LastModified>2025-12-08T21:34:42.000Z</LastModified><ETag>&#34;3ab57f8f53afeee2d63282f90c5d6d37&#34;</ETag><Size>164</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-12-08 21:34:42,564 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7b3f93783070>
2025-12-08 21:34:42,564 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-12-08 21:34:42,565 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b3f93785af0>>
2025-12-08 21:34:42,565 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7bdf934b7030>
2025-12-08 21:34:42,566 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-12-08 21:34:42,568 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-12-08 21:34:42,569 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7bdf93e94dd0>
2025-12-08 21:34:42,570 - INFO - __tests__.test_types_and_formats - test_different_types_and_formats: Exporting finished, bucket stats: (2, 283)
2025-12-08 21:34:42,570 - INFO - __tests__.test_types_and_formats - test_different_types_and_formats: Importing into ydb...
2025-12-08 21:34:42,571 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:42,571 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, a7d05e60-1f68-4a9b-a03a-2ddf8f0b3d24, ghrun-kcja2ts4ve.auto.internal:23724): creating call state
2025-12-08 21:34:42,572 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, a7d05e60-1f68-4a9b-a03a-2ddf8f0b3d24, ghrun-kcja2ts4ve.auto.internal:23724): request = { session_id: "ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            CREATE TABLE from_s3_csv_with_names_zstd (\n                PRIMARY KEY (c_int32)\n            ) WITH (\n                STORE = COLUMN\n            ) AS SELECT * FROM s3_table_csv_with_names_zstd\n        " } stats_mode: STATS_MODE_NONE }
2025-12-08 21:34:42,573 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, a7d05e60-1f68-4a9b-a03a-2ddf8f0b3d24, ghrun-kcja2ts4ve.auto.internal:23724): response = { <_MultiThreadedRendezvous object> }
2025-12-08 21:34:46,646 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:46,647 - DEBUG - ydb.query.pool - acquire: Acquired active session from queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:46,648 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteQuery, 0abcab09-9caa-4d2f-8802-d75605ad3113, ghrun-kcja2ts4ve.auto.internal:23724): creating call state
2025-12-08 21:34:46,649 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteQuery, 0abcab09-9caa-4d2f-8802-d75605ad3113, ghrun-kcja2ts4ve.auto.internal:23724): request = { session_id: "ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=" exec_mode: EXEC_MODE_EXECUTE query_content { syntax: SYNTAX_YQL_V1 text: "\n            SELECT\n                String::Hex(Sum(Digest::MurMurHash32(Pickle(TableRow())))) AS check_hash,\n                COUNT(*) AS check_size\n            FROM from_s3_csv_with_names_zstd;\n\n            SELECT\n                String::Hex(Sum(Digest::MurMurHash32(Pickle(TableRow())))) AS olap_hash,\n                COUNT(*) AS olap_size\n            FROM olap_table_csv_with_names_zstd;\n        " } stats_mode: STATS_MODE_NONE }
2025-12-08 21:34:46,650 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteQuery, 0abcab09-9caa-4d2f-8802-d75605ad3113, ghrun-kcja2ts4ve.auto.internal:23724): response = { <_MultiThreadedRendezvous object> }
2025-12-08 21:34:49,034 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-08 21:34:49,035 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-08 21:34:49,060 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database /Root
2025-12-08 21:34:49,061 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, a286f882-31d9-47f3-bcc8-59bb8864d503, localhost:23724): creating call state
2025-12-08 21:34:49,062 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, a286f882-31d9-47f3-bcc8-59bb8864d503, localhost:23724): request = { database: "/Root" }
2025-12-08 21:34:49,102 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, a286f882-31d9-47f3-bcc8-59bb8864d503, localhost:23724): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-kcja2ts4ve.auto.internal" port: 23724 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-08 21:34:49,104 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database /Root: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-kcja2ts4ve.auto.internal:23724, location 1, ssl: False>]>
2025-12-08 21:34:49,104 - INFO - ydb.connection - close: Closing channel for endpoint localhost:23724
2025-12-08 21:34:49,541 - DEBUG - ydb.query.pool - release: Session returned to queue: ydb://session/3?node_id=1&id=MTRkZmU3YmItMmRiNzIxZWYtMTIzOTI5YWEtYmRhMTY0OGM=
2025-12-08 21:34:49,544 - INFO - ya.test - pytest_runtest_teardown: Test teardown
