2025-11-10 09:37:47,277 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 09:37:47,297 - INFO - ya.test - pytest_runtest_setup: test_multipart_insert_with_compression[v1-client0-gzip-csv_with_names]
2025-11-10 09:37:47,298 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 09:37:47,299 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-10 09:37:47,377 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_insert.py::TestS3, test_name: test_multipart_insert_with_compression[v1-client0-gzip-csv_with_names])
2025-11-10 09:37:47,381 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f48f3219f10>
2025-11-10 09:37:47,403 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f48f333d6d0>
2025-11-10 09:37:47,408 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f48df846f90>
2025-11-10 09:37:47,409 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f48f333d3d0>
2025-11-10 09:37:47,413 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 09:37:47,446 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 09:37:47,458 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 09:37:47,475 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 09:37:47,485 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-10 09:37:47,493 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-10 09:37:47,499 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-10 09:37:47,501 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f48df847a10>
2025-11-10 09:37:47,502 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'insert_bucket', 'ACL': 'public-read-write'}
2025-11-10 09:37:47,524 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f48f321bdd0>
2025-11-10 09:37:47,524 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f48f3246690>
2025-11-10 09:37:47,524 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,525 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f48f25dfd50>>
2025-11-10 09:37:47,525 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f48f321bb90>
2025-11-10 09:37:47,525 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f48f32468d0>
2025-11-10 09:37:47,526 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,526 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:6023', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True}
2025-11-10 09:37:47,528 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:6023/insert_bucket
2025-11-10 09:37:47,528 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:37:47,529 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:37:47,530 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f48f3244290>
2025-11-10 09:37:47,552 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48dbd52bd0>>
2025-11-10 09:37:47,553 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f48f321a150>
2025-11-10 09:37:47,553 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f48f3245cd0>
2025-11-10 09:37:47,554 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read-write', 'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:6023/insert_bucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f48d532fcb0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'ACL': 'public-read-write'}}, 'input_params': {'Bucket': 'insert_bucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 09:37:47,555 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f48d532f440>>
2025-11-10 09:37:47,572 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f48f25dfd50>>
2025-11-10 09:37:47,572 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f48f321ba10>
2025-11-10 09:37:47,573 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f48f3246810>
2025-11-10 09:37:47,573 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48dbd52bd0>>
2025-11-10 09:37:47,574 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:37:47,574 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/insert_bucket

host:localhost:6023
x-amz-acl:public-read-write
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T093747Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 09:37:47,574 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093747Z
20251110/yandex/s3/aws4_request
97276a7f0ca8b18b5de1aee6e01b4c62eb8cf931dbca504b4b73dceb831978d9
2025-11-10 09:37:47,574 - DEBUG - botocore.auth - add_auth: Signature:
213265e7c609de68d77d91fb99457a91937643c177fd78fd8e9387009ec40afc
2025-11-10 09:37:47,575 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f48f32465d0>
2025-11-10 09:37:47,575 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:6023/insert_bucket, headers={'x-amz-acl': b'public-read-write', 'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T093747Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=213265e7c609de68d77d91fb99457a91937643c177fd78fd8e9387009ec40afc', 'amz-sdk-invocation-id': b'a138c3c7-eb48-4c19-ac86-c6307a9c7102', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-10 09:37:47,576 - DEBUG - botocore.hooks - _emit: Event before-send.s3.CreateBucket: calling handler <moto.core.botocore_stubber.BotocoreStubber object at 0x7f48f243b580>
2025-11-10 09:37:47,637 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:37:47 GMT', 'x-amzn-requestid': 'gguCOdHJCBC4e4HPu00Pa3Mo2ZlGcfSFswpCFGi1oMhYmkeGmX8h', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '167', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:37:47,642 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>insert_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-10 09:37:47,643 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f48dbd52270>
2025-11-10 09:37:47,643 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:37:47,643 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,644 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'gguCOdHJCBC4e4HPu00Pa3Mo2ZlGcfSFswpCFGi1oMhYmkeGmX8h', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 09:37:47 GMT', 'x-amzn-requestid': 'gguCOdHJCBC4e4HPu00Pa3Mo2ZlGcfSFswpCFGi1oMhYmkeGmX8h', 'content-type': 'text/html; charset=utf-8', 'content-length': '167', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-10 09:37:47,644 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'insert_bucket'}
2025-11-10 09:37:47,645 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7f48f32456d0>
2025-11-10 09:37:47,645 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7f48f321bdd0>
2025-11-10 09:37:47,645 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f48f3246690>
2025-11-10 09:37:47,646 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,646 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f48f25dfd50>>
2025-11-10 09:37:47,646 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7f48f321bb90>
2025-11-10 09:37:47,646 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f48f32468d0>
2025-11-10 09:37:47,647 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,647 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:6023', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 09:37:47,648 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:6023/insert_bucket
2025-11-10 09:37:47,651 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:37:47,651 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:37:47,652 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7f48f3244290>
2025-11-10 09:37:47,653 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48dbd52bd0>>
2025-11-10 09:37:47,653 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7f48f321a150>
2025-11-10 09:37:47,653 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7f48f3245cd0>
2025-11-10 09:37:47,653 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:6023/insert_bucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f48d532fcb0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'EncodingType': 'url'}}, 'input_params': {'Bucket': 'insert_bucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 09:37:47,655 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f48d532f440>>
2025-11-10 09:37:47,655 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f48f25dfd50>>
2025-11-10 09:37:47,655 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7f48f321ba10>
2025-11-10 09:37:47,656 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7f48f3246810>
2025-11-10 09:37:47,660 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48dbd52bd0>>
2025-11-10 09:37:47,661 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:37:47,661 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/insert_bucket
encoding-type=url
host:localhost:6023
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T093747Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 09:37:47,661 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093747Z
20251110/yandex/s3/aws4_request
2077be5947e0967f388157ef517182e449782b282c4af802bc6012a701d205e8
2025-11-10 09:37:47,689 - DEBUG - botocore.auth - add_auth: Signature:
302a3280d4dccdc9cc650dfece4404dd0405397716c82653d05e7301ecd1f9b4
2025-11-10 09:37:47,691 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7f48f32465d0>
2025-11-10 09:37:47,691 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:6023/insert_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T093747Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=302a3280d4dccdc9cc650dfece4404dd0405397716c82653d05e7301ecd1f9b4', 'amz-sdk-invocation-id': b'3d69afc3-d440-47a2-8670-8b741e97c059', 'amz-sdk-request': b'attempt=1'}>
2025-11-10 09:37:47,694 - DEBUG - botocore.hooks - _emit: Event before-send.s3.ListObjects: calling handler <moto.core.botocore_stubber.BotocoreStubber object at 0x7f48f243b580>
2025-11-10 09:37:47,798 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:37:47 GMT', 'x-amzn-requestid': 'qqmAL7iDeaOl5Yt4xpqcSK4zac4Pa4tat1CeJHxWsq8etfFRrkVa', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '623', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:37:47,798 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>insert_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>test/ptjudsomro97lol9ig4f_0_WL0aipGVyUCH910_XVYZt1qtDp4z5G5p.json.gz</Key><LastModified>2025-11-10T09:37:45.000Z</LastModified><ETag>&#34;35f9da1008eded6f23c50c480a74f479-1&#34;</ETag><Size>56070</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-10 09:37:47,802 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f48dbd52270>
2025-11-10 09:37:47,802 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:37:47,802 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,803 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7f48f3245790>
2025-11-10 09:37:47,803 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-10 09:37:47,804 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-10 09:37:47,806 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7f48df847b90>
2025-11-10 09:37:47,807 - DEBUG - boto3.resources.action - __call__: Calling s3:delete_objects with {'Bucket': 'insert_bucket', 'Delete': {'Objects': [{'Key': 'test/ptjudsomro97lol9ig4f_0_WL0aipGVyUCH910_XVYZt1qtDp4z5G5p.json.gz'}]}}
2025-11-10 09:37:47,808 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function validate_bucket_name at 0x7f48f321bdd0>
2025-11-10 09:37:47,810 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f48f3246690>
2025-11-10 09:37:47,810 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,810 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f48f25dfd50>>
2025-11-10 09:37:47,810 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function generate_idempotent_uuid at 0x7f48f321bb90>
2025-11-10 09:37:47,811 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f48f32468d0>
2025-11-10 09:37:47,811 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,812 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:6023', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 09:37:47,843 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:6023/insert_bucket
2025-11-10 09:37:47,843 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:37:47,844 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:37:47,845 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function escape_xml_payload at 0x7f48f321b7d0>
2025-11-10 09:37:47,846 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function conditionally_calculate_checksum at 0x7f48f344ba10>
2025-11-10 09:37:47,846 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_expect_header at 0x7f48f3244290>
2025-11-10 09:37:47,847 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48dbd52bd0>>
2025-11-10 09:37:47,847 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_recursion_detection_header at 0x7f48f321a150>
2025-11-10 09:37:47,847 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function inject_api_version_header_if_needed at 0x7f48f3245cd0>
2025-11-10 09:37:47,847 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=DeleteObjects) with params: {'url_path': '?delete', 'query_string': {}, 'method': 'POST', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': 'i2YHPQaeyqXRRWnVCbB0Xg=='}, 'body': b'<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Object><Key>test/ptjudsomro97lol9ig4f_0_WL0aipGVyUCH910_XVYZt1qtDp4z5G5p.json.gz</Key></Object></Delete>', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:6023/insert_bucket?delete', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f48d532fcb0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'Delete': {'Objects': [{'Key': 'test/ptjudsomro97lol9ig4f_0_WL0aipGVyUCH910_XVYZt1qtDp4z5G5p.json.gz'}]}}}, 'input_params': {'Bucket': 'insert_bucket', 'Delete': {'Objects': [{'Key': 'test/ptjudsomro97lol9ig4f_0_WL0aipGVyUCH910_XVYZt1qtDp4z5G5p.json.gz'}]}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}, 'checksum': {'request_algorithm': 'conditional-md5'}}}
2025-11-10 09:37:47,849 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f48d532f440>>
2025-11-10 09:37:47,849 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f48f25dfd50>>
2025-11-10 09:37:47,850 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <function set_operation_specific_signer at 0x7f48f321ba10>
2025-11-10 09:37:47,850 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <function remove_arn_from_signing_path at 0x7f48f3246810>
2025-11-10 09:37:47,851 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48dbd52bd0>>
2025-11-10 09:37:47,851 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:37:47,852 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
POST
/insert_bucket
delete=
content-md5:i2YHPQaeyqXRRWnVCbB0Xg==
host:localhost:6023
x-amz-content-sha256:effc19cd8c0cb31786d64a8ffc32192ee9f66343fb2e38f64fe2265f0604b73c
x-amz-date:20251110T093747Z

content-md5;host;x-amz-content-sha256;x-amz-date
effc19cd8c0cb31786d64a8ffc32192ee9f66343fb2e38f64fe2265f0604b73c
2025-11-10 09:37:47,852 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093747Z
20251110/yandex/s3/aws4_request
46f998acb059a7aa0a00be506ccfd88570a1641ef03585e277523903db5fa37a
2025-11-10 09:37:47,852 - DEBUG - botocore.auth - add_auth: Signature:
e5d70b63e389e0a78bf03786104d75550c28b3f7ca238102df731b39ffd159e5
2025-11-10 09:37:47,853 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <function add_retry_headers at 0x7f48f32465d0>
2025-11-10 09:37:47,853 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=http://localhost:6023/insert_bucket?delete, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': b'i2YHPQaeyqXRRWnVCbB0Xg==', 'X-Amz-Date': b'20251110T093747Z', 'X-Amz-Content-SHA256': b'effc19cd8c0cb31786d64a8ffc32192ee9f66343fb2e38f64fe2265f0604b73c', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=e5d70b63e389e0a78bf03786104d75550c28b3f7ca238102df731b39ffd159e5', 'amz-sdk-invocation-id': b'150cc368-89d3-4a1a-a875-a8279d18dc25', 'amz-sdk-request': b'attempt=1', 'Content-Length': '161'}>
2025-11-10 09:37:47,854 - DEBUG - botocore.hooks - _emit: Event before-send.s3.DeleteObjects: calling handler <moto.core.botocore_stubber.BotocoreStubber object at 0x7f48f243b580>
2025-11-10 09:37:47,910 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:37:47 GMT', 'x-amzn-requestid': 'sgYOIgU4jTDcMa3X14bBCAEefoYAu0QkHWTUBX2MAeZqzy3OT6J5', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '212', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:37:47,911 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><DeleteResult xmlns="http://s3.amazonaws.com/doc/2006-03-01"><Deleted><Key>test/ptjudsomro97lol9ig4f_0_WL0aipGVyUCH910_XVYZt1qtDp4z5G5p.json.gz</Key></Deleted></DeleteResult>'
2025-11-10 09:37:47,912 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f48dbd52270>
2025-11-10 09:37:47,913 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:37:47,913 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e904c0>>
2025-11-10 09:37:47,914 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'sgYOIgU4jTDcMa3X14bBCAEefoYAu0QkHWTUBX2MAeZqzy3OT6J5', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 09:37:47 GMT', 'x-amzn-requestid': 'sgYOIgU4jTDcMa3X14bBCAEefoYAu0QkHWTUBX2MAeZqzy3OT6J5', 'content-type': 'text/html; charset=utf-8', 'content-length': '212', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'Deleted': [{'Key': 'test/ptjudsomro97lol9ig4f_0_WL0aipGVyUCH910_XVYZt1qtDp4z5G5p.json.gz'}]}
2025-11-10 09:37:47,953 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA s3.AtomicUploadCommit = \"true\";\n\n            INSERT INTO `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\"\n            ) SELECT * FROM AS_TABLE(ListReplicate(\n                <|data: \"hello world\"|>,\n                1000000\n            ))\n        "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "84b13928-0d28-46c4-8380-afeeaa144bdf"

2025-11-10 09:37:48,001 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsomrk05348s22ec"

2025-11-10 09:37:48,011 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomrk05348s22ec"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767467
        nanos: 965262000
      }
      modified_at {
        seconds: 1762767467
        nanos: 965262000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsomrk052u4dqt36-ptqudsomrk05348s22ec"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767467
      nanos: 965262000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA s3.AtomicUploadCommit = \"true\";\n\n            INSERT INTO `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\"\n            ) SELECT * FROM AS_TABLE(ListReplicate(\n                <|data: \"hello world\"|>,\n                1000000\n            ))\n        "
    syntax: YQL_V1
  }
}

2025-11-10 09:37:48,519 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-10 09:37:49,028 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomrk05348s22ec"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767467
        nanos: 965262000
      }
      modified_at {
        seconds: 1762767467
        nanos: 965262000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767468
      nanos: 979000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsomrk052u4dqt36-ptqudsomrk05348s22ec"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767467
      nanos: 965262000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA s3.AtomicUploadCommit = \"true\";\n\n            INSERT INTO `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\"\n            ) SELECT * FROM AS_TABLE(ListReplicate(\n                <|data: \"hello world\"|>,\n                1000000\n            ))\n        "
    syntax: YQL_V1
  }
}

2025-11-10 09:37:49,535 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomrk05348s22ec"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767467
        nanos: 965262000
      }
      modified_at {
        seconds: 1762767467
        nanos: 965262000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767468
      nanos: 979000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsomrk052u4dqt36-ptqudsomrk05348s22ec"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767467
      nanos: 965262000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA s3.AtomicUploadCommit = \"true\";\n\n            INSERT INTO `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\"\n            ) SELECT * FROM AS_TABLE(ListReplicate(\n                <|data: \"hello world\"|>,\n                1000000\n            ))\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"Replicate\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 \'\"h5071492044589720035_test_multipart_insert_with_compressionibucket_compression\")\n(let $4 (DataSink \'\"s3\" $3))\n(let $5 \'\"cluster:default_h5071492044589720035_test_multipart_insert_with_compressionibucket_compression\")\n(let $6 (S3SinkSettings \'\"test/\" \'(\'(\'\"compression\" \'\"gzip\") \'(\'\"multipart\" \'\"true\")) (SecureParam $5) \'\".csv.gz\" (StructType \'(\'\"data\" (DataType \'String)))))\n(return (Commit! (DqQuery! $2 \'((DqStage \'() (lambda \'() (block \'(\n  (let $7 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput (ToFlow (Replicate (AsStruct \'(\'\"data\" (String \'\"hello world\"))) (Uint64 \'1000000))) \'\"csv_with_names\" \'() $7))\n))) \'() \'((DqSink \'0 $4 $6))))) $4))\n)\n"
  }
}

2025-11-10 09:37:50,073 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomrk05348s22ec"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767467
        nanos: 965262000
      }
      modified_at {
        seconds: 1762767467
        nanos: 965262000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767468
      nanos: 979000000
    }
    execute_mode: RUN
    status: COMPLETING
    last_job_query_revision: 1
    last_job_id: "ptjudsomrk052u4dqt36-ptqudsomrk05348s22ec"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767467
      nanos: 965262000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA s3.AtomicUploadCommit = \"true\";\n\n            INSERT INTO `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\"\n            ) SELECT * FROM AS_TABLE(ListReplicate(\n                <|data: \"hello world\"|>,\n                1000000\n            ))\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"Replicate\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 \'\"h5071492044589720035_test_multipart_insert_with_compressionibucket_compression\")\n(let $4 (DataSink \'\"s3\" $3))\n(let $5 \'\"cluster:default_h5071492044589720035_test_multipart_insert_with_compressionibucket_compression\")\n(let $6 (S3SinkSettings \'\"test/\" \'(\'(\'\"compression\" \'\"gzip\") \'(\'\"multipart\" \'\"true\")) (SecureParam $5) \'\".csv.gz\" (StructType \'(\'\"data\" (DataType \'String)))))\n(return (Commit! (DqQuery! $2 \'((DqStage \'() (lambda \'() (block \'(\n  (let $7 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput (ToFlow (Replicate (AsStruct \'(\'\"data\" (String \'\"hello world\"))) (Uint64 \'1000000))) \'\"csv_with_names\" \'() $7))\n))) \'() \'((DqSink \'0 $4 $6))))) $4))\n)\n"
  }
}

2025-11-10 09:37:50,581 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomrk05348s22ec"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767467
        nanos: 965262000
      }
      modified_at {
        seconds: 1762767467
        nanos: 965262000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767468
      nanos: 979000000
    }
    finished_at {
      seconds: 1762767470
      nanos: 18000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsomrk052u4dqt36-ptqudsomrk05348s22ec"
    result_expire_at {
      seconds: 1762853868
      nanos: 968314000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767467
      nanos: 965262000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA s3.AtomicUploadCommit = \"true\";\n\n            INSERT INTO `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\"\n            ) SELECT * FROM AS_TABLE(ListReplicate(\n                <|data: \"hello world\"|>,\n                1000000\n            ))\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"Replicate\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.95s\",\"count\":1,\"avg\":\"0.95s\",\"max\":\"0.95s\",\"min\":\"0.95s\"},\"EgressBytes\":{\"sum\":27475,\"count\":1,\"avg\":27475,\"max\":27475,\"min\":27475},\"EgressRows\":{\"sum\":21,\"count\":1,\"avg\":21,\"max\":21,\"min\":21},\"MaxMemoryUsage\":{\"sum\":1664704,\"count\":1,\"avg\":1664704,\"max\":1664704,\"min\":1664704},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 \'\"h5071492044589720035_test_multipart_insert_with_compressionibucket_compression\")\n(let $4 (DataSink \'\"s3\" $3))\n(let $5 \'\"cluster:default_h5071492044589720035_test_multipart_insert_with_compressionibucket_compression\")\n(let $6 (S3SinkSettings \'\"test/\" \'(\'(\'\"compression\" \'\"gzip\") \'(\'\"multipart\" \'\"true\")) (SecureParam $5) \'\".csv.gz\" (StructType \'(\'\"data\" (DataType \'String)))))\n(return (Commit! (DqQuery! $2 \'((DqStage \'() (lambda \'() (block \'(\n  (let $7 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput (ToFlow (Replicate (AsStruct \'(\'\"data\" (String \'\"hello world\"))) (Uint64 \'1000000))) \'\"csv_with_names\" \'() $7))\n))) \'() \'((DqSink \'0 $4 $6))))) $4))\n)\n"
  }
}

2025-11-10 09:37:50,589 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            SELECT\n                MIN(data) AS min_data,\n                MAX(data) AS max_data\n            FROM `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\",\n                SCHEMA (\n                    data Utf8 NOT NULL\n                )\n            )\n        "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "5c19bef4-f9a1-44a3-92f2-9318c2a80055"

2025-11-10 09:37:50,605 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsomrhfvbvo1mku4"

2025-11-10 09:37:50,617 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomrhfvbvo1mku4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767470
        nanos: 592575000
      }
      modified_at {
        seconds: 1762767470
        nanos: 592575000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsomrhfvblkemajn-ptqudsomrhfvbvo1mku4"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767470
      nanos: 592575000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            SELECT\n                MIN(data) AS min_data,\n                MAX(data) AS max_data\n            FROM `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\",\n                SCHEMA (\n                    data Utf8 NOT NULL\n                )\n            )\n        "
    syntax: YQL_V1
  }
}

2025-11-10 09:37:51,137 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomrhfvbvo1mku4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767470
        nanos: 592575000
      }
      modified_at {
        seconds: 1762767470
        nanos: 592575000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767470
      nanos: 975000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsomrhfvblkemajn-ptqudsomrhfvbvo1mku4"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767470
      nanos: 592575000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            SELECT\n                MIN(data) AS min_data,\n                MAX(data) AS max_data\n            FROM `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\",\n                SCHEMA (\n                    data Utf8 NOT NULL\n                )\n            )\n        "
    syntax: YQL_V1
  }
}

2025-11-10 09:37:51,650 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-10 09:37:52,218 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomrhfvbvo1mku4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767470
        nanos: 592575000
      }
      modified_at {
        seconds: 1762767470
        nanos: 592575000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767470
      nanos: 975000000
    }
    finished_at {
      seconds: 1762767471
      nanos: 996000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsomrhfvblkemajn-ptqudsomrhfvbvo1mku4"
    result_expire_at {
      seconds: 1762853870
      nanos: 968327000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767470
      nanos: 592575000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            SELECT\n                MIN(data) AS min_data,\n                MAX(data) AS max_data\n            FROM `h5071492044589720035_test_multipart_insert_with_compressionibucket_compression`.`test/` WITH (\n                FORMAT = \"csv_with_names\",\n                COMPRESSION = \"gzip\",\n                SCHEMA (\n                    data Utf8 NOT NULL\n                )\n            )\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":13,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"CombineByKey\"}]}},{\"Id\":11,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"PartitionsByKeys\"},{\"Name\":\"Take\"},{\"Name\":\"Condense\"}]},\"DependsOn\":[13]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsList\"},{\"Name\":\"Iterator\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[11]},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":4,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":13,\"level\":1,\"name\":\"DqStage #13\",\"type\":\"op\"},{\"id\":11,\"level\":2,\"name\":\"DqStage #11\",\"type\":\"op\"},{\"id\":8,\"level\":3,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":4,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":5,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":13,\"target\":11},{\"source\":11,\"target\":8},{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"1.06s\",\"count\":2,\"avg\":\"0.53s\",\"max\":\"0.73s\",\"min\":\"0.33s\"},\"IngressBytes\":{\"sum\":27475,\"count\":1,\"avg\":27475,\"max\":27475,\"min\":27475},\"IngressRows\":{\"sum\":1000000,\"count\":1,\"avg\":1000000,\"max\":1000000,\"min\":1000000},\"InputBytes\":{\"sum\":29,\"count\":1,\"avg\":29,\"max\":29,\"min\":29},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":59,\"count\":2,\"avg\":29,\"max\":30,\"min\":29},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":327680,\"count\":2,\"avg\":163840,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}},\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"52ms\",\"count\":2,\"avg\":\"26ms\",\"max\":\"49ms\",\"min\":\"2ms\"},\"InputBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":60,\"count\":2,\"avg\":30,\"max\":30,\"min\":30},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":327680,\"count\":2,\"avg\":163840,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "min_data"
      type {
        optional_type {
          item {
            type_id: UTF8
          }
        }
      }
    }
    column {
      name: "max_data"
      type {
        optional_type {
          item {
            type_id: UTF8
          }
        }
      }
    }
    rows_count: 1
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h5071492044589720035_test_multipart_insert_with_compressionibucket_compression\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 \'\"Paths {\\n  Name: \\\"test\\\"\\n  Children {\\n    Name: \\\"ptjudsomrk052u4dqt36_0_EmIBgLQS0EaUMM82V1Ehhw854t224nl8.csv.gz\\\"\\n    Size: 27475\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $6 (Bool \'\"true\"))\n(let $7 \'\"cluster:default_h5071492044589720035_test_multipart_insert_with_compressionibucket_compression\")\n(let $8 (DataType \'Utf8))\n(let $9 (StructType \'(\'\"data\" $8)))\n(let $10 (S3ParseSettings world \'(\'((String $5) $6 (AsStruct))) (SecureParam $7) \'\"\" \'\"test/ \" \'\"csv_with_names\" $9 (lambda \'($18) $6) \'(\'(\'\"compression\" \'\"gzip\"))))\n(let $11 (Uint32 \'0))\n(let $12 (DqStage \'((DqSource $4 $10)) (lambda \'($19) (block \'(\n  (let $20 (DqSourceWideWrap $19 $4 $9 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (CombineByKey (NarrowMap $20 (lambda \'($21) (AsStruct \'(\'\"data\" $21)))) (lambda \'($22) (Just $22)) (lambda \'($23) $11) (lambda \'($24 $25) (block \'(\n    (let $26 (Member $25 \'\"data\"))\n    (return (AsStruct \'(\'_yql_agg_0 $26) \'(\'_yql_agg_1 $26)))\n  ))) (lambda \'($27 $28 $29) (block \'(\n    (let $30 (Member $28 \'\"data\"))\n    (return (AsStruct \'(\'_yql_agg_0 (AggrMax $30 (Member $29 \'_yql_agg_0))) \'(\'_yql_agg_1 (AggrMin $30 (Member $29 \'_yql_agg_1)))))\n  ))) (lambda \'($31 $32) (Just $32))))\n))) \'(\'(\'\"_logical_id\" \'210160))))\n(let $13 (DqStage \'((DqCnUnionAll (TDqOutput $12 \'0))) (lambda \'($33) (block \'(\n  (let $34 (lambda \'($36) $11))\n  (let $35 (PartitionsByKeys $33 $34 (Void) (Void) (lambda \'($37) (block \'(\n    (let $38 (Condense1 $37 (lambda \'($39) $39) (lambda \'($40 $41) (IsKeySwitch $40 $41 $34 $34)) (lambda \'($42 $43) (AsStruct \'(\'_yql_agg_0 (AggrMax (Member $42 \'_yql_agg_0) (Member $43 \'_yql_agg_0))) \'(\'_yql_agg_1 (AggrMin (Member $42 \'_yql_agg_1) (Member $43 \'_yql_agg_1)))))))\n    (return (FlatMap $38 (lambda \'($44) (Just (AsStruct \'(\'Max0 (Member $44 \'_yql_agg_0)) \'(\'Min0 (Member $44 \'_yql_agg_1)))))))\n  )))))\n  (return (Condense (Take $35 (Uint64 \'\"1\")) (Nothing (OptionalType (StructType \'(\'Max0 $8) \'(\'Min0 $8)))) (lambda \'($45 $46) (Bool \'false)) (lambda \'($47 $48) (Just $47))))\n))) \'(\'(\'\"_logical_id\" \'210447))))\n(let $14 (DqStage \'((DqPhyPrecompute (DqCnValue (TDqOutput $13 \'0)))) (lambda \'($49) (FlatMap (Iterator (AsList $49)) (lambda \'($50) (Just (AsStruct \'(\'\"max_data\" (Member $50 \'Max0)) \'(\'\"min_data\" (Member $50 \'Min0))))))) \'(\'(\'\"_logical_id\" \'210508))))\n(let $15 (DqStage \'((DqCnUnionAll (TDqOutput $14 \'0))) (lambda \'($51) $51) \'(\'(\'\"_logical_id\" \'210597))))\n(let $16 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"min_data\" \'\"max_data\"))))\n(let $17 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $15 \'0) \'()) $16 \'\"dq\"))\n(return (Commit! (Commit! $17 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-10 09:37:52,252 - DEBUG - root - test_multipart_insert_with_compression: columns {
  name: "min_data"
  type {
    optional_type {
      item {
        type_id: UTF8
      }
    }
  }
}
columns {
  name: "max_data"
  type {
    optional_type {
      item {
        type_id: UTF8
      }
    }
  }
}
rows {
  items {
    text_value: "hello world"
  }
  items {
    text_value: "hello world"
  }
}

2025-11-10 09:37:52,254 - INFO - ya.test - pytest_runtest_teardown: Test teardown
