2025-11-10 10:15:09,706 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 10:15:09,707 - INFO - ya.test - pytest_runtest_setup: test_big_compression[v1-big.json.xz-xz]
2025-11-10 10:15:09,707 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 10:15:09,707 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-10 10:15:09,796 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_compressions.py::TestS3Compressions, test_name: test_big_compression[v1-big.json.xz-xz])
2025-11-10 10:15:09,797 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f9966639e50>
2025-11-10 10:15:09,800 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f996675d610>
2025-11-10 10:15:09,801 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f996620f890>
2025-11-10 10:15:09,801 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f996675d310>
2025-11-10 10:15:09,805 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 10:15:09,810 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 10:15:09,811 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 10:15:09,813 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 10:15:09,814 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-10 10:15:09,815 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-10 10:15:09,816 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-10 10:15:09,818 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f9966298350>
2025-11-10 10:15:09,818 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'fbucket', 'ACL': 'public-read'}
2025-11-10 10:15:09,819 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f996663bd10>
2025-11-10 10:15:09,820 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f99666665d0>
2025-11-10 10:15:09,820 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:09,820 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f99662ca590>>
2025-11-10 10:15:09,820 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f996663bad0>
2025-11-10 10:15:09,821 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f9966666810>
2025-11-10 10:15:09,821 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:09,822 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:10247', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True}
2025-11-10 10:15:09,823 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:10247/fbucket
2025-11-10 10:15:09,823 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:15:09,824 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:15:09,825 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f99666641d0>
2025-11-10 10:15:09,825 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f9949b85000>>
2025-11-10 10:15:09,826 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f996663a090>
2025-11-10 10:15:09,826 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f9966665c10>
2025-11-10 10:15:09,826 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read', 'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/fbucket/', 'url': 'http://localhost:10247/fbucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f994cde3030>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'ACL': 'public-read'}}, 'input_params': {'Bucket': 'fbucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 10:15:09,827 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f99663a9af0>>
2025-11-10 10:15:09,828 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f99662ca590>>
2025-11-10 10:15:09,828 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f996663b950>
2025-11-10 10:15:09,829 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f9966666750>
2025-11-10 10:15:09,829 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f9949b85000>>
2025-11-10 10:15:09,830 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:15:09,830 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/fbucket

host:localhost:10247
x-amz-acl:public-read
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T101509Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 10:15:09,830 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101509Z
20251110/yandex/s3/aws4_request
87baf8f9f34550751c8b0714fcf466b99b0b203a323d11e0a9eb15a3ea0dfe21
2025-11-10 10:15:09,830 - DEBUG - botocore.auth - add_auth: Signature:
ad7916e46195de3267617a45ffe40a631b76f34be1459784ceb0169ccda48e30
2025-11-10 10:15:09,831 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f9966666510>
2025-11-10 10:15:09,831 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:10247/fbucket, headers={'x-amz-acl': b'public-read', 'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T101509Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=ad7916e46195de3267617a45ffe40a631b76f34be1459784ceb0169ccda48e30', 'amz-sdk-invocation-id': b'763b7bee-7376-4545-92d2-511f39dfe68e', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-10 10:15:09,862 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:15:09 GMT', 'x-amzn-requestid': 'sUVSwnk8oIboPWEfoPEKN4McLfxST5NVjtkelWFyO2mszvOvBYsv', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '161', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:15:09,862 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>fbucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-10 10:15:09,863 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f9949b87030>
2025-11-10 10:15:09,864 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:15:09,864 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:09,865 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'sUVSwnk8oIboPWEfoPEKN4McLfxST5NVjtkelWFyO2mszvOvBYsv', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 10:15:09 GMT', 'x-amzn-requestid': 'sUVSwnk8oIboPWEfoPEKN4McLfxST5NVjtkelWFyO2mszvOvBYsv', 'content-type': 'text/html; charset=utf-8', 'content-length': '161', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-10 10:15:09,866 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'fbucket'}
2025-11-10 10:15:09,867 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7f9966665610>
2025-11-10 10:15:09,867 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7f996663bd10>
2025-11-10 10:15:09,867 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f99666665d0>
2025-11-10 10:15:09,867 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:09,868 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f99662ca590>>
2025-11-10 10:15:09,868 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7f996663bad0>
2025-11-10 10:15:09,873 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f9966666810>
2025-11-10 10:15:09,873 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:09,874 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:10247', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 10:15:09,875 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:10247/fbucket
2025-11-10 10:15:09,876 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:15:09,876 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:15:09,881 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7f99666641d0>
2025-11-10 10:15:09,882 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f9949b85000>>
2025-11-10 10:15:09,882 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7f996663a090>
2025-11-10 10:15:09,882 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7f9966665c10>
2025-11-10 10:15:09,883 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/fbucket/', 'url': 'http://localhost:10247/fbucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f994cde3030>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'EncodingType': 'url'}}, 'input_params': {'Bucket': 'fbucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 10:15:09,884 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f99663a9af0>>
2025-11-10 10:15:09,901 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f99662ca590>>
2025-11-10 10:15:09,902 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7f996663b950>
2025-11-10 10:15:09,902 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7f9966666750>
2025-11-10 10:15:09,903 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f9949b85000>>
2025-11-10 10:15:09,903 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:15:09,904 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/fbucket
encoding-type=url
host:localhost:10247
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T101509Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 10:15:09,904 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101509Z
20251110/yandex/s3/aws4_request
7cac3e2a2aea4a666f37408cfb2d4c7d516a6634e071cee767fe670c05b3bdc2
2025-11-10 10:15:09,904 - DEBUG - botocore.auth - add_auth: Signature:
db3349755cf5639e08d1e5d5b4c8953e15a9045224d608bd28129d52fdcfe999
2025-11-10 10:15:09,905 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7f9966666510>
2025-11-10 10:15:09,906 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:10247/fbucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T101509Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=db3349755cf5639e08d1e5d5b4c8953e15a9045224d608bd28129d52fdcfe999', 'amz-sdk-invocation-id': b'ed060520-02a2-4d44-8f05-1df86be0e74e', 'amz-sdk-request': b'attempt=1'}>
2025-11-10 10:15:09,926 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:15:09 GMT', 'x-amzn-requestid': 'mOow7k06cgCigpsIPczrOsMiTnUUyNphGJPO7sbup3TR8ZpiCFK2', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '556', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:15:09,927 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>fbucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>big.json.zst</Key><LastModified>2025-11-10T10:15:07.000Z</LastModified><ETag>&#34;4a3155feb051c2a039761e82cdec449f&#34;</ETag><Size>47</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-10 10:15:09,933 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f9949b87030>
2025-11-10 10:15:09,934 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:15:09,934 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:09,935 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7f99666656d0>
2025-11-10 10:15:09,935 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-10 10:15:09,936 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-10 10:15:09,942 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7f99662984d0>
2025-11-10 10:15:09,942 - DEBUG - boto3.resources.action - __call__: Calling s3:delete_objects with {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'big.json.zst'}]}}
2025-11-10 10:15:09,943 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function validate_bucket_name at 0x7f996663bd10>
2025-11-10 10:15:09,944 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f99666665d0>
2025-11-10 10:15:09,944 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:09,949 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f99662ca590>>
2025-11-10 10:15:09,949 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function generate_idempotent_uuid at 0x7f996663bad0>
2025-11-10 10:15:09,949 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f9966666810>
2025-11-10 10:15:09,950 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:09,950 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:10247', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 10:15:09,950 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:10247/fbucket
2025-11-10 10:15:09,951 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:15:09,951 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:15:09,956 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function escape_xml_payload at 0x7f996663b710>
2025-11-10 10:15:09,957 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function conditionally_calculate_checksum at 0x7f996686b950>
2025-11-10 10:15:09,965 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_expect_header at 0x7f99666641d0>
2025-11-10 10:15:09,967 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f9949b85000>>
2025-11-10 10:15:09,968 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_recursion_detection_header at 0x7f996663a090>
2025-11-10 10:15:09,968 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function inject_api_version_header_if_needed at 0x7f9966665c10>
2025-11-10 10:15:09,969 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=DeleteObjects) with params: {'url_path': '?delete', 'query_string': {}, 'method': 'POST', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': 'r6R+FrYPahG+IgjWrSNaFA=='}, 'body': b'<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Object><Key>big.json.zst</Key></Object></Delete>', 'auth_path': '/fbucket/', 'url': 'http://localhost:10247/fbucket?delete', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f994cde3030>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'big.json.zst'}]}}}, 'input_params': {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'big.json.zst'}]}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}, 'checksum': {'request_algorithm': 'conditional-md5'}}}
2025-11-10 10:15:09,970 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f99663a9af0>>
2025-11-10 10:15:09,973 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f99662ca590>>
2025-11-10 10:15:09,973 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <function set_operation_specific_signer at 0x7f996663b950>
2025-11-10 10:15:09,974 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <function remove_arn_from_signing_path at 0x7f9966666750>
2025-11-10 10:15:09,975 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f9949b85000>>
2025-11-10 10:15:09,976 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:15:09,976 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
POST
/fbucket
delete=
content-md5:r6R+FrYPahG+IgjWrSNaFA==
host:localhost:10247
x-amz-content-sha256:e1a0bcdce19d71dcd4159a8a56bd864c452bb1314dabde7e05d95eebc2629c81
x-amz-date:20251110T101509Z

content-md5;host;x-amz-content-sha256;x-amz-date
e1a0bcdce19d71dcd4159a8a56bd864c452bb1314dabde7e05d95eebc2629c81
2025-11-10 10:15:09,976 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101509Z
20251110/yandex/s3/aws4_request
1ef99b5483d5aba03927e307e3d052c17d219efd4525306e556f59d7d55ad8ae
2025-11-10 10:15:09,977 - DEBUG - botocore.auth - add_auth: Signature:
ce2fad4a01b876dfd4e22ced10db29af147e2bddd58b9d29af06aca21c2533db
2025-11-10 10:15:09,978 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <function add_retry_headers at 0x7f9966666510>
2025-11-10 10:15:09,979 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=http://localhost:10247/fbucket?delete, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': b'r6R+FrYPahG+IgjWrSNaFA==', 'X-Amz-Date': b'20251110T101509Z', 'X-Amz-Content-SHA256': b'e1a0bcdce19d71dcd4159a8a56bd864c452bb1314dabde7e05d95eebc2629c81', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=ce2fad4a01b876dfd4e22ced10db29af147e2bddd58b9d29af06aca21c2533db', 'amz-sdk-invocation-id': b'4648a648-8d50-4749-a21e-53c77b123bb5', 'amz-sdk-request': b'attempt=1', 'Content-Length': '105'}>
2025-11-10 10:15:10,005 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:15:10 GMT', 'x-amzn-requestid': 'eHya7y0UQYgBpCXcqa6rSc3noqnOWp7DFqgQIHiJf6vIlfeQh2Lq', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '156', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:15:10,006 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><DeleteResult xmlns="http://s3.amazonaws.com/doc/2006-03-01"><Deleted><Key>big.json.zst</Key></Deleted></DeleteResult>'
2025-11-10 10:15:10,008 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f9949b87030>
2025-11-10 10:15:10,008 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:15:10,009 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f9952b68100>>
2025-11-10 10:15:10,009 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'eHya7y0UQYgBpCXcqa6rSc3noqnOWp7DFqgQIHiJf6vIlfeQh2Lq', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 10:15:10 GMT', 'x-amzn-requestid': 'eHya7y0UQYgBpCXcqa6rSc3noqnOWp7DFqgQIHiJf6vIlfeQh2Lq', 'content-type': 'text/html; charset=utf-8', 'content-length': '156', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'Deleted': [{'Key': 'big.json.zst'}]}
2025-11-10 10:15:10,010 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f9966639e50>
2025-11-10 10:15:10,022 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f996675d610>
2025-11-10 10:15:10,023 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f996620f890>
2025-11-10 10:15:10,023 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f996675d310>
2025-11-10 10:15:10,027 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 10:15:10,033 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 10:15:10,041 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 10:15:10,052 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 10:15:10,054 - DEBUG - boto3.s3.transfer - _should_use_crt: Opting out of CRT Transfer Manager. Preferred client: auto, CRT available: False, Instance Optimized: False.
2025-11-10 10:15:10,054 - DEBUG - boto3.s3.transfer - create_transfer_manager: Using default client. pid: 2568257, thread: 140296912721024
2025-11-10 10:15:10,063 - DEBUG - s3transfer.utils - acquire: Acquiring 0
2025-11-10 10:15:10,069 - DEBUG - s3transfer.tasks - _wait_until_all_complete: UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f99495624f0>}) about to wait for the following futures []
2025-11-10 10:15:10,070 - DEBUG - s3transfer.tasks - _wait_until_all_complete: UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f99495624f0>}) done waiting for dependent futures
2025-11-10 10:15:10,071 - DEBUG - s3transfer.tasks - _execute_main: Executing task UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f99495624f0>}) with kwargs {'client': <botocore.client.S3 object at 0x7f994cd6b800>, 'config': <boto3.s3.transfer.TransferConfig object at 0x7f99491fb490>, 'osutil': <s3transfer.utils.OSUtils object at 0x7f99495634e0>, 'request_executor': <s3transfer.futures.BoundedExecutor object at 0x7f9949562d10>, 'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f99495624f0>}
2025-11-10 10:15:10,071 - DEBUG - s3transfer.futures - submit: Submitting task PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'big.json.xz', 'extra_args': {}}) to executor <s3transfer.futures.BoundedExecutor object at 0x7f9949562d10> for transfer request: 0.
2025-11-10 10:15:10,072 - DEBUG - s3transfer.utils - acquire: Acquiring 0
2025-11-10 10:15:10,072 - DEBUG - s3transfer.tasks - _wait_until_all_complete: PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'big.json.xz', 'extra_args': {}}) about to wait for the following futures []
2025-11-10 10:15:10,073 - DEBUG - s3transfer.tasks - _wait_until_all_complete: PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'big.json.xz', 'extra_args': {}}) done waiting for dependent futures
2025-11-10 10:15:10,074 - DEBUG - s3transfer.tasks - _execute_main: Executing task PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'big.json.xz', 'extra_args': {}}) with kwargs {'client': <botocore.client.S3 object at 0x7f994cd6b800>, 'fileobj': <s3transfer.utils.ReadFileChunk object at 0x7f9949563120>, 'bucket': 'fbucket', 'key': 'big.json.xz', 'extra_args': {}}
2025-11-10 10:15:10,075 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f9966664dd0>
2025-11-10 10:15:10,076 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f996663bdd0>
2025-11-10 10:15:10,076 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f9966665a90>
2025-11-10 10:15:10,073 - DEBUG - s3transfer.utils - release: Releasing acquire 0/None
2025-11-10 10:15:10,076 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f996663bd10>
2025-11-10 10:15:10,077 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f99666665d0>
2025-11-10 10:15:10,077 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f994996af90>>
2025-11-10 10:15:10,077 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f9952b20ba0>>
2025-11-10 10:15:10,078 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f996663bad0>
2025-11-10 10:15:10,078 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f9966666810>
2025-11-10 10:15:10,079 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f994996af90>>
2025-11-10 10:15:10,079 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:10247', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'Key': 'big.json.xz', 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 10:15:10,081 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:10247/fbucket
2025-11-10 10:15:10,081 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:15:10,082 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:15:10,083 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_checksum at 0x7f996686b950>
2025-11-10 10:15:10,083 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f99666641d0>
2025-11-10 10:15:10,084 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-10 10:15:10,084 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f994913a090>>
2025-11-10 10:15:10,084 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f996663a090>
2025-11-10 10:15:10,085 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f9966665c10>
2025-11-10 10:15:10,085 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/big.json.xz', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89', 'Content-MD5': 'FgBLf2Fk6E9mO9mq3s3Szg==', 'Expect': '100-continue'}, 'body': <s3transfer.utils.ReadFileChunk object at 0x7f9949563120>, 'auth_path': '/fbucket/big.json.xz', 'url': 'http://localhost:10247/fbucket/big.json.xz', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f9949155000>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'Key': 'big.json.xz', 'Body': <s3transfer.utils.ReadFileChunk object at 0x7f9949563120>}}, 'input_params': {'Bucket': 'fbucket', 'Key': 'big.json.xz'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 10:15:10,086 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function signal_not_transferring at 0x7f99499d0110>
2025-11-10 10:15:10,087 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f9949154920>>
2025-11-10 10:15:10,088 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f9952b20ba0>>
2025-11-10 10:15:10,088 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f996663b950>
2025-11-10 10:15:10,093 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f9966666750>
2025-11-10 10:15:10,093 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f994913a090>>
2025-11-10 10:15:10,094 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:15:10,094 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/fbucket/big.json.xz

content-md5:FgBLf2Fk6E9mO9mq3s3Szg==
host:localhost:10247
x-amz-content-sha256:4c9a175091c5bfcfe697f6e6ca5deab34ab01131108bcad552f30971cf5e3f42
x-amz-date:20251110T101510Z

content-md5;host;x-amz-content-sha256;x-amz-date
4c9a175091c5bfcfe697f6e6ca5deab34ab01131108bcad552f30971cf5e3f42
2025-11-10 10:15:10,095 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101510Z
20251110/yandex/s3/aws4_request
8d1cb4d8d6f84f8ee0aaff2cdcdbc0a1f9ce65ff5f6d4e9c87f9f176f9a1a0c0
2025-11-10 10:15:10,095 - DEBUG - botocore.auth - add_auth: Signature:
623adea000e980947abba97fd56e841c6ca220bab62d3174c560a189974f47eb
2025-11-10 10:15:10,095 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function signal_transferring at 0x7f99499d01d0>
2025-11-10 10:15:10,096 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f9966666510>
2025-11-10 10:15:10,096 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:10247/fbucket/big.json.xz, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89', 'Content-MD5': b'FgBLf2Fk6E9mO9mq3s3Szg==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251110T101510Z', 'X-Amz-Content-SHA256': b'4c9a175091c5bfcfe697f6e6ca5deab34ab01131108bcad552f30971cf5e3f42', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=623adea000e980947abba97fd56e841c6ca220bab62d3174c560a189974f47eb', 'amz-sdk-invocation-id': b'387f3943-cdfc-4cd4-8c2e-6a1f63981562', 'amz-sdk-request': b'attempt=1', 'Content-Length': '168'}>
2025-11-10 10:15:10,108 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-10 10:15:10,110 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-10 10:15:10,120 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:15:10 GMT', 'ETag': '"16004b7f6164e84f663bd9aadecdd2ce"', 'last-modified': 'Mon, 10 Nov 2025 10:15:10 GMT', 'x-amzn-requestid': 'STUtUC0yOmyOrumV61LUMnRZNk625s9XrOhQQdRVZqgIhvlNRVSA', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '0', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:15:10,120 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-10 10:15:10,123 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f9949138150>
2025-11-10 10:15:10,124 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:15:10,124 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f994996af90>>
2025-11-10 10:15:10,125 - DEBUG - s3transfer.utils - release: Releasing acquire 0/None
2025-11-10 10:15:10,127 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-10 10:15:10,178 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-10 10:15:10,220 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            SELECT count(*)\n            FROM `h4721057531150351144_test_big_compressionfruitbucket`.`big.json.xz`\n            WITH (format=json_each_row, compression=\"xz\", SCHEMA (\n                a String NOT NULL\n            ));\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "de8bd704-6041-4bf6-a799-21a7856e90ad"

2025-11-10 10:15:10,243 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsokopjr4e5466of"

2025-11-10 10:15:10,250 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokopjr4e5466of"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769710
        nanos: 224159000
      }
      modified_at {
        seconds: 1762769710
        nanos: 224159000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsokopjr49rm4ei9-ptqudsokopjr4e5466of"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769710
      nanos: 224159000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            SELECT count(*)\n            FROM `h4721057531150351144_test_big_compressionfruitbucket`.`big.json.xz`\n            WITH (format=json_each_row, compression=\"xz\", SCHEMA (\n                a String NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
}

2025-11-10 10:15:10,766 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-10 10:15:11,276 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokopjr4e5466of"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769710
        nanos: 224159000
      }
      modified_at {
        seconds: 1762769710
        nanos: 224159000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769710
      nanos: 956000000
    }
    execute_mode: RUN
    status: COMPLETING
    last_job_query_revision: 1
    last_job_id: "ptjudsokopjr49rm4ei9-ptqudsokopjr4e5466of"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769710
      nanos: 224159000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            SELECT count(*)\n            FROM `h4721057531150351144_test_big_compressionfruitbucket`.`big.json.xz`\n            WITH (format=json_each_row, compression=\"xz\", SCHEMA (\n                a String NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":13,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"DqPhyLength\"}]}},{\"Id\":11,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"Condense\"}]},\"DependsOn\":[13]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsList\"},{\"Name\":\"Iterator\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[11]},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":4,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":13,\"level\":1,\"name\":\"DqStage #13\",\"type\":\"op\"},{\"id\":11,\"level\":2,\"name\":\"DqStage #11\",\"type\":\"op\"},{\"id\":8,\"level\":3,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":4,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":5,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":13,\"target\":11},{\"source\":11,\"target\":8},{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.11s\",\"count\":2,\"avg\":\"58ms\",\"max\":\"80ms\",\"min\":\"35ms\"},\"IngressBytes\":{\"sum\":168,\"count\":1,\"avg\":168,\"max\":168,\"min\":168},\"IngressRows\":{\"sum\":5458,\"count\":1,\"avg\":5458,\"max\":5458,\"min\":5458},\"InputBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":8,\"count\":2,\"avg\":4,\"max\":4,\"min\":4},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "column0"
      type {
        type_id: UINT64
      }
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h4721057531150351144_test_big_compressionfruitbucket\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 (Bool \'\"true\"))\n(let $6 \'\"cluster:default_h4721057531150351144_test_big_compressionfruitbucket\")\n(let $7 (S3ParseSettings world \'(\'((String \'\"Paths {\\n  Name: \\\"big.json.xz\\\"\\n  Size: 168\\n  Read: true\\n}\\n\") $5 (AsStruct))) (SecureParam $6) \'\"\" \'\"big.json.xz \" \'\"json_each_row\" (StructType \'(\'\"a\" (DataType \'String))) (lambda \'($14) $5) \'(\'(\'\"compression\" \'\"xz\"))))\n(let $8 (DqStage \'((DqSource $4 $7)) (lambda \'($15) (block \'(\n  (let $16 (DqSourceWideWrap $15 $4 (StructType) \'(\'(\'format \'\"json_each_row\"))))\n  (return (DqPhyLength (NarrowMap $16 (lambda \'() (AsStruct))) \'\"_dq_agg_cnt\"))\n))) \'(\'(\'\"_logical_id\" \'209619))))\n(let $9 (DqStage \'((DqCnUnionAll (TDqOutput $8 \'\"0\"))) (lambda \'($17) (Condense $17 (Uint64 \'\"0\") (lambda \'($18 $19) (Bool \'false)) (lambda \'($20 $21) (AggrAdd $21 (Member $20 \'\"_dq_agg_cnt\"))))) \'(\'(\'\"_logical_id\" \'209644))))\n(let $10 (DqStage \'((DqPhyPrecompute (DqCnValue (TDqOutput $9 \'\"0\")))) (lambda \'($22) (FlatMap (Iterator (AsList $22)) (lambda \'($23) (Just (AsStruct \'(\'\"column0\" $23)))))) \'(\'(\'\"_logical_id\" \'209692))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($24) $24) \'(\'(\'\"_logical_id\" \'209772))))\n(let $12 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"column0\"))))\n(let $13 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) $12 \'\"dq\"))\n(return (Commit! (Commit! $13 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-10 10:15:11,785 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokopjr4e5466of"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769710
        nanos: 224159000
      }
      modified_at {
        seconds: 1762769710
        nanos: 224159000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769710
      nanos: 956000000
    }
    finished_at {
      seconds: 1762769711
      nanos: 239000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsokopjr49rm4ei9-ptqudsokopjr4e5466of"
    result_expire_at {
      seconds: 1762856110
      nanos: 944202000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769710
      nanos: 224159000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            SELECT count(*)\n            FROM `h4721057531150351144_test_big_compressionfruitbucket`.`big.json.xz`\n            WITH (format=json_each_row, compression=\"xz\", SCHEMA (\n                a String NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":13,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"DqPhyLength\"}]}},{\"Id\":11,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"Condense\"}]},\"DependsOn\":[13]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsList\"},{\"Name\":\"Iterator\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[11]},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":4,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":13,\"level\":1,\"name\":\"DqStage #13\",\"type\":\"op\"},{\"id\":11,\"level\":2,\"name\":\"DqStage #11\",\"type\":\"op\"},{\"id\":8,\"level\":3,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":4,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":5,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":13,\"target\":11},{\"source\":11,\"target\":8},{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.11s\",\"count\":2,\"avg\":\"58ms\",\"max\":\"80ms\",\"min\":\"35ms\"},\"IngressBytes\":{\"sum\":168,\"count\":1,\"avg\":168,\"max\":168,\"min\":168},\"IngressRows\":{\"sum\":5458,\"count\":1,\"avg\":5458,\"max\":5458,\"min\":5458},\"InputBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":8,\"count\":2,\"avg\":4,\"max\":4,\"min\":4},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}},\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"30ms\",\"count\":2,\"avg\":\"15ms\",\"max\":\"27ms\",\"min\":\"2ms\"},\"InputBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":8,\"count\":2,\"avg\":4,\"max\":4,\"min\":4},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":327680,\"count\":2,\"avg\":163840,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "column0"
      type {
        type_id: UINT64
      }
    }
    rows_count: 1
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h4721057531150351144_test_big_compressionfruitbucket\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 (Bool \'\"true\"))\n(let $6 \'\"cluster:default_h4721057531150351144_test_big_compressionfruitbucket\")\n(let $7 (S3ParseSettings world \'(\'((String \'\"Paths {\\n  Name: \\\"big.json.xz\\\"\\n  Size: 168\\n  Read: true\\n}\\n\") $5 (AsStruct))) (SecureParam $6) \'\"\" \'\"big.json.xz \" \'\"json_each_row\" (StructType \'(\'\"a\" (DataType \'String))) (lambda \'($14) $5) \'(\'(\'\"compression\" \'\"xz\"))))\n(let $8 (DqStage \'((DqSource $4 $7)) (lambda \'($15) (block \'(\n  (let $16 (DqSourceWideWrap $15 $4 (StructType) \'(\'(\'format \'\"json_each_row\"))))\n  (return (DqPhyLength (NarrowMap $16 (lambda \'() (AsStruct))) \'\"_dq_agg_cnt\"))\n))) \'(\'(\'\"_logical_id\" \'209619))))\n(let $9 (DqStage \'((DqCnUnionAll (TDqOutput $8 \'\"0\"))) (lambda \'($17) (Condense $17 (Uint64 \'\"0\") (lambda \'($18 $19) (Bool \'false)) (lambda \'($20 $21) (AggrAdd $21 (Member $20 \'\"_dq_agg_cnt\"))))) \'(\'(\'\"_logical_id\" \'209644))))\n(let $10 (DqStage \'((DqPhyPrecompute (DqCnValue (TDqOutput $9 \'\"0\")))) (lambda \'($22) (FlatMap (Iterator (AsList $22)) (lambda \'($23) (Just (AsStruct \'(\'\"column0\" $23)))))) \'(\'(\'\"_logical_id\" \'209692))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($24) $24) \'(\'(\'\"_logical_id\" \'209772))))\n(let $12 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"column0\"))))\n(let $13 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) $12 \'\"dq\"))\n(return (Commit! (Commit! $13 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-10 10:15:11,805 - DEBUG - root - test_big_compression: columns {
  name: "column0"
  type {
    type_id: UINT64
  }
}
rows {
  items {
    uint64_value: 5458
  }
}

2025-11-10 10:15:11,807 - INFO - ya.test - pytest_runtest_teardown: Test teardown
