2025-11-10 09:34:30,016 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 09:34:30,017 - INFO - ya.test - pytest_runtest_setup: test_date_simple[v1-date/simple/test.parquet-parquet]
2025-11-10 09:34:30,017 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 09:34:30,017 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-10 09:34:30,222 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_format_setting.py::TestS3, test_name: test_date_simple[v1-date/simple/test.parquet-parquet])
2025-11-10 09:34:30,223 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f61bd189e50>
2025-11-10 09:34:30,233 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f61bd2ad610>
2025-11-10 09:34:30,247 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f61bb9be750>
2025-11-10 09:34:30,248 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f61bd2ad310>
2025-11-10 09:34:30,261 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 09:34:30,276 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 09:34:30,362 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 09:34:30,364 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 09:34:30,370 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-10 09:34:30,479 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-10 09:34:30,480 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-10 09:34:30,482 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f61bb9bf1d0>
2025-11-10 09:34:30,482 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'fbucket', 'ACL': 'public-read'}
2025-11-10 09:34:30,484 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f61bd18bd10>
2025-11-10 09:34:30,484 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f61bd1b65d0>
2025-11-10 09:34:30,484 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,488 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f619fe30330>>
2025-11-10 09:34:30,488 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f61bd18bad0>
2025-11-10 09:34:30,489 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f61bd1b6810>
2025-11-10 09:34:30,489 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,490 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:26482', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True}
2025-11-10 09:34:30,492 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:26482/fbucket
2025-11-10 09:34:30,492 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:34:30,493 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:34:30,494 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f61bd1b41d0>
2025-11-10 09:34:30,494 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f619fe41a00>>
2025-11-10 09:34:30,494 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f61bd18a090>
2025-11-10 09:34:30,494 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f61bd1b5c10>
2025-11-10 09:34:30,495 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read', 'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/fbucket/', 'url': 'http://localhost:26482/fbucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f619fede040>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'ACL': 'public-read'}}, 'input_params': {'Bucket': 'fbucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 09:34:30,501 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f619feddf50>>
2025-11-10 09:34:30,502 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f619fe30330>>
2025-11-10 09:34:30,502 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f61bd18b950>
2025-11-10 09:34:30,503 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f61bd1b6750>
2025-11-10 09:34:30,503 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f619fe41a00>>
2025-11-10 09:34:30,504 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:34:30,504 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/fbucket

host:localhost:26482
x-amz-acl:public-read
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T093430Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 09:34:30,504 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093430Z
20251110/yandex/s3/aws4_request
389ab0b5a2f4f79d20d5ff633c0caf273088fd672eda3818c3243ad42ccec892
2025-11-10 09:34:30,504 - DEBUG - botocore.auth - add_auth: Signature:
723cbb787d608d2e4211c1a6969c4aebc0dc6995b8223a53b1bf4789b275c857
2025-11-10 09:34:30,505 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f61bd1b6510>
2025-11-10 09:34:30,505 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:26482/fbucket, headers={'x-amz-acl': b'public-read', 'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T093430Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=723cbb787d608d2e4211c1a6969c4aebc0dc6995b8223a53b1bf4789b275c857', 'amz-sdk-invocation-id': b'b782e765-3b32-4838-acf2-d1473b62176a', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-10 09:34:30,526 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:34:30 GMT', 'x-amzn-requestid': 'CVGWw3NVeawaFA0Cqo1qgA0k6WQwxlYJVNNvIBckFX73tdaXw6Us', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '161', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:34:30,605 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>fbucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-10 09:34:30,606 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f619fe41dc0>
2025-11-10 09:34:30,606 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:34:30,607 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,607 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'CVGWw3NVeawaFA0Cqo1qgA0k6WQwxlYJVNNvIBckFX73tdaXw6Us', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 09:34:30 GMT', 'x-amzn-requestid': 'CVGWw3NVeawaFA0Cqo1qgA0k6WQwxlYJVNNvIBckFX73tdaXw6Us', 'content-type': 'text/html; charset=utf-8', 'content-length': '161', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-10 09:34:30,608 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'fbucket'}
2025-11-10 09:34:30,609 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7f61bd1b5610>
2025-11-10 09:34:30,610 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7f61bd18bd10>
2025-11-10 09:34:30,610 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f61bd1b65d0>
2025-11-10 09:34:30,610 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,610 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f619fe30330>>
2025-11-10 09:34:30,610 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7f61bd18bad0>
2025-11-10 09:34:30,611 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f61bd1b6810>
2025-11-10 09:34:30,611 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,612 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:26482', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 09:34:30,634 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:26482/fbucket
2025-11-10 09:34:30,634 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:34:30,635 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:34:30,636 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7f61bd1b41d0>
2025-11-10 09:34:30,636 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f619fe41a00>>
2025-11-10 09:34:30,636 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7f61bd18a090>
2025-11-10 09:34:30,636 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7f61bd1b5c10>
2025-11-10 09:34:30,637 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/fbucket/', 'url': 'http://localhost:26482/fbucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f619fede040>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'EncodingType': 'url'}}, 'input_params': {'Bucket': 'fbucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 09:34:30,638 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f619feddf50>>
2025-11-10 09:34:30,639 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f619fe30330>>
2025-11-10 09:34:30,639 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7f61bd18b950>
2025-11-10 09:34:30,639 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7f61bd1b6750>
2025-11-10 09:34:30,640 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f619fe41a00>>
2025-11-10 09:34:30,641 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:34:30,641 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/fbucket
encoding-type=url
host:localhost:26482
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T093430Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 09:34:30,641 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093430Z
20251110/yandex/s3/aws4_request
c00da06cd94e7d273b9d4c344745a318a3ddcfd17be4161823801fee252abd86
2025-11-10 09:34:30,641 - DEBUG - botocore.auth - add_auth: Signature:
35fd5c9ddfae34eb6fafc8e10a9973515845c01b8485f26477e449a70a6485e2
2025-11-10 09:34:30,642 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7f61bd1b6510>
2025-11-10 09:34:30,642 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:26482/fbucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T093430Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=35fd5c9ddfae34eb6fafc8e10a9973515845c01b8485f26477e449a70a6485e2', 'amz-sdk-invocation-id': b'10ab0e24-88e0-4056-a699-c0005104e08b', 'amz-sdk-request': b'attempt=1'}>
2025-11-10 09:34:30,713 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:34:30 GMT', 'x-amzn-requestid': '7CREGKQcTe2evd2cfoYHfHxgcJBf39lDLJSrzmlpDQPjzJvXPGI3', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '566', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:34:30,713 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>fbucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>date/simple/test.json</Key><LastModified>2025-11-10T09:34:28.000Z</LastModified><ETag>&#34;16d80472fb5b4834a04a7e2b92f528df&#34;</ETag><Size>185</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-10 09:34:30,716 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f619fe41dc0>
2025-11-10 09:34:30,716 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:34:30,723 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,724 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7f61bd1b56d0>
2025-11-10 09:34:30,724 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-10 09:34:30,724 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-10 09:34:30,726 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7f61bb9bf350>
2025-11-10 09:34:30,727 - DEBUG - boto3.resources.action - __call__: Calling s3:delete_objects with {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'date/simple/test.json'}]}}
2025-11-10 09:34:30,736 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function validate_bucket_name at 0x7f61bd18bd10>
2025-11-10 09:34:30,737 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f61bd1b65d0>
2025-11-10 09:34:30,769 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,769 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f619fe30330>>
2025-11-10 09:34:30,769 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function generate_idempotent_uuid at 0x7f61bd18bad0>
2025-11-10 09:34:30,770 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f61bd1b6810>
2025-11-10 09:34:30,770 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,771 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:26482', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 09:34:30,771 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:26482/fbucket
2025-11-10 09:34:30,771 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:34:30,771 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:34:30,773 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function escape_xml_payload at 0x7f61bd18b710>
2025-11-10 09:34:30,773 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function conditionally_calculate_checksum at 0x7f61bd3bb950>
2025-11-10 09:34:30,774 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_expect_header at 0x7f61bd1b41d0>
2025-11-10 09:34:30,774 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f619fe41a00>>
2025-11-10 09:34:30,774 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_recursion_detection_header at 0x7f61bd18a090>
2025-11-10 09:34:30,774 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function inject_api_version_header_if_needed at 0x7f61bd1b5c10>
2025-11-10 09:34:30,774 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=DeleteObjects) with params: {'url_path': '?delete', 'query_string': {}, 'method': 'POST', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': 'Oz/lqdHKP+uLGxWwl9yRKQ=='}, 'body': b'<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Object><Key>date/simple/test.json</Key></Object></Delete>', 'auth_path': '/fbucket/', 'url': 'http://localhost:26482/fbucket?delete', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f619fede040>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'date/simple/test.json'}]}}}, 'input_params': {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'date/simple/test.json'}]}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}, 'checksum': {'request_algorithm': 'conditional-md5'}}}
2025-11-10 09:34:30,776 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f619feddf50>>
2025-11-10 09:34:30,776 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f619fe30330>>
2025-11-10 09:34:30,784 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <function set_operation_specific_signer at 0x7f61bd18b950>
2025-11-10 09:34:30,785 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <function remove_arn_from_signing_path at 0x7f61bd1b6750>
2025-11-10 09:34:30,785 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f619fe41a00>>
2025-11-10 09:34:30,786 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:34:30,786 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
POST
/fbucket
delete=
content-md5:Oz/lqdHKP+uLGxWwl9yRKQ==
host:localhost:26482
x-amz-content-sha256:e0a4547502f3d27df411ec4a8dd6aa6267fddece2c58628349dc622e0998803d
x-amz-date:20251110T093430Z

content-md5;host;x-amz-content-sha256;x-amz-date
e0a4547502f3d27df411ec4a8dd6aa6267fddece2c58628349dc622e0998803d
2025-11-10 09:34:30,786 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093430Z
20251110/yandex/s3/aws4_request
56dab4f24ee78d9bd0ca190e01eae4a88ffd6e79d9d079dd96e1fa8ac4fffc71
2025-11-10 09:34:30,786 - DEBUG - botocore.auth - add_auth: Signature:
e84faf4b9d57ac7add07f3b8989724f97c34f674f106895668a26618352f40b5
2025-11-10 09:34:30,787 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <function add_retry_headers at 0x7f61bd1b6510>
2025-11-10 09:34:30,787 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=http://localhost:26482/fbucket?delete, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': b'Oz/lqdHKP+uLGxWwl9yRKQ==', 'X-Amz-Date': b'20251110T093430Z', 'X-Amz-Content-SHA256': b'e0a4547502f3d27df411ec4a8dd6aa6267fddece2c58628349dc622e0998803d', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=e84faf4b9d57ac7add07f3b8989724f97c34f674f106895668a26618352f40b5', 'amz-sdk-invocation-id': b'fe32f295-6768-4dc0-be72-85422a9a53b9', 'amz-sdk-request': b'attempt=1', 'Content-Length': '114'}>
2025-11-10 09:34:30,819 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:34:30 GMT', 'x-amzn-requestid': 'EyorULmGlLG2r6Cb9DdZBxCebrudhkrcnwkiUaGD8B6QHDuLof1D', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '165', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:34:30,819 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><DeleteResult xmlns="http://s3.amazonaws.com/doc/2006-03-01"><Deleted><Key>date/simple/test.json</Key></Deleted></DeleteResult>'
2025-11-10 09:34:30,821 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f619fe41dc0>
2025-11-10 09:34:30,821 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:34:30,821 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f61a02186a0>>
2025-11-10 09:34:30,822 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'EyorULmGlLG2r6Cb9DdZBxCebrudhkrcnwkiUaGD8B6QHDuLof1D', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 09:34:30 GMT', 'x-amzn-requestid': 'EyorULmGlLG2r6Cb9DdZBxCebrudhkrcnwkiUaGD8B6QHDuLof1D', 'content-type': 'text/html; charset=utf-8', 'content-length': '165', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'Deleted': [{'Key': 'date/simple/test.json'}]}
2025-11-10 09:34:30,823 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f61bd189e50>
2025-11-10 09:34:30,826 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f61bd2ad610>
2025-11-10 09:34:30,826 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f61bb9be750>
2025-11-10 09:34:30,827 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f61bd2ad310>
2025-11-10 09:34:30,833 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 09:34:30,846 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 09:34:30,847 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 09:34:30,858 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 09:34:30,860 - DEBUG - boto3.s3.transfer - _should_use_crt: Opting out of CRT Transfer Manager. Preferred client: auto, CRT available: False, Instance Optimized: False.
2025-11-10 09:34:30,869 - DEBUG - boto3.s3.transfer - create_transfer_manager: Using default client. pid: 187584, thread: 140057856185472
2025-11-10 09:34:30,872 - DEBUG - s3transfer.utils - acquire: Acquiring 0
2025-11-10 09:34:30,881 - DEBUG - s3transfer.tasks - _wait_until_all_complete: UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f619fe26c70>}) about to wait for the following futures []
2025-11-10 09:34:30,881 - DEBUG - s3transfer.tasks - _wait_until_all_complete: UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f619fe26c70>}) done waiting for dependent futures
2025-11-10 09:34:30,882 - DEBUG - s3transfer.tasks - _execute_main: Executing task UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f619fe26c70>}) with kwargs {'client': <botocore.client.S3 object at 0x7f61a0300ce0>, 'config': <boto3.s3.transfer.TransferConfig object at 0x7f61bb7740b0>, 'osutil': <s3transfer.utils.OSUtils object at 0x7f619fe1db90>, 'request_executor': <s3transfer.futures.BoundedExecutor object at 0x7f619fe25eb0>, 'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f619fe26c70>}
2025-11-10 09:34:30,882 - DEBUG - s3transfer.futures - submit: Submitting task PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'date/simple/test.parquet', 'extra_args': {}}) to executor <s3transfer.futures.BoundedExecutor object at 0x7f619fe25eb0> for transfer request: 0.
2025-11-10 09:34:30,882 - DEBUG - s3transfer.utils - acquire: Acquiring 0
2025-11-10 09:34:30,905 - DEBUG - s3transfer.tasks - _wait_until_all_complete: PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'date/simple/test.parquet', 'extra_args': {}}) about to wait for the following futures []
2025-11-10 09:34:30,906 - DEBUG - s3transfer.utils - release: Releasing acquire 0/None
2025-11-10 09:34:30,915 - DEBUG - s3transfer.tasks - _wait_until_all_complete: PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'date/simple/test.parquet', 'extra_args': {}}) done waiting for dependent futures
2025-11-10 09:34:30,940 - DEBUG - s3transfer.tasks - _execute_main: Executing task PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'date/simple/test.parquet', 'extra_args': {}}) with kwargs {'client': <botocore.client.S3 object at 0x7f61a0300ce0>, 'fileobj': <s3transfer.utils.ReadFileChunk object at 0x7f619fe273a0>, 'bucket': 'fbucket', 'key': 'date/simple/test.parquet', 'extra_args': {}}
2025-11-10 09:34:30,942 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f61bd1b4dd0>
2025-11-10 09:34:30,942 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f61bd18bdd0>
2025-11-10 09:34:30,942 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f61bd1b5a90>
2025-11-10 09:34:30,943 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f61bd18bd10>
2025-11-10 09:34:30,943 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f61bd1b65d0>
2025-11-10 09:34:30,943 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f619fa0ab80>>
2025-11-10 09:34:30,943 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f619fad1280>>
2025-11-10 09:34:30,943 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f61bd18bad0>
2025-11-10 09:34:30,944 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f61bd1b6810>
2025-11-10 09:34:30,944 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f619fa0ab80>>
2025-11-10 09:34:30,945 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:26482', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'Key': 'date/simple/test.parquet', 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 09:34:30,956 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:26482/fbucket
2025-11-10 09:34:30,957 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:34:30,957 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:34:30,958 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_checksum at 0x7f61bd3bb950>
2025-11-10 09:34:30,971 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f61bd1b41d0>
2025-11-10 09:34:30,981 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-10 09:34:30,981 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f619fe25820>>
2025-11-10 09:34:30,981 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f61bd18a090>
2025-11-10 09:34:30,981 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f61bd1b5c10>
2025-11-10 09:34:30,982 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/date/simple/test.parquet', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89', 'Content-MD5': 'otlcs1B/wAeOME1DbG/Gfg==', 'Expect': '100-continue'}, 'body': <s3transfer.utils.ReadFileChunk object at 0x7f619fe273a0>, 'auth_path': '/fbucket/date/simple/test.parquet', 'url': 'http://localhost:26482/fbucket/date/simple/test.parquet', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f61a0300dd0>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'Key': 'date/simple/test.parquet', 'Body': <s3transfer.utils.ReadFileChunk object at 0x7f619fe273a0>}}, 'input_params': {'Bucket': 'fbucket', 'Key': 'date/simple/test.parquet'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 09:34:30,983 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function signal_not_transferring at 0x7f61a02cebd0>
2025-11-10 09:34:30,983 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f61a03030d0>>
2025-11-10 09:34:30,984 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f619fad1280>>
2025-11-10 09:34:30,984 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f61bd18b950>
2025-11-10 09:34:30,989 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f61bd1b6750>
2025-11-10 09:34:30,989 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f619fe25820>>
2025-11-10 09:34:31,009 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:34:31,010 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/fbucket/date/simple/test.parquet

content-md5:otlcs1B/wAeOME1DbG/Gfg==
host:localhost:26482
x-amz-content-sha256:faa55eda0de8d6c5dbfe50f1bd4ad9d4415869389cc48416fd8b0201e9f53cd2
x-amz-date:20251110T093431Z

content-md5;host;x-amz-content-sha256;x-amz-date
faa55eda0de8d6c5dbfe50f1bd4ad9d4415869389cc48416fd8b0201e9f53cd2
2025-11-10 09:34:31,010 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093431Z
20251110/yandex/s3/aws4_request
bc540a239d30b4e44ff400525d44bd93f5b5e35493ce0e6454cd4d3b0ed92de4
2025-11-10 09:34:31,010 - DEBUG - botocore.auth - add_auth: Signature:
2077a91a893f85127412cf210cc88859c6ba8259faa980482be3b7fd20e2d080
2025-11-10 09:34:31,011 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function signal_transferring at 0x7f61a02cec90>
2025-11-10 09:34:31,011 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f61bd1b6510>
2025-11-10 09:34:31,011 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:26482/fbucket/date/simple/test.parquet, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89', 'Content-MD5': b'otlcs1B/wAeOME1DbG/Gfg==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251110T093431Z', 'X-Amz-Content-SHA256': b'faa55eda0de8d6c5dbfe50f1bd4ad9d4415869389cc48416fd8b0201e9f53cd2', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=2077a91a893f85127412cf210cc88859c6ba8259faa980482be3b7fd20e2d080', 'amz-sdk-invocation-id': b'a2999947-2d64-4aa0-a2f7-3b1009ed557f', 'amz-sdk-request': b'attempt=1', 'Content-Length': '1157'}>
2025-11-10 09:34:31,014 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-10 09:34:31,029 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-10 09:34:31,035 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:34:31 GMT', 'ETag': '"a2d95cb3507fc0078e304d436c6fc67e"', 'last-modified': 'Mon, 10 Nov 2025 09:34:31 GMT', 'x-amzn-requestid': 'mqFDS97acNb0yNV2YVImwR9CXZLpmFPLwFbu6tmSWdcNyafaDkkm', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '0', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:34:31,035 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-10 09:34:31,036 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f619fe25690>
2025-11-10 09:34:31,037 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:34:31,037 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f619fa0ab80>>
2025-11-10 09:34:31,038 - DEBUG - s3transfer.utils - release: Releasing acquire 0/None
2025-11-10 09:34:31,043 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-10 09:34:31,110 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-10 09:34:31,240 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            SELECT *\n            FROM bindings.`h5350228219092927505_test_date_simplemy_binding`\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "a9ccb552-bc97-431f-b8d7-e2ab154602a3"

2025-11-10 09:34:31,282 - DEBUG - root - create_query_impl: Result: query_id: "ptqudson1fjfu96q0vv6"

2025-11-10 09:34:31,290 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudson1fjfu96q0vv6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767271
        nanos: 247854000
      }
      modified_at {
        seconds: 1762767271
        nanos: 247854000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudson1fjfu4igeage-ptqudson1fjfu96q0vv6"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767271
      nanos: 247854000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            SELECT *\n            FROM bindings.`h5350228219092927505_test_date_simplemy_binding`\n            "
    syntax: YQL_V1
  }
}

2025-11-10 09:34:31,802 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-10 09:34:32,315 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-10 09:34:32,846 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudson1fjfu96q0vv6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767271
        nanos: 247854000
      }
      modified_at {
        seconds: 1762767271
        nanos: 247854000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767272
      nanos: 287000000
    }
    finished_at {
      seconds: 1762767272
      nanos: 728000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudson1fjfu4igeage-ptqudson1fjfu96q0vv6"
    result_expire_at {
      seconds: 1762853672
      nanos: 254791000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767271
      nanos: 247854000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            SELECT *\n            FROM bindings.`h5350228219092927505_test_date_simplemy_binding`\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.24s\",\"count\":2,\"avg\":\"0.12s\",\"max\":\"0.24s\",\"min\":\"3ms\"},\"IngressBytes\":{\"sum\":1809,\"count\":1,\"avg\":1809,\"max\":1809,\"min\":1809},\"IngressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"InputBytes\":{\"sum\":29,\"count\":1,\"avg\":29,\"max\":29,\"min\":29},\"InputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"OutputBytes\":{\"sum\":58,\"count\":2,\"avg\":29,\"max\":29,\"min\":29},\"OutputRows\":{\"sum\":4,\"count\":2,\"avg\":2,\"max\":2,\"min\":2},\"ResultBytes\":{\"sum\":29,\"count\":1,\"avg\":29,\"max\":29,\"min\":29},\"ResultRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "Fruit"
      type {
        type_id: STRING
      }
    }
    column {
      name: "Price"
      type {
        type_id: INT32
      }
    }
    column {
      name: "Time"
      type {
        type_id: DATE
      }
    }
    column {
      name: "Weight"
      type {
        type_id: INT32
      }
    }
    rows_count: 2
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h5350228219092927505_test_date_simplefruitbucket\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 \'\"Paths {\\n  Name: \\\"date\\\"\\n  Children {\\n    Name: \\\"simple\\\"\\n    Children {\\n      Name: \\\"test.parquet\\\"\\n      Size: 1157\\n      Read: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $6 (Bool \'\"true\"))\n(let $7 (DataType \'Int32))\n(let $8 (StructType \'(\'\"Fruit\" (DataType \'String)) \'(\'\"Price\" $7) \'(\'\"Time\" (DataType \'Date)) \'(\'\"Weight\" $7)))\n(let $9 (S3ParseSettings world \'(\'((String $5) $6 (AsStruct))) (SecureParam \'\"cluster:default_h5350228219092927505_test_date_simplefruitbucket\") \'\"\" \'\"date/simple/test.parquet \" \'\"parquet\" $8 (lambda \'($13) $6) \'(\'(\'\"data.date.format\" \'\"%m/%d/%Y\"))))\n(let $10 (DqStage \'((DqSource $4 $9)) (lambda \'($14) (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $14 $4 $8 \'(\'(\'format \'\"parquet\")))))) (lambda \'($15 $16 $17 $18) (AsStruct \'(\'\"Fruit\" $15) \'(\'\"Price\" $16) \'(\'\"Time\" $17) \'(\'\"Weight\" $18))))) \'(\'(\'\"_logical_id\" \'209278))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($19) $19) \'(\'(\'\"_logical_id\" \'209324))))\n(let $12 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $12 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-10 09:34:32,874 - DEBUG - root - validate_date_simple_result: columns {
  name: "Fruit"
  type {
    type_id: STRING
  }
}
columns {
  name: "Price"
  type {
    type_id: INT32
  }
}
columns {
  name: "Time"
  type {
    type_id: DATE
  }
}
columns {
  name: "Weight"
  type {
    type_id: INT32
  }
}
rows {
  items {
    bytes_value: "Banana"
  }
  items {
    int32_value: 3
  }
  items {
    uint32_value: 19284
  }
  items {
    int32_value: 100
  }
}
rows {
  items {
    bytes_value: "Apple"
  }
  items {
    int32_value: 2
  }
  items {
    uint32_value: 19285
  }
  items {
    int32_value: 22
  }
}

2025-11-10 09:34:32,876 - INFO - ya.test - pytest_runtest_teardown: Test teardown
2025-11-10 09:44:09,473 - DEBUG - ya.test - _verify_test: Verifying [test_format_setting.TestS3.test_date_simple[v1-date/simple/test.parquet-parquet] in ydb/tests/fq/s3] canonical results
2025-11-10 09:44:09,488 - DEBUG - ya.test - verify: Test test_format_setting.TestS3.test_date_simple[v1-date/simple/test.parquet-parquet] status: good
