2025-11-10 10:14:17,087 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 10:14:17,087 - INFO - ya.test - pytest_runtest_setup: test_format[v1-test.parquet-parquet-kikimr_settings0]
2025-11-10 10:14:17,088 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 10:14:17,088 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-10 10:14:17,192 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_formats.py::TestS3Formats, test_name: test_format[v1-test.parquet-parquet-kikimr_settings0])
2025-11-10 10:14:17,193 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f6a62d35f10>
2025-11-10 10:14:17,205 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f6a62e556d0>
2025-11-10 10:14:17,206 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f6a629e0f50>
2025-11-10 10:14:17,206 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f6a62e553d0>
2025-11-10 10:14:17,211 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 10:14:17,218 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 10:14:17,220 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 10:14:17,221 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 10:14:17,222 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-10 10:14:17,224 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-10 10:14:17,225 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-10 10:14:17,227 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f6a629e19d0>
2025-11-10 10:14:17,227 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'fbucket', 'ACL': 'public-read'}
2025-11-10 10:14:17,229 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f6a62d37dd0>
2025-11-10 10:14:17,229 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f6a62d62690>
2025-11-10 10:14:17,229 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,229 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f6a45a229f0>>
2025-11-10 10:14:17,229 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f6a62d37b90>
2025-11-10 10:14:17,230 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f6a62d628d0>
2025-11-10 10:14:17,230 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,231 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:27589', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True}
2025-11-10 10:14:17,233 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:27589/fbucket
2025-11-10 10:14:17,233 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:14:17,233 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:14:17,234 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f6a62d60290>
2025-11-10 10:14:17,234 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f6a45a46c70>>
2025-11-10 10:14:17,234 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f6a62d36150>
2025-11-10 10:14:17,235 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f6a62d61cd0>
2025-11-10 10:14:17,235 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read', 'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/fbucket/', 'url': 'http://localhost:27589/fbucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f6a4548cd30>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'ACL': 'public-read'}}, 'input_params': {'Bucket': 'fbucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 10:14:17,236 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f6a4548da00>>
2025-11-10 10:14:17,236 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f6a45a229f0>>
2025-11-10 10:14:17,237 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f6a62d37a10>
2025-11-10 10:14:17,237 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f6a62d62810>
2025-11-10 10:14:17,237 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f6a45a46c70>>
2025-11-10 10:14:17,238 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:14:17,238 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/fbucket

host:localhost:27589
x-amz-acl:public-read
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T101417Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 10:14:17,238 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101417Z
20251110/yandex/s3/aws4_request
5d01f7272430e6d5ad42e408545725789a82604336147b306ef9264510499f52
2025-11-10 10:14:17,239 - DEBUG - botocore.auth - add_auth: Signature:
81fa394580dcf51f4a60027e288bbed591f4841f47f9bb11ecd524e8e10df56d
2025-11-10 10:14:17,239 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f6a62d625d0>
2025-11-10 10:14:17,239 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:27589/fbucket, headers={'x-amz-acl': b'public-read', 'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T101417Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=81fa394580dcf51f4a60027e288bbed591f4841f47f9bb11ecd524e8e10df56d', 'amz-sdk-invocation-id': b'bf699141-e2cb-4945-b366-e5afe8d0b84b', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-10 10:14:17,269 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:14:17 GMT', 'x-amzn-requestid': '0JQSTZSDUH7BkvBoZDWsjCTBT6eK2VHbellgZ1Xerj3rucED8bFU', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '161', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:14:17,270 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>fbucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-10 10:14:17,271 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f6a45a46db0>
2025-11-10 10:14:17,271 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:14:17,271 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,272 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': '0JQSTZSDUH7BkvBoZDWsjCTBT6eK2VHbellgZ1Xerj3rucED8bFU', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 10:14:17 GMT', 'x-amzn-requestid': '0JQSTZSDUH7BkvBoZDWsjCTBT6eK2VHbellgZ1Xerj3rucED8bFU', 'content-type': 'text/html; charset=utf-8', 'content-length': '161', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-10 10:14:17,277 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'fbucket'}
2025-11-10 10:14:17,278 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7f6a62d616d0>
2025-11-10 10:14:17,279 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7f6a62d37dd0>
2025-11-10 10:14:17,279 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f6a62d62690>
2025-11-10 10:14:17,279 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,279 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f6a45a229f0>>
2025-11-10 10:14:17,279 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7f6a62d37b90>
2025-11-10 10:14:17,280 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f6a62d628d0>
2025-11-10 10:14:17,280 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,281 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:27589', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 10:14:17,282 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:27589/fbucket
2025-11-10 10:14:17,283 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:14:17,283 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:14:17,284 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7f6a62d60290>
2025-11-10 10:14:17,284 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f6a45a46c70>>
2025-11-10 10:14:17,285 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7f6a62d36150>
2025-11-10 10:14:17,285 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7f6a62d61cd0>
2025-11-10 10:14:17,285 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/fbucket/', 'url': 'http://localhost:27589/fbucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f6a4548cd30>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'EncodingType': 'url'}}, 'input_params': {'Bucket': 'fbucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 10:14:17,286 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f6a4548da00>>
2025-11-10 10:14:17,287 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f6a45a229f0>>
2025-11-10 10:14:17,287 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7f6a62d37a10>
2025-11-10 10:14:17,288 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7f6a62d62810>
2025-11-10 10:14:17,288 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f6a45a46c70>>
2025-11-10 10:14:17,288 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:14:17,289 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/fbucket
encoding-type=url
host:localhost:27589
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T101417Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 10:14:17,289 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101417Z
20251110/yandex/s3/aws4_request
280dfd9a9bbc60903f6c25bfbff239f224c58fa4a274bbcaa284c8fd9d0aefcc
2025-11-10 10:14:17,289 - DEBUG - botocore.auth - add_auth: Signature:
2f04767425301d85d601853636f3054e1ed932fd22e13b18d93d4870603afcac
2025-11-10 10:14:17,290 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7f6a62d625d0>
2025-11-10 10:14:17,290 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:27589/fbucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T101417Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=2f04767425301d85d601853636f3054e1ed932fd22e13b18d93d4870603afcac', 'amz-sdk-invocation-id': b'a2424728-bcf5-483f-9750-38ac7622c9e8', 'amz-sdk-request': b'attempt=1'}>
2025-11-10 10:14:17,302 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:14:17 GMT', 'x-amzn-requestid': 'OMCbSUlaolvs3Bwk7jfhVXrpF7NvRH6DyqGv0ftVg9Xdthm0ZlDN', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '559', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:14:17,303 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>fbucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>test_list.json</Key><LastModified>2025-11-10T10:14:15.000Z</LastModified><ETag>&#34;c56077d348a21a03b297129c62510007&#34;</ETag><Size>160</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-10 10:14:17,306 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f6a45a46db0>
2025-11-10 10:14:17,307 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:14:17,307 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,307 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7f6a62d61790>
2025-11-10 10:14:17,313 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-10 10:14:17,314 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-10 10:14:17,315 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7f6a629e1b50>
2025-11-10 10:14:17,316 - DEBUG - boto3.resources.action - __call__: Calling s3:delete_objects with {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'test_list.json'}]}}
2025-11-10 10:14:17,321 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function validate_bucket_name at 0x7f6a62d37dd0>
2025-11-10 10:14:17,322 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f6a62d62690>
2025-11-10 10:14:17,322 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,322 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f6a45a229f0>>
2025-11-10 10:14:17,323 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function generate_idempotent_uuid at 0x7f6a62d37b90>
2025-11-10 10:14:17,323 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f6a62d628d0>
2025-11-10 10:14:17,323 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,324 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:27589', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 10:14:17,324 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:27589/fbucket
2025-11-10 10:14:17,331 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:14:17,331 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:14:17,333 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function escape_xml_payload at 0x7f6a62d377d0>
2025-11-10 10:14:17,334 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function conditionally_calculate_checksum at 0x7f6a62f5fa10>
2025-11-10 10:14:17,334 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_expect_header at 0x7f6a62d60290>
2025-11-10 10:14:17,334 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f6a45a46c70>>
2025-11-10 10:14:17,334 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_recursion_detection_header at 0x7f6a62d36150>
2025-11-10 10:14:17,334 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function inject_api_version_header_if_needed at 0x7f6a62d61cd0>
2025-11-10 10:14:17,335 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=DeleteObjects) with params: {'url_path': '?delete', 'query_string': {}, 'method': 'POST', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': 'G9qWHZAq11jUG7Y54z1MbA=='}, 'body': b'<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Object><Key>test_list.json</Key></Object></Delete>', 'auth_path': '/fbucket/', 'url': 'http://localhost:27589/fbucket?delete', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f6a4548cd30>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'test_list.json'}]}}}, 'input_params': {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'test_list.json'}]}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}, 'checksum': {'request_algorithm': 'conditional-md5'}}}
2025-11-10 10:14:17,336 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f6a4548da00>>
2025-11-10 10:14:17,336 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f6a45a229f0>>
2025-11-10 10:14:17,345 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <function set_operation_specific_signer at 0x7f6a62d37a10>
2025-11-10 10:14:17,346 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <function remove_arn_from_signing_path at 0x7f6a62d62810>
2025-11-10 10:14:17,346 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f6a45a46c70>>
2025-11-10 10:14:17,347 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:14:17,347 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
POST
/fbucket
delete=
content-md5:G9qWHZAq11jUG7Y54z1MbA==
host:localhost:27589
x-amz-content-sha256:f7951cd99af31da4487d7d0c69c519a0bd24400076ca34f3d43e135c364b5d53
x-amz-date:20251110T101417Z

content-md5;host;x-amz-content-sha256;x-amz-date
f7951cd99af31da4487d7d0c69c519a0bd24400076ca34f3d43e135c364b5d53
2025-11-10 10:14:17,348 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101417Z
20251110/yandex/s3/aws4_request
86b203121d7412a925d4e9f60181fca40def7519a3d7b6c717b8f9919a5bc981
2025-11-10 10:14:17,348 - DEBUG - botocore.auth - add_auth: Signature:
a658c92babcd13403e3bcf0f2664dc8cbc9ef21ac72d2840bf7a5dd0f55e657c
2025-11-10 10:14:17,349 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <function add_retry_headers at 0x7f6a62d625d0>
2025-11-10 10:14:17,350 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=http://localhost:27589/fbucket?delete, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': b'G9qWHZAq11jUG7Y54z1MbA==', 'X-Amz-Date': b'20251110T101417Z', 'X-Amz-Content-SHA256': b'f7951cd99af31da4487d7d0c69c519a0bd24400076ca34f3d43e135c364b5d53', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=a658c92babcd13403e3bcf0f2664dc8cbc9ef21ac72d2840bf7a5dd0f55e657c', 'amz-sdk-invocation-id': b'1620b922-9dea-4c6c-8871-4634d131a292', 'amz-sdk-request': b'attempt=1', 'Content-Length': '107'}>
2025-11-10 10:14:17,373 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:14:17 GMT', 'x-amzn-requestid': 'mQ2XVobLM21NShaEdHmrz4g6OokNkywVGWILDOGwb2kv6EtpfMXJ', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '158', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:14:17,374 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><DeleteResult xmlns="http://s3.amazonaws.com/doc/2006-03-01"><Deleted><Key>test_list.json</Key></Deleted></DeleteResult>'
2025-11-10 10:14:17,375 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f6a45a46db0>
2025-11-10 10:14:17,376 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:14:17,376 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a445b0>>
2025-11-10 10:14:17,378 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'mQ2XVobLM21NShaEdHmrz4g6OokNkywVGWILDOGwb2kv6EtpfMXJ', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 10:14:17 GMT', 'x-amzn-requestid': 'mQ2XVobLM21NShaEdHmrz4g6OokNkywVGWILDOGwb2kv6EtpfMXJ', 'content-type': 'text/html; charset=utf-8', 'content-length': '158', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'Deleted': [{'Key': 'test_list.json'}]}
2025-11-10 10:14:17,379 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f6a62d35f10>
2025-11-10 10:14:17,387 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f6a62e556d0>
2025-11-10 10:14:17,388 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f6a629e0f50>
2025-11-10 10:14:17,388 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f6a62e553d0>
2025-11-10 10:14:17,401 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 10:14:17,418 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 10:14:17,419 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 10:14:17,429 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 10:14:17,431 - DEBUG - boto3.s3.transfer - _should_use_crt: Opting out of CRT Transfer Manager. Preferred client: auto, CRT available: False, Instance Optimized: False.
2025-11-10 10:14:17,431 - DEBUG - boto3.s3.transfer - create_transfer_manager: Using default client. pid: 2567718, thread: 140094991086720
2025-11-10 10:14:17,432 - DEBUG - s3transfer.utils - acquire: Acquiring 0
2025-11-10 10:14:17,434 - DEBUG - s3transfer.tasks - _wait_until_all_complete: UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f6a62842a40>}) about to wait for the following futures []
2025-11-10 10:14:17,436 - DEBUG - s3transfer.tasks - _wait_until_all_complete: UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f6a62842a40>}) done waiting for dependent futures
2025-11-10 10:14:17,438 - DEBUG - s3transfer.tasks - _execute_main: Executing task UploadSubmissionTask(transfer_id=0, {'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f6a62842a40>}) with kwargs {'client': <botocore.client.S3 object at 0x7f6a627133f0>, 'config': <boto3.s3.transfer.TransferConfig object at 0x7f6a4e358880>, 'osutil': <s3transfer.utils.OSUtils object at 0x7f6a45a9e090>, 'request_executor': <s3transfer.futures.BoundedExecutor object at 0x7f6a62842db0>, 'transfer_future': <s3transfer.futures.TransferFuture object at 0x7f6a62842a40>}
2025-11-10 10:14:17,443 - DEBUG - s3transfer.futures - submit: Submitting task PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'test.parquet', 'extra_args': {}}) to executor <s3transfer.futures.BoundedExecutor object at 0x7f6a62842db0> for transfer request: 0.
2025-11-10 10:14:17,443 - DEBUG - s3transfer.utils - acquire: Acquiring 0
2025-11-10 10:14:17,444 - DEBUG - s3transfer.tasks - _wait_until_all_complete: PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'test.parquet', 'extra_args': {}}) about to wait for the following futures []
2025-11-10 10:14:17,445 - DEBUG - s3transfer.tasks - _wait_until_all_complete: PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'test.parquet', 'extra_args': {}}) done waiting for dependent futures
2025-11-10 10:14:17,445 - DEBUG - s3transfer.tasks - _execute_main: Executing task PutObjectTask(transfer_id=0, {'bucket': 'fbucket', 'key': 'test.parquet', 'extra_args': {}}) with kwargs {'client': <botocore.client.S3 object at 0x7f6a627133f0>, 'fileobj': <s3transfer.utils.ReadFileChunk object at 0x7f6a45a73760>, 'bucket': 'fbucket', 'key': 'test.parquet', 'extra_args': {}}
2025-11-10 10:14:17,447 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f6a62d60e90>
2025-11-10 10:14:17,447 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f6a62d37e90>
2025-11-10 10:14:17,447 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f6a62d61b50>
2025-11-10 10:14:17,448 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f6a62d37dd0>
2025-11-10 10:14:17,448 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f6a62d62690>
2025-11-10 10:14:17,451 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a9fc60>>
2025-11-10 10:14:17,451 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f6a453f3da0>>
2025-11-10 10:14:17,452 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f6a62d37b90>
2025-11-10 10:14:17,452 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f6a62d628d0>
2025-11-10 10:14:17,453 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a9fc60>>
2025-11-10 10:14:17,453 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:27589', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'Key': 'test.parquet', 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 10:14:17,456 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:27589/fbucket
2025-11-10 10:14:17,456 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:14:17,457 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:14:17,458 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_checksum at 0x7f6a62f5fa10>
2025-11-10 10:14:17,459 - DEBUG - s3transfer.utils - release: Releasing acquire 0/None
2025-11-10 10:14:17,460 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f6a62d60290>
2025-11-10 10:14:17,460 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-10 10:14:17,460 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f6a45a9c9c0>>
2025-11-10 10:14:17,460 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f6a62d36150>
2025-11-10 10:14:17,461 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f6a62d61cd0>
2025-11-10 10:14:17,461 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/test.parquet', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89', 'Content-MD5': 'Mht7bNbfLfkZrPyBCwtTYg==', 'Expect': '100-continue'}, 'body': <s3transfer.utils.ReadFileChunk object at 0x7f6a45a73760>, 'auth_path': '/fbucket/test.parquet', 'url': 'http://localhost:27589/fbucket/test.parquet', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f6a454946a0>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'Key': 'test.parquet', 'Body': <s3transfer.utils.ReadFileChunk object at 0x7f6a45a73760>}}, 'input_params': {'Bucket': 'fbucket', 'Key': 'test.parquet'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 10:14:17,462 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function signal_not_transferring at 0x7f6a4591d790>
2025-11-10 10:14:17,471 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f6a45495410>>
2025-11-10 10:14:17,472 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f6a453f3da0>>
2025-11-10 10:14:17,472 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f6a62d37a10>
2025-11-10 10:14:17,473 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f6a62d62810>
2025-11-10 10:14:17,473 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f6a45a9c9c0>>
2025-11-10 10:14:17,474 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:14:17,475 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/fbucket/test.parquet

content-md5:Mht7bNbfLfkZrPyBCwtTYg==
host:localhost:27589
x-amz-content-sha256:be77cb020707f244eb471dbc8767d1316cc900892e7a00297bef2d4ae43aaa97
x-amz-date:20251110T101417Z

content-md5;host;x-amz-content-sha256;x-amz-date
be77cb020707f244eb471dbc8767d1316cc900892e7a00297bef2d4ae43aaa97
2025-11-10 10:14:17,475 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101417Z
20251110/yandex/s3/aws4_request
6966f4b83bbf2f719c603d634853cba7d49251cc88e96d134b6bd56ff413f5b7
2025-11-10 10:14:17,476 - DEBUG - botocore.auth - add_auth: Signature:
ba0aa09a2e7168e0277870161b82c828729452d4e2c16bf761dea2248bd4a947
2025-11-10 10:14:17,477 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function signal_transferring at 0x7f6a4591d850>
2025-11-10 10:14:17,477 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f6a62d625d0>
2025-11-10 10:14:17,478 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:27589/fbucket/test.parquet, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89', 'Content-MD5': b'Mht7bNbfLfkZrPyBCwtTYg==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251110T101417Z', 'X-Amz-Content-SHA256': b'be77cb020707f244eb471dbc8767d1316cc900892e7a00297bef2d4ae43aaa97', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=ba0aa09a2e7168e0277870161b82c828729452d4e2c16bf761dea2248bd4a947', 'amz-sdk-invocation-id': b'02b1494d-0de8-4e9f-a1d7-8a946c6bfa02', 'amz-sdk-request': b'attempt=1', 'Content-Length': '2899'}>
2025-11-10 10:14:17,485 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-10 10:14:17,490 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-10 10:14:17,498 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:14:17 GMT', 'ETag': '"321b7b6cd6df2df919acfc810b0b5362"', 'last-modified': 'Mon, 10 Nov 2025 10:14:17 GMT', 'x-amzn-requestid': 'jliadcIqoXD0OTDZfKe5HCATeceSifxk290GwqgxqD0qieMKxYfN', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '0', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:14:17,499 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-10 10:14:17,500 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f6a45a9dc30>
2025-11-10 10:14:17,501 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:14:17,501 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f6a45a9fc60>>
2025-11-10 10:14:17,502 - DEBUG - s3transfer.utils - release: Releasing acquire 0/None
2025-11-10 10:14:17,504 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-10 10:14:17,553 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-10 10:14:17,597 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA s3.UseBlocksSource=\"true\";\n            SELECT *\n            FROM `h1716997286969189503_test_formatfruitbucket`.`test.parquet`\n            WITH (format=`parquet`, SCHEMA (\n                Fruit String NOT NULL,\n                Price Int NOT NULL,\n                Weight Int NOT NULL\n            ));\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "c14f859d-cc2d-4901-bdfc-ebf89b7923e9"

2025-11-10 10:14:17,623 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsokqbpo368jfte7"

2025-11-10 10:14:17,630 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokqbpo368jfte7"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769657
        nanos: 601830000
      }
      modified_at {
        seconds: 1762769657
        nanos: 601830000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsokqbpo30ocvnib-ptqudsokqbpo368jfte7"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769657
      nanos: 601830000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA s3.UseBlocksSource=\"true\";\n            SELECT *\n            FROM `h1716997286969189503_test_formatfruitbucket`.`test.parquet`\n            WITH (format=`parquet`, SCHEMA (\n                Fruit String NOT NULL,\n                Price Int NOT NULL,\n                Weight Int NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
}

2025-11-10 10:14:18,143 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-10 10:14:18,651 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokqbpo368jfte7"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769657
        nanos: 601830000
      }
      modified_at {
        seconds: 1762769657
        nanos: 601830000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769658
      nanos: 334000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsokqbpo30ocvnib-ptqudsokqbpo368jfte7"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769657
      nanos: 601830000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA s3.UseBlocksSource=\"true\";\n            SELECT *\n            FROM `h1716997286969189503_test_formatfruitbucket`.`test.parquet`\n            WITH (format=`parquet`, SCHEMA (\n                Fruit String NOT NULL,\n                Price Int NOT NULL,\n                Weight Int NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":10,\"level\":1,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":2,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  result_set_meta {
    column {
      name: "Fruit"
      type {
        type_id: STRING
      }
    }
    column {
      name: "Price"
      type {
        type_id: INT32
      }
    }
    column {
      name: "Weight"
      type {
        type_id: INT32
      }
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useblockssource\" \'\"true\"))\n(let $3 (DataSink \'result))\n(let $4 \'\"h1716997286969189503_test_formatfruitbucket\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 (Bool \'\"true\"))\n(let $7 (DataType \'Int32))\n(let $8 (StructType \'(\'\"Fruit\" (DataType \'String)) \'(\'\"Price\" $7) \'(\'\"Weight\" $7)))\n(let $9 (S3ParseSettings world \'(\'((String \'\"Paths {\\n  Name: \\\"test.parquet\\\"\\n  Size: 2899\\n  Read: true\\n}\\n\") $6 (AsStruct))) (SecureParam \'\"cluster:default_h1716997286969189503_test_formatfruitbucket\") \'\"\" \'\"test.parquet \" \'\"parquet\" $8 (lambda \'($13) $6) \'()))\n(let $10 (DqStage \'((DqSource $5 $9)) (lambda \'($14) (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $14 $5 $8 \'(\'(\'format \'\"parquet\")))))) (lambda \'($15 $16 $17) (AsStruct \'(\'\"Fruit\" $15) \'(\'\"Price\" $16) \'(\'\"Weight\" $17))))) \'(\'(\'\"_logical_id\" \'209292))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($18) $18) \'(\'(\'\"_logical_id\" \'209336))))\n(let $12 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $12 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-10 10:14:19,160 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokqbpo368jfte7"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769657
        nanos: 601830000
      }
      modified_at {
        seconds: 1762769657
        nanos: 601830000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769658
      nanos: 334000000
    }
    finished_at {
      seconds: 1762769658
      nanos: 644000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsokqbpo30ocvnib-ptqudsokqbpo368jfte7"
    result_expire_at {
      seconds: 1762856058
      nanos: 321721000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769657
      nanos: 601830000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA s3.UseBlocksSource=\"true\";\n            SELECT *\n            FROM `h1716997286969189503_test_formatfruitbucket`.`test.parquet`\n            WITH (format=`parquet`, SCHEMA (\n                Fruit String NOT NULL,\n                Price Int NOT NULL,\n                Weight Int NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":10,\"level\":1,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":2,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Actor\":{\"ActorCreateTimeUs\":{\"sum\":\"3ms\",\"count\":2,\"avg\":\"1ms\",\"max\":\"3ms\",\"min\":\"311us\"}},\"AllocateWorkersUs\":{\"sum\":\"3ms\",\"count\":1,\"avg\":\"3ms\",\"max\":\"3ms\",\"min\":\"3ms\"},\"ExecutionTimeUs\":{\"sum\":\"0.17s\",\"count\":1,\"avg\":\"0.17s\",\"max\":\"0.17s\",\"min\":\"0.17s\"},\"IngressBytes\":{\"sum\":3373,\"count\":1,\"avg\":3373,\"max\":3373,\"min\":3373},\"TaskRunner\":{\"Input=209440\":{\"Stage=209457\":{\"PopBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PushChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"0.15s\",\"count\":1,\"avg\":\"0.15s\",\"max\":\"0.15s\",\"min\":\"0.15s\"}}},\"Input=Total\":{\"Stage=209457\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PushChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"0.15s\",\"count\":1,\"avg\":\"0.15s\",\"max\":\"0.15s\",\"min\":\"0.15s\"}},\"Stage=Total\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PushChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"0.15s\",\"count\":1,\"avg\":\"0.15s\",\"max\":\"0.15s\",\"min\":\"0.15s\"}}},\"Output=0\":{\"Stage=209457\":{\"PopBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushChunks\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"27ms\",\"count\":1,\"avg\":\"27ms\",\"max\":\"27ms\",\"min\":\"27ms\"}}},\"Output=209457\":{\"Stage=209440\":{\"PopBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushChunks\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"27ms\",\"count\":1,\"avg\":\"27ms\",\"max\":\"27ms\",\"min\":\"27ms\"}}},\"Output=Total\":{\"Stage=209440\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushChunks\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"27ms\",\"count\":1,\"avg\":\"27ms\",\"max\":\"27ms\",\"min\":\"27ms\"}},\"Stage=209457\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushChunks\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"27ms\",\"count\":1,\"avg\":\"27ms\",\"max\":\"27ms\",\"min\":\"27ms\"}},\"Stage=Total\":{\"ChannelCount\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"PopBytes\":{\"sum\":60,\"count\":2,\"avg\":30,\"max\":30,\"min\":30},\"PopChunks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":2,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":2,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":6,\"count\":2,\"avg\":3,\"max\":3,\"min\":3},\"PushChunks\":{\"sum\":6,\"count\":2,\"avg\":3,\"max\":3,\"min\":3},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":2,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":2,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":2,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":2,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":6,\"count\":2,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"55ms\",\"count\":2,\"avg\":\"27ms\",\"max\":\"27ms\",\"min\":\"27ms\"}}},\"Source=S3Source\":{\"Stage=209440\":{\"IngressBytes\":{\"sum\":3373,\"count\":1,\"avg\":3373,\"max\":3373,\"min\":3373},\"IngressChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"IngressLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"IngressPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"IngressRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"IngressSplits\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressWaitTimeUs\":{\"sum\":\"24ms\",\"count\":1,\"avg\":\"24ms\",\"max\":\"24ms\",\"min\":\"24ms\"},\"PopBytes\":{\"sum\":481,\"count\":1,\"avg\":481,\"max\":481,\"min\":481},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushBytes\":{\"sum\":481,\"count\":1,\"avg\":481,\"max\":481,\"min\":481},\"PushChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"24ms\",\"count\":1,\"avg\":\"24ms\",\"max\":\"24ms\",\"min\":\"24ms\"}},\"Stage=Total\":{\"IngressBytes\":{\"sum\":3373,\"count\":1,\"avg\":3373,\"max\":3373,\"min\":3373},\"IngressChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"IngressLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"IngressPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"IngressRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"IngressSplits\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressWaitTimeUs\":{\"sum\":\"24ms\",\"count\":1,\"avg\":\"24ms\",\"max\":\"24ms\",\"min\":\"24ms\"},\"PopBytes\":{\"sum\":481,\"count\":1,\"avg\":481,\"max\":481,\"min\":481},\"PopChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushBytes\":{\"sum\":481,\"count\":1,\"avg\":481,\"max\":481,\"min\":481},\"PushChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.59s\",\"max\":\"10:14:18.59s\",\"min\":\"10:14:18.59s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"PushRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"PushWaitPeriods\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PushWaitTimeUs\":{\"sum\":\"24ms\",\"count\":1,\"avg\":\"24ms\",\"max\":\"24ms\",\"min\":\"24ms\"}}},\"Stage=209440\":{\"BuildCpuTimeUs\":{\"sum\":\"0.13s\",\"count\":1,\"avg\":\"0.13s\",\"max\":\"0.13s\",\"min\":\"0.13s\"},\"ComputeCpuTimeUs\":{\"sum\":\"168us\",\"count\":1,\"avg\":\"168us\",\"max\":\"168us\",\"min\":\"168us\"},\"CpuTimeUs\":{\"sum\":\"0.14s\",\"count\":1,\"avg\":\"0.14s\",\"max\":\"0.14s\",\"min\":\"0.14s\"},\"DurationUs\":{\"sum\":\"3ms\",\"count\":1,\"avg\":\"3ms\",\"max\":\"3ms\",\"min\":\"3ms\"},\"FinishTimeMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"IngressBytes\":{\"sum\":3373,\"count\":1,\"avg\":3373,\"max\":3373,\"min\":3373},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"MkqlMaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"OutputBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"OutputRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"SourceCpuTimeUs\":{\"sum\":\"6ms\",\"count\":1,\"avg\":\"6ms\",\"max\":\"6ms\",\"min\":\"6ms\"},\"StartTimeMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=209457\":{\"BuildCpuTimeUs\":{\"sum\":\"2ms\",\"count\":1,\"avg\":\"2ms\",\"max\":\"2ms\",\"min\":\"2ms\"},\"ComputeCpuTimeUs\":{\"sum\":\"77us\",\"count\":1,\"avg\":\"77us\",\"max\":\"77us\",\"min\":\"77us\"},\"CpuTimeUs\":{\"sum\":\"2ms\",\"count\":1,\"avg\":\"2ms\",\"max\":\"2ms\",\"min\":\"2ms\"},\"DurationUs\":{\"sum\":\"14ms\",\"count\":1,\"avg\":\"14ms\",\"max\":\"14ms\",\"min\":\"14ms\"},\"FinishTimeMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.63s\",\"max\":\"10:14:18.63s\",\"min\":\"10:14:18.63s\"},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"InputBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"InputRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"MkqlMaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"OutputBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"OutputRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"ResultBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"ResultRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"StartTimeMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=Total\":{\"BuildCpuTimeUs\":{\"sum\":\"0.13s\",\"count\":2,\"avg\":\"67ms\",\"max\":\"0.13s\",\"min\":\"2ms\"},\"ComputeCpuTimeUs\":{\"sum\":\"245us\",\"count\":2,\"avg\":\"122us\",\"max\":\"168us\",\"min\":\"77us\"},\"CpuTimeUs\":{\"sum\":\"0.14s\",\"count\":2,\"avg\":\"72ms\",\"max\":\"0.14s\",\"min\":\"2ms\"},\"DurationUs\":{\"sum\":\"17ms\",\"count\":2,\"avg\":\"8ms\",\"max\":\"14ms\",\"min\":\"3ms\"},\"FinishTimeMs\":{\"sum\":\"N/A\",\"count\":2,\"avg\":\"10:14:18.63s\",\"max\":\"10:14:18.63s\",\"min\":\"10:14:18.62s\"},\"IngressBytes\":{\"sum\":3373,\"count\":1,\"avg\":3373,\"max\":3373,\"min\":3373},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"InputBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"InputRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"MkqlMaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"OutputBytes\":{\"sum\":60,\"count\":2,\"avg\":30,\"max\":30,\"min\":30},\"OutputRows\":{\"sum\":6,\"count\":2,\"avg\":3,\"max\":3,\"min\":3},\"ResultBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"ResultRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"SourceCpuTimeUs\":{\"sum\":\"6ms\",\"count\":1,\"avg\":\"6ms\",\"max\":\"6ms\",\"min\":\"6ms\"},\"StartTimeMs\":{\"sum\":\"N/A\",\"count\":2,\"avg\":\"10:14:18.62s\",\"max\":\"10:14:18.62s\",\"min\":\"10:14:18.62s\"},\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1}}},\"UniqueWorkers\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}}}"
  }
  result_set_meta {
    column {
      name: "Fruit"
      type {
        type_id: STRING
      }
    }
    column {
      name: "Price"
      type {
        type_id: INT32
      }
    }
    column {
      name: "Weight"
      type {
        type_id: INT32
      }
    }
    rows_count: 3
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useblockssource\" \'\"true\"))\n(let $3 (DataSink \'result))\n(let $4 \'\"h1716997286969189503_test_formatfruitbucket\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 (Bool \'\"true\"))\n(let $7 (DataType \'Int32))\n(let $8 (StructType \'(\'\"Fruit\" (DataType \'String)) \'(\'\"Price\" $7) \'(\'\"Weight\" $7)))\n(let $9 (S3ParseSettings world \'(\'((String \'\"Paths {\\n  Name: \\\"test.parquet\\\"\\n  Size: 2899\\n  Read: true\\n}\\n\") $6 (AsStruct))) (SecureParam \'\"cluster:default_h1716997286969189503_test_formatfruitbucket\") \'\"\" \'\"test.parquet \" \'\"parquet\" $8 (lambda \'($13) $6) \'()))\n(let $10 (DqStage \'((DqSource $5 $9)) (lambda \'($14) (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $14 $5 $8 \'(\'(\'format \'\"parquet\")))))) (lambda \'($15 $16 $17) (AsStruct \'(\'\"Fruit\" $15) \'(\'\"Price\" $16) \'(\'\"Weight\" $17))))) \'(\'(\'\"_logical_id\" \'209292))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($18) $18) \'(\'(\'\"_logical_id\" \'209336))))\n(let $12 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $12 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-10 10:14:19,184 - DEBUG - root - validate_result: columns {
  name: "Fruit"
  type {
    type_id: STRING
  }
}
columns {
  name: "Price"
  type {
    type_id: INT32
  }
}
columns {
  name: "Weight"
  type {
    type_id: INT32
  }
}
rows {
  items {
    bytes_value: "Banana"
  }
  items {
    int32_value: 3
  }
  items {
    int32_value: 100
  }
}
rows {
  items {
    bytes_value: "Apple"
  }
  items {
    int32_value: 2
  }
  items {
    int32_value: 22
  }
}
rows {
  items {
    bytes_value: "Pear"
  }
  items {
    int32_value: 15
  }
  items {
    int32_value: 33
  }
}

2025-11-10 10:14:19,202 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-10 10:14:19,225 - INFO - ya.test - pytest_runtest_teardown: Test teardown
