2025-11-10 10:17:26,545 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 10:17:26,545 - INFO - ya.test - pytest_runtest_setup: test_parquet[v1-false-client0]
2025-11-10 10:17:26,546 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 10:17:26,546 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-10 10:17:26,614 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_explicit_partitioning_1.py::TestS3, test_name: test_parquet[v1-false-client0])
2025-11-10 10:17:26,615 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7ffaa4d35850>
2025-11-10 10:17:26,618 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7ffaa4e69010>
2025-11-10 10:17:26,618 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7ffaa4ab0890>
2025-11-10 10:17:26,618 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7ffaa4e68d10>
2025-11-10 10:17:26,623 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 10:17:26,628 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 10:17:26,629 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 10:17:26,630 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 10:17:26,632 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-10 10:17:26,633 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-10 10:17:26,634 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-10 10:17:26,636 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7ffaa4ab13d0>
2025-11-10 10:17:26,636 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'parquets', 'ACL': 'public-read-write'}
2025-11-10 10:17:26,637 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7ffaa4d37710>
2025-11-10 10:17:26,638 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ffaa4d61fd0>
2025-11-10 10:17:26,638 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ffa86efdbe0>>
2025-11-10 10:17:26,638 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7ffa87585870>>
2025-11-10 10:17:26,638 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7ffaa4d374d0>
2025-11-10 10:17:26,638 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ffaa4d62210>
2025-11-10 10:17:26,639 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ffa86efdbe0>>
2025-11-10 10:17:26,639 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'parquets', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:11934', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True}
2025-11-10 10:17:26,641 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:11934/parquets
2025-11-10 10:17:26,641 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:17:26,641 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:17:26,642 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7ffaa4d37b90>
2025-11-10 10:17:26,642 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7ffa87ac4600>>
2025-11-10 10:17:26,643 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7ffaa4d35a90>
2025-11-10 10:17:26,643 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7ffaa4d61610>
2025-11-10 10:17:26,643 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read-write', 'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/parquets/', 'url': 'http://localhost:11934/parquets', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ffa87637d50>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'parquets', 'params': {'Bucket': 'parquets', 'ACL': 'public-read-write'}}, 'input_params': {'Bucket': 'parquets'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 10:17:26,644 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ffa87635eb0>>
2025-11-10 10:17:26,645 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ffa87585870>>
2025-11-10 10:17:26,645 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7ffaa4d37350>
2025-11-10 10:17:26,645 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7ffaa4d62150>
2025-11-10 10:17:26,645 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7ffa87ac4600>>
2025-11-10 10:17:26,646 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:17:26,646 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/parquets

host:localhost:11934
x-amz-acl:public-read-write
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T101726Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 10:17:26,647 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101726Z
20251110/yandex/s3/aws4_request
1f88fc4624b7e43ab7b3c7b09fd166ae962b81940f8261808d0e1e05d3827824
2025-11-10 10:17:26,647 - DEBUG - botocore.auth - add_auth: Signature:
fc229e30f45c772cc81e1c6e9fcb0c9ce02bea75e4ade5a0bff42b42426eb173
2025-11-10 10:17:26,647 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7ffaa4d61f10>
2025-11-10 10:17:26,648 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:11934/parquets, headers={'x-amz-acl': b'public-read-write', 'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T101726Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=fc229e30f45c772cc81e1c6e9fcb0c9ce02bea75e4ade5a0bff42b42426eb173', 'amz-sdk-invocation-id': b'1f92b2eb-7763-426b-a111-95d88697e421', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-10 10:17:26,663 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:17:26 GMT', 'x-amzn-requestid': 'uzOyjlc1N0CQHixvEcqDSzCGITagJEjCGvEg2MIWHxh6aBOeKCvT', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '162', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:17:26,663 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>parquets</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-10 10:17:26,665 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7ffa87ac7d00>
2025-11-10 10:17:26,665 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:17:26,665 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ffa86efdbe0>>
2025-11-10 10:17:26,666 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'uzOyjlc1N0CQHixvEcqDSzCGITagJEjCGvEg2MIWHxh6aBOeKCvT', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 10:17:26 GMT', 'x-amzn-requestid': 'uzOyjlc1N0CQHixvEcqDSzCGITagJEjCGvEg2MIWHxh6aBOeKCvT', 'content-type': 'text/html; charset=utf-8', 'content-length': '162', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-10 10:17:26,667 - DEBUG - botocore.loaders - _load_resource: Loading JSON file: contrib/python/botocore/py3/botocore/data/s3/2006-03-01/paginators-1.json
2025-11-10 10:17:26,667 - DEBUG - botocore.loaders - _load_resource: Loading JSON file: contrib/python/botocore/py3/botocore/data/s3/2006-03-01/paginators-1.sdk-extras.json
2025-11-10 10:17:26,668 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'parquets'}
2025-11-10 10:17:26,670 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7ffaa4d61010>
2025-11-10 10:17:26,670 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7ffaa4d37710>
2025-11-10 10:17:26,670 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ffaa4d61fd0>
2025-11-10 10:17:26,670 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ffa86efdbe0>>
2025-11-10 10:17:26,671 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7ffa87585870>>
2025-11-10 10:17:26,671 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7ffaa4d374d0>
2025-11-10 10:17:26,671 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ffaa4d62210>
2025-11-10 10:17:26,671 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ffa86efdbe0>>
2025-11-10 10:17:26,672 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'parquets', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:11934', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 10:17:26,673 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:11934/parquets
2025-11-10 10:17:26,674 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 10:17:26,674 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 10:17:26,675 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7ffaa4d37b90>
2025-11-10 10:17:26,675 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7ffa87ac4600>>
2025-11-10 10:17:26,676 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7ffaa4d35a90>
2025-11-10 10:17:26,676 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7ffaa4d61610>
2025-11-10 10:17:26,676 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/parquets/', 'url': 'http://localhost:11934/parquets?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ffa87637d50>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'parquets', 'params': {'Bucket': 'parquets', 'EncodingType': 'url'}}, 'input_params': {'Bucket': 'parquets'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 10:17:26,677 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ffa87635eb0>>
2025-11-10 10:17:26,680 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ffa87585870>>
2025-11-10 10:17:26,681 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7ffaa4d37350>
2025-11-10 10:17:26,681 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7ffaa4d62150>
2025-11-10 10:17:26,682 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7ffa87ac4600>>
2025-11-10 10:17:26,682 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 10:17:26,683 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/parquets
encoding-type=url
host:localhost:11934
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T101726Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 10:17:26,683 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T101726Z
20251110/yandex/s3/aws4_request
ee73f69a85f0b85517cbbe2884102708f3a3f19566cea09a5b6e363e10f72800
2025-11-10 10:17:26,683 - DEBUG - botocore.auth - add_auth: Signature:
55eda83be855e24e080a961d817bd957360cf4ed3ffd4b09a1ea094e2ac122b8
2025-11-10 10:17:26,684 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7ffaa4d61f10>
2025-11-10 10:17:26,684 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:11934/parquets?encoding-type=url, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T101726Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=55eda83be855e24e080a961d817bd957360cf4ed3ffd4b09a1ea094e2ac122b8', 'amz-sdk-invocation-id': b'3a57d4f0-7210-4d14-973f-4c5b1d8577d3', 'amz-sdk-request': b'attempt=1'}>
2025-11-10 10:17:26,706 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 10:17:26 GMT', 'x-amzn-requestid': 'EehkoMIg49lBnOG0LifYBb99Xj7GHDSAaZ9jHfDMzw8rBWFnmKOT', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '231', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 10:17:26,706 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>parquets</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated></ListBucketResult>'
2025-11-10 10:17:26,707 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7ffa87ac7d00>
2025-11-10 10:17:26,708 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 10:17:26,708 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ffa86efdbe0>>
2025-11-10 10:17:26,709 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7ffaa4d610d0>
2025-11-10 10:17:26,709 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-10 10:17:26,710 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-10 10:17:26,711 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7ffaa4ab1550>
2025-11-10 10:17:26,712 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-10 10:17:26,746 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-10 10:17:26,777 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            insert into `h5217332395946712130_test_parquetpb`.`part/x=1/` with (format=\"parquet\")\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "25f39a59-33d4-48fc-b0b2-e8348db9ad6e"

2025-11-10 10:17:26,800 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsokkncelo4j4ni2"

2025-11-10 10:17:26,807 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokkncelo4j4ni2"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769846
        nanos: 781180000
      }
      modified_at {
        seconds: 1762769846
        nanos: 781180000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsokkncelke0ia3i-ptqudsokkncelo4j4ni2"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769846
      nanos: 781180000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h5217332395946712130_test_parquetpb`.`part/x=1/` with (format=\"parquet\")\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
}

2025-11-10 10:17:27,313 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokkncelo4j4ni2"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769846
        nanos: 781180000
      }
      modified_at {
        seconds: 1762769846
        nanos: 781180000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769847
      nanos: 269000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsokkncelke0ia3i-ptqudsokkncelo4j4ni2"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769846
      nanos: 781180000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h5217332395946712130_test_parquetpb`.`part/x=1/` with (format=\"parquet\")\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
}

2025-11-10 10:17:27,822 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokkncelo4j4ni2"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769846
        nanos: 781180000
      }
      modified_at {
        seconds: 1762769846
        nanos: 781180000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769847
      nanos: 269000000
    }
    finished_at {
      seconds: 1762769847
      nanos: 422000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsokkncelke0ia3i-ptqudsokkncelo4j4ni2"
    result_expire_at {
      seconds: 1762856247
      nanos: 256390000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769846
      nanos: 781180000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h5217332395946712130_test_parquetpb`.`part/x=1/` with (format=\"parquet\")\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"AsList\"},{\"Name\":\"ToFlow\"},{\"Name\":\"ExpandMap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideToBlocks\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"75ms\",\"count\":1,\"avg\":\"75ms\",\"max\":\"75ms\",\"min\":\"75ms\"},\"EgressBytes\":{\"sum\":533,\"count\":1,\"avg\":533,\"max\":533,\"min\":533},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":934208,\"count\":1,\"avg\":934208,\"max\":934208,\"min\":934208},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'\"s3\" \'\"h5217332395946712130_test_parquetpb\"))\n(let $3 (S3SinkSettings \'\"part/x=1/\" \'(\'(\'\"multipart\" \'\"true\") \'(\'\"block_output\" \'\"true\")) (SecureParam \'\"cluster:default_h5217332395946712130_test_parquetpb\") \'\".parquet\" (StructType \'(\'\"bar\" (DataType \'Utf8)) \'(\'\"foo\" (DataType \'Int32)))))\n(return (Commit! (DqQuery! $1 \'((DqStage \'() (lambda \'() (block \'(\n  (let $4 (lambda \'($5) (Member $5 \'\"bar\") (Member $5 \'\"foo\")))\n  (return (WideToBlocks (FromFlow (ExpandMap (ToFlow (AsList (AsStruct \'(\'\"bar\" (Utf8 \'\"xxx\")) \'(\'\"foo\" (Int32 \'\"123\"))) (AsStruct \'(\'\"bar\" (Utf8 \'\"yyy\")) \'(\'\"foo\" (Int32 \'\"456\"))))) $4))))\n))) \'() \'((DqSink \'0 $2 $3))))) $2))\n)\n"
  }
}

2025-11-10 10:17:27,823 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            insert into `h5217332395946712130_test_parquetpb`.`part/x=2/` with (format=\"parquet\")\n            select * from AS_TABLE([<|foo:234, bar:\"zzz\"u|>,<|foo:567, bar:\"ttt\"u|>]);\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "5f8fe142-0b23-4991-9fdb-fc07eeeb4f03"

2025-11-10 10:17:27,850 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsokkmch6r7tiap4"

2025-11-10 10:17:27,858 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokkmch6r7tiap4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769847
        nanos: 827170000
      }
      modified_at {
        seconds: 1762769847
        nanos: 827170000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsokkmch6mb45ee2-ptqudsokkmch6r7tiap4"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769847
      nanos: 827170000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h5217332395946712130_test_parquetpb`.`part/x=2/` with (format=\"parquet\")\n            select * from AS_TABLE([<|foo:234, bar:\"zzz\"u|>,<|foo:567, bar:\"ttt\"u|>]);\n            "
    syntax: YQL_V1
  }
}

2025-11-10 10:17:28,366 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokkmch6r7tiap4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769847
        nanos: 827170000
      }
      modified_at {
        seconds: 1762769847
        nanos: 827170000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769848
      nanos: 267000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsokkmch6mb45ee2-ptqudsokkmch6r7tiap4"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769847
      nanos: 827170000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h5217332395946712130_test_parquetpb`.`part/x=2/` with (format=\"parquet\")\n            select * from AS_TABLE([<|foo:234, bar:\"zzz\"u|>,<|foo:567, bar:\"ttt\"u|>]);\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"AsList\"},{\"Name\":\"ToFlow\"},{\"Name\":\"ExpandMap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideToBlocks\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'\"s3\" \'\"h5217332395946712130_test_parquetpb\"))\n(let $3 (S3SinkSettings \'\"part/x=2/\" \'(\'(\'\"multipart\" \'\"true\") \'(\'\"block_output\" \'\"true\")) (SecureParam \'\"cluster:default_h5217332395946712130_test_parquetpb\") \'\".parquet\" (StructType \'(\'\"bar\" (DataType \'Utf8)) \'(\'\"foo\" (DataType \'Int32)))))\n(return (Commit! (DqQuery! $1 \'((DqStage \'() (lambda \'() (block \'(\n  (let $4 (lambda \'($5) (Member $5 \'\"bar\") (Member $5 \'\"foo\")))\n  (return (WideToBlocks (FromFlow (ExpandMap (ToFlow (AsList (AsStruct \'(\'\"bar\" (Utf8 \'\"zzz\")) \'(\'\"foo\" (Int32 \'\"234\"))) (AsStruct \'(\'\"bar\" (Utf8 \'\"ttt\")) \'(\'\"foo\" (Int32 \'\"567\"))))) $4))))\n))) \'() \'((DqSink \'0 $2 $3))))) $2))\n)\n"
  }
}

2025-11-10 10:17:28,873 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokkmch6r7tiap4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769847
        nanos: 827170000
      }
      modified_at {
        seconds: 1762769847
        nanos: 827170000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769848
      nanos: 267000000
    }
    finished_at {
      seconds: 1762769848
      nanos: 421000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsokkmch6mb45ee2-ptqudsokkmch6r7tiap4"
    result_expire_at {
      seconds: 1762856248
      nanos: 255648000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769847
      nanos: 827170000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h5217332395946712130_test_parquetpb`.`part/x=2/` with (format=\"parquet\")\n            select * from AS_TABLE([<|foo:234, bar:\"zzz\"u|>,<|foo:567, bar:\"ttt\"u|>]);\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"AsList\"},{\"Name\":\"ToFlow\"},{\"Name\":\"ExpandMap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideToBlocks\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"74ms\",\"count\":1,\"avg\":\"74ms\",\"max\":\"74ms\",\"min\":\"74ms\"},\"EgressBytes\":{\"sum\":533,\"count\":1,\"avg\":533,\"max\":533,\"min\":533},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":934208,\"count\":1,\"avg\":934208,\"max\":934208,\"min\":934208},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'\"s3\" \'\"h5217332395946712130_test_parquetpb\"))\n(let $3 (S3SinkSettings \'\"part/x=2/\" \'(\'(\'\"multipart\" \'\"true\") \'(\'\"block_output\" \'\"true\")) (SecureParam \'\"cluster:default_h5217332395946712130_test_parquetpb\") \'\".parquet\" (StructType \'(\'\"bar\" (DataType \'Utf8)) \'(\'\"foo\" (DataType \'Int32)))))\n(return (Commit! (DqQuery! $1 \'((DqStage \'() (lambda \'() (block \'(\n  (let $4 (lambda \'($5) (Member $5 \'\"bar\") (Member $5 \'\"foo\")))\n  (return (WideToBlocks (FromFlow (ExpandMap (ToFlow (AsList (AsStruct \'(\'\"bar\" (Utf8 \'\"zzz\")) \'(\'\"foo\" (Int32 \'\"234\"))) (AsStruct \'(\'\"bar\" (Utf8 \'\"ttt\")) \'(\'\"foo\" (Int32 \'\"567\"))))) $4))))\n))) \'() \'((DqSink \'0 $2 $3))))) $2))\n)\n"
  }
}

2025-11-10 10:17:28,875 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            SELECT foo, bar, x FROM `h5217332395946712130_test_parquetpb`.`part/`\n            WITH\n            (\n                format=\"parquet\",\n                schema=(\n                    foo Int NOT NULL,\n                    bar String NOT NULL,\n                    x Int NOT NULL,\n                ),\n                partitioned_by=(`x`)\n            )\n            ORDER BY foo\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "cf219df6-c9fa-4144-a661-3cffa953bb12"

2025-11-10 10:17:28,894 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsokklcf4aotuhqq"

2025-11-10 10:17:28,901 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokklcf4aotuhqq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769848
        nanos: 877862000
      }
      modified_at {
        seconds: 1762769848
        nanos: 877862000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsokklcf450p5f0m-ptqudsokklcf4aotuhqq"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769848
      nanos: 877862000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            SELECT foo, bar, x FROM `h5217332395946712130_test_parquetpb`.`part/`\n            WITH\n            (\n                format=\"parquet\",\n                schema=(\n                    foo Int NOT NULL,\n                    bar String NOT NULL,\n                    x Int NOT NULL,\n                ),\n                partitioned_by=(`x`)\n            )\n            ORDER BY foo\n            "
    syntax: YQL_V1
  }
}

2025-11-10 10:17:29,409 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokklcf4aotuhqq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769848
        nanos: 877862000
      }
      modified_at {
        seconds: 1762769848
        nanos: 877862000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769849
      nanos: 272000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsokklcf450p5f0m-ptqudsokklcf4aotuhqq"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769848
      nanos: 877862000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            SELECT foo, bar, x FROM `h5217332395946712130_test_parquetpb`.`part/`\n            WITH\n            (\n                format=\"parquet\",\n                schema=(\n                    foo Int NOT NULL,\n                    bar String NOT NULL,\n                    x Int NOT NULL,\n                ),\n                partitioned_by=(`x`)\n            )\n            ORDER BY foo\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":12,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"Sort\"}]}},{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[12]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":3,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":12,\"level\":1,\"name\":\"DqStage #12\",\"type\":\"op\"},{\"id\":10,\"level\":2,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":3,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":4,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":5,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":12,\"target\":10},{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 4
        column: 37
      }
      message: "At function: S3ReadObject!"
      end_position {
        row: 4
        column: 37
      }
      severity: 2
      issues {
        message: "Runtime listing is not allowed for federated queries, pragma value was ignored"
        severity: 2
      }
    }
  }
  result_set_meta {
    column {
      name: "foo"
      type {
        type_id: INT32
      }
    }
    column {
      name: "bar"
      type {
        type_id: STRING
      }
    }
    column {
      name: "x"
      type {
        type_id: INT32
      }
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'\"false\"))\n(let $3 (DataSink \'result))\n(let $4 \'\"h5217332395946712130_test_parquetpb\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 \'\"Paths {\\n  Name: \\\"part\\\"\\n  Children {\\n    Name: \\\"x=1\\\"\\n    Children {\\n      Name: \\\"ptjudsokkncelke0ia3i_0_-ykfieMdl0OBUtoIiQUz3U-zcUuFpB8U.parquet\\\"\\n      Size: 533\\n      Read: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $7 (Bool \'true))\n(let $8 (AsStruct \'(\'\"x\" (Int32 \'1))))\n(let $9 \'((String $6) $7 $8))\n(let $10 \'\"Paths {\\n  Name: \\\"part\\\"\\n  Children {\\n    Name: \\\"x=2\\\"\\n    Children {\\n      Name: \\\"ptjudsokkmch6mb45ee2_0_aPBiTAKcgEW8NIx44U4R_O9NFYf4XfXi.parquet\\\"\\n      Size: 533\\n      Read: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $11 (AsStruct \'(\'\"x\" (Int32 \'\"2\"))))\n(let $12 \'((String $10) $7 $11))\n(let $13 (DataType \'Int32))\n(let $14 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" $13) \'(\'\"x\" $13)))\n(let $15 (S3ParseSettings world \'($9 $12) (SecureParam \'\"cluster:default_h5217332395946712130_test_parquetpb\") \'\"\" \'\"part/ \" \'\"parquet\" $14 (lambda \'($22) $7) \'(\'(\'\"partitionedby\" \'\"x\"))))\n(let $16 (DqStage \'((DqSource $5 $15)) (lambda \'($23) (block \'(\n  (let $24 (Uint64 \'1))\n  (return (Sort (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $23 $5 $14 \'(\'(\'format \'\"parquet\") \'(\'\"extraColumns\" (OrderedExtend (Replicate $8 $24) (Replicate $11 $24)))))))) (lambda \'($25 $26 $27) (AsStruct \'(\'\"bar\" $25) \'(\'\"foo\" $26) \'(\'\"x\" $27)))) $7 (lambda \'($28) (Member $28 \'\"foo\"))))\n))) \'(\'(\'\"_logical_id\" \'209517))))\n(let $17 (DqStage \'((DqCnMerge (TDqOutput $16 \'\"0\") \'(\'(\'\"foo\" \'\"Asc\")))) (lambda \'($29) $29) \'(\'(\'\"_logical_id\" \'209529))))\n(let $18 (DqStage \'((DqCnUnionAll (TDqOutput $17 \'\"0\"))) (lambda \'($30) $30) \'(\'(\'\"_logical_id\" \'209576))))\n(let $19 \'(\'\"foo\" \'\"bar\" \'\"x\"))\n(let $20 \'(\'(\'type) \'(\'autoref) \'(\'columns $19)))\n(let $21 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $18 \'\"0\") \'()) $20 \'\"dq\"))\n(return (Commit! (Commit! $21 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-10 10:17:29,917 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsokklcf4aotuhqq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762769848
        nanos: 877862000
      }
      modified_at {
        seconds: 1762769848
        nanos: 877862000
      }
      revision: 1
    }
    started_at {
      seconds: 1762769849
      nanos: 272000000
    }
    finished_at {
      seconds: 1762769849
      nanos: 536000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsokklcf450p5f0m-ptqudsokklcf4aotuhqq"
    result_expire_at {
      seconds: 1762856249
      nanos: 255383000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762769848
      nanos: 877862000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            SELECT foo, bar, x FROM `h5217332395946712130_test_parquetpb`.`part/`\n            WITH\n            (\n                format=\"parquet\",\n                schema=(\n                    foo Int NOT NULL,\n                    bar String NOT NULL,\n                    x Int NOT NULL,\n                ),\n                partitioned_by=(`x`)\n            )\n            ORDER BY foo\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":12,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"Sort\"}]}},{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[12]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":3,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":12,\"level\":1,\"name\":\"DqStage #12\",\"type\":\"op\"},{\"id\":10,\"level\":2,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":3,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":4,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":5,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":12,\"target\":10},{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 4
        column: 37
      }
      message: "At function: S3ReadObject!"
      end_position {
        row: 4
        column: 37
      }
      severity: 2
      issues {
        message: "Runtime listing is not allowed for federated queries, pragma value was ignored"
        severity: 2
      }
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":4,\"count\":3,\"avg\":1,\"max\":2,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.28s\",\"count\":4,\"avg\":\"72ms\",\"max\":\"0.14s\",\"min\":\"3ms\"},\"IngressBytes\":{\"sum\":1470,\"count\":2,\"avg\":735,\"max\":735,\"min\":735},\"IngressRows\":{\"sum\":4,\"count\":2,\"avg\":2,\"max\":2,\"min\":2},\"InputBytes\":{\"sum\":71,\"count\":2,\"avg\":35,\"max\":38,\"min\":33},\"InputRows\":{\"sum\":8,\"count\":2,\"avg\":4,\"max\":4,\"min\":4},\"OutputBytes\":{\"sum\":104,\"count\":4,\"avg\":26,\"max\":33,\"min\":19},\"OutputRows\":{\"sum\":12,\"count\":4,\"avg\":3,\"max\":4,\"min\":2},\"ResultBytes\":{\"sum\":33,\"count\":1,\"avg\":33,\"max\":33,\"min\":33},\"ResultRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"MaxMemoryUsage\":{\"sum\":851968,\"count\":4,\"avg\":212992,\"max\":262144,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":4,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":4,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "foo"
      type {
        type_id: INT32
      }
    }
    column {
      name: "bar"
      type {
        type_id: STRING
      }
    }
    column {
      name: "x"
      type {
        type_id: INT32
      }
    }
    rows_count: 4
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'\"false\"))\n(let $3 (DataSink \'result))\n(let $4 \'\"h5217332395946712130_test_parquetpb\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 \'\"Paths {\\n  Name: \\\"part\\\"\\n  Children {\\n    Name: \\\"x=1\\\"\\n    Children {\\n      Name: \\\"ptjudsokkncelke0ia3i_0_-ykfieMdl0OBUtoIiQUz3U-zcUuFpB8U.parquet\\\"\\n      Size: 533\\n      Read: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $7 (Bool \'true))\n(let $8 (AsStruct \'(\'\"x\" (Int32 \'1))))\n(let $9 \'((String $6) $7 $8))\n(let $10 \'\"Paths {\\n  Name: \\\"part\\\"\\n  Children {\\n    Name: \\\"x=2\\\"\\n    Children {\\n      Name: \\\"ptjudsokkmch6mb45ee2_0_aPBiTAKcgEW8NIx44U4R_O9NFYf4XfXi.parquet\\\"\\n      Size: 533\\n      Read: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $11 (AsStruct \'(\'\"x\" (Int32 \'\"2\"))))\n(let $12 \'((String $10) $7 $11))\n(let $13 (DataType \'Int32))\n(let $14 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" $13) \'(\'\"x\" $13)))\n(let $15 (S3ParseSettings world \'($9 $12) (SecureParam \'\"cluster:default_h5217332395946712130_test_parquetpb\") \'\"\" \'\"part/ \" \'\"parquet\" $14 (lambda \'($22) $7) \'(\'(\'\"partitionedby\" \'\"x\"))))\n(let $16 (DqStage \'((DqSource $5 $15)) (lambda \'($23) (block \'(\n  (let $24 (Uint64 \'1))\n  (return (Sort (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $23 $5 $14 \'(\'(\'format \'\"parquet\") \'(\'\"extraColumns\" (OrderedExtend (Replicate $8 $24) (Replicate $11 $24)))))))) (lambda \'($25 $26 $27) (AsStruct \'(\'\"bar\" $25) \'(\'\"foo\" $26) \'(\'\"x\" $27)))) $7 (lambda \'($28) (Member $28 \'\"foo\"))))\n))) \'(\'(\'\"_logical_id\" \'209517))))\n(let $17 (DqStage \'((DqCnMerge (TDqOutput $16 \'\"0\") \'(\'(\'\"foo\" \'\"Asc\")))) (lambda \'($29) $29) \'(\'(\'\"_logical_id\" \'209529))))\n(let $18 (DqStage \'((DqCnUnionAll (TDqOutput $17 \'\"0\"))) (lambda \'($30) $30) \'(\'(\'\"_logical_id\" \'209576))))\n(let $19 \'(\'\"foo\" \'\"bar\" \'\"x\"))\n(let $20 \'(\'(\'type) \'(\'autoref) \'(\'columns $19)))\n(let $21 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $18 \'\"0\") \'()) $20 \'\"dq\"))\n(return (Commit! (Commit! $21 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-10 10:17:29,929 - DEBUG - root - test_parquet: columns {
  name: "foo"
  type {
    type_id: INT32
  }
}
columns {
  name: "bar"
  type {
    type_id: STRING
  }
}
columns {
  name: "x"
  type {
    type_id: INT32
  }
}
rows {
  items {
    int32_value: 123
  }
  items {
    bytes_value: "xxx"
  }
  items {
    int32_value: 1
  }
}
rows {
  items {
    int32_value: 234
  }
  items {
    bytes_value: "zzz"
  }
  items {
    int32_value: 2
  }
}
rows {
  items {
    int32_value: 456
  }
  items {
    bytes_value: "yyy"
  }
  items {
    int32_value: 1
  }
}
rows {
  items {
    int32_value: 567
  }
  items {
    bytes_value: "ttt"
  }
  items {
    int32_value: 2
  }
}

2025-11-10 10:17:29,932 - INFO - ya.test - pytest_runtest_teardown: Test teardown
