2025-11-14 10:12:43,425 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:12:43,426 - INFO - ya.test - pytest_runtest_setup: test_raw_format[v1-true-client0]
2025-11-14 10:12:43,426 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:12:43,426 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-14 10:12:43,567 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_explicit_partitioning_1.py::TestS3, test_name: test_raw_format[v1-true-client0])
2025-11-14 10:12:43,568 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f47110347d0>
2025-11-14 10:12:43,570 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f47111404d0>
2025-11-14 10:12:43,572 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f47102cc4d0>
2025-11-14 10:12:43,573 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f47111401d0>
2025-11-14 10:12:43,578 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:12:43,585 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:12:43,586 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:12:43,588 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-14 10:12:43,590 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-14 10:12:43,591 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-14 10:12:43,593 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f47102cd0d0>
2025-11-14 10:12:43,593 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'raw_bucket', 'ACL': 'public-read'}
2025-11-14 10:12:43,595 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f4711036690>
2025-11-14 10:12:43,595 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f4711054f50>
2025-11-14 10:12:43,596 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f46f4552680>>
2025-11-14 10:12:43,596 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f4711036450>
2025-11-14 10:12:43,596 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f4711055190>
2025-11-14 10:12:43,596 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f46f4552680>>
2025-11-14 10:12:43,597 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'raw_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:14912', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:12:43,599 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:14912/raw_bucket
2025-11-14 10:12:43,599 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:12:43,599 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:12:43,600 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f4711036b10>
2025-11-14 10:12:43,600 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f4711034a10>
2025-11-14 10:12:43,601 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f4711054590>
2025-11-14 10:12:43,601 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/raw_bucket/', 'url': 'http://localhost:14912/raw_bucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f46fb52acc0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'raw_bucket', 'params': {'Bucket': 'raw_bucket', 'ACL': 'public-read'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:12:43,602 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f46fb52a090>>
2025-11-14 10:12:43,603 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f46f458a360>>
2025-11-14 10:12:43,603 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f47110362d0>
2025-11-14 10:12:43,604 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f47110550d0>
2025-11-14 10:12:43,605 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:12:43,605 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/raw_bucket

host:localhost:14912
x-amz-acl:public-read
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101243Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:12:43,605 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101243Z
20251114/yandex/s3/aws4_request
275e71a59e7d55963385a1c7c05af689377b661c232c91694e726f66ab3dd2bc
2025-11-14 10:12:43,606 - DEBUG - botocore.auth - add_auth: Signature:
e0b9b8f0eb513abe13b7d46aeee925721b3ce8e2eb84688ed10a5d9156efb689
2025-11-14 10:12:43,606 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f4711054e90>
2025-11-14 10:12:43,606 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:14912/raw_bucket, headers={'x-amz-acl': b'public-read', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101243Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=e0b9b8f0eb513abe13b7d46aeee925721b3ce8e2eb84688ed10a5d9156efb689', 'amz-sdk-invocation-id': b'74c238a9-68e8-4e2e-ac40-4bbc3582f05f', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-14 10:12:43,624 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:12:43 GMT', 'x-amzn-requestid': 'WQ0DoNvTdb0VjT3bWeQ7QPl71G8SsioarrV63slHPiQTMevk9SdQ', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '164', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:12:43,624 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>raw_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-14 10:12:43,626 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f46f5406f40>
2025-11-14 10:12:43,626 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:12:43,626 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f46f4552680>>
2025-11-14 10:12:43,627 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'WQ0DoNvTdb0VjT3bWeQ7QPl71G8SsioarrV63slHPiQTMevk9SdQ', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:12:43 GMT', 'x-amzn-requestid': 'WQ0DoNvTdb0VjT3bWeQ7QPl71G8SsioarrV63slHPiQTMevk9SdQ', 'content-type': 'text/html; charset=utf-8', 'content-length': '164', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-14 10:12:43,628 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f47110347d0>
2025-11-14 10:12:43,631 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f47111404d0>
2025-11-14 10:12:43,632 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f47102cc4d0>
2025-11-14 10:12:43,632 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f47111401d0>
2025-11-14 10:12:43,636 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:12:43,641 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:12:43,643 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:12:43,645 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f4711037710>
2025-11-14 10:12:43,646 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f4711036750>
2025-11-14 10:12:43,646 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f4711054410>
2025-11-14 10:12:43,646 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f4711036690>
2025-11-14 10:12:43,646 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f4711054f50>
2025-11-14 10:12:43,646 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f46f4ad4970>>
2025-11-14 10:12:43,647 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f4711036450>
2025-11-14 10:12:43,647 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f4711055190>
2025-11-14 10:12:43,647 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f46f4ad4970>>
2025-11-14 10:12:43,648 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'raw_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:14912', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:12:43,649 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:14912/raw_bucket
2025-11-14 10:12:43,650 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:12:43,650 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:12:43,651 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_md5 at 0x7f471124f650>
2025-11-14 10:12:43,651 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f4711036b10>
2025-11-14 10:12:43,652 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-14 10:12:43,652 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f4711034a10>
2025-11-14 10:12:43,652 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f4711054590>
2025-11-14 10:12:43,653 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/raw_format/year%3D2023/month%3D01/day%3D14/file1.txt', 'query_string': {}, 'method': 'PUT', 'headers': {'Content-Type': 'text/plain', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': 'HLJR7A1WjeapKbUgxK7Y0Q==', 'Expect': '100-continue'}, 'body': <_io.BytesIO object at 0x7f46fb5267b0>, 'auth_path': '/raw_bucket/raw_format/year%3D2023/month%3D01/day%3D14/file1.txt', 'url': 'http://localhost:14912/raw_bucket/raw_format/year%3D2023/month%3D01/day%3D14/file1.txt', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f46f9574e20>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'raw_bucket', 'params': {'Body': <_io.BytesIO object at 0x7f46fb5267b0>, 'Bucket': 'raw_bucket', 'Key': 'raw_format/year=2023/month=01/day=14/file1.txt', 'ContentType': 'text/plain'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:12:43,654 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f46f9577da0>>
2025-11-14 10:12:43,655 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f46fb59f760>>
2025-11-14 10:12:43,655 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f47110362d0>
2025-11-14 10:12:43,655 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f47110550d0>
2025-11-14 10:12:43,656 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:12:43,656 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/raw_bucket/raw_format/year%3D2023/month%3D01/day%3D14/file1.txt

content-md5:HLJR7A1WjeapKbUgxK7Y0Q==
content-type:text/plain
host:localhost:14912
x-amz-content-sha256:982d9e3eb996f559e633f4d194def3761d909f5a3b647d1a851fead67c32c9d1
x-amz-date:20251114T101243Z

content-md5;content-type;host;x-amz-content-sha256;x-amz-date
982d9e3eb996f559e633f4d194def3761d909f5a3b647d1a851fead67c32c9d1
2025-11-14 10:12:43,657 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101243Z
20251114/yandex/s3/aws4_request
ef2ac86a5e9cd40f28f2bf33a915ca94458f6629a790d537371d4ab28e088353
2025-11-14 10:12:43,657 - DEBUG - botocore.auth - add_auth: Signature:
41ce9673f78b62b85ae468d1a2a942589d5a27f42e9b52f1a426b1ee1e2317b9
2025-11-14 10:12:43,657 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f4711054e90>
2025-11-14 10:12:43,657 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:14912/raw_bucket/raw_format/year%3D2023/month%3D01/day%3D14/file1.txt, headers={'Content-Type': b'text/plain', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': b'HLJR7A1WjeapKbUgxK7Y0Q==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251114T101243Z', 'X-Amz-Content-SHA256': b'982d9e3eb996f559e633f4d194def3761d909f5a3b647d1a851fead67c32c9d1', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;content-type;host;x-amz-content-sha256;x-amz-date, Signature=41ce9673f78b62b85ae468d1a2a942589d5a27f42e9b52f1a426b1ee1e2317b9', 'amz-sdk-invocation-id': b'77b79460-9afe-42c0-9d9e-574cde2df908', 'amz-sdk-request': b'attempt=1', 'Content-Length': '4'}>
2025-11-14 10:12:43,660 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-14 10:12:43,662 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-14 10:12:43,668 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:12:43 GMT', 'ETag': '"1cb251ec0d568de6a929b520c4aed8d1"', 'last-modified': 'Fri, 14 Nov 2025 10:12:43 GMT', 'Content-Length': '0', 'x-amzn-requestid': 'aAZIQGHnUPcoPUCdL7PQBwHx94WuZo8FnCXPRq5kkifByEx4mSIc', 'Content-Type': 'text/html; charset=utf-8', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:12:43,669 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:12:43,670 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f46fc7867c0>
2025-11-14 10:12:43,670 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:12:43,670 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f46f4ad4970>>
2025-11-14 10:12:43,671 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:12:43,731 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:12:43,781 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "pragma dq.MaxTasksPerStage=\"10\"; \n            pragma s3.UseRuntimeListing=\"true\";\n            \n            $projection = @@ {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${timestamp}\",\n                \"projection.timestamp.type\" : \"date\",\n                \"projection.timestamp.min\" : \"2023-01-14\",\n                \"projection.timestamp.max\" : \"2023-01-14\",\n                \"projection.timestamp.interval\" : \"1\",\n                \"projection.timestamp.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.timestamp.unit\" : \"DAYS\"\n            }\n            @@;\n            \n            SELECT\n                data,\n                timestamp\n            FROM\n                `h6969009485427892182_test_raw_formatrawbucket`.`raw_format`\n            WITH\n            (\n                format=\"raw\",\n                schema=(\n                    `data` String NOT NULL,\n                    `timestamp` Date NOT NULL\n                ),\n                partitioned_by=(`timestamp`),\n                projection=$projection\n            )\n        "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "eea0f102-9344-4046-9865-80642300e8a3"

2025-11-14 10:12:43,831 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej1fdcuk5laf9c"

2025-11-14 10:12:43,857 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej1fdcuk5laf9c"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115163
        nanos: 798558000
      }
      modified_at {
        seconds: 1763115163
        nanos: 798558000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej1fdcsc7598hn-ptqudsej1fdcuk5laf9c"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115163
      nanos: 798558000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "pragma dq.MaxTasksPerStage=\"10\"; \n            pragma s3.UseRuntimeListing=\"true\";\n            \n            $projection = @@ {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${timestamp}\",\n                \"projection.timestamp.type\" : \"date\",\n                \"projection.timestamp.min\" : \"2023-01-14\",\n                \"projection.timestamp.max\" : \"2023-01-14\",\n                \"projection.timestamp.interval\" : \"1\",\n                \"projection.timestamp.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.timestamp.unit\" : \"DAYS\"\n            }\n            @@;\n            \n            SELECT\n                data,\n                timestamp\n            FROM\n                `h6969009485427892182_test_raw_formatrawbucket`.`raw_format`\n            WITH\n            (\n                format=\"raw\",\n                schema=(\n                    `data` String NOT NULL,\n                    `timestamp` Date NOT NULL\n                ),\n                partitioned_by=(`timestamp`),\n                projection=$projection\n            )\n        "
    syntax: YQL_V1
  }
}

2025-11-14 10:12:44,399 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:12:45,177 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej1fdcuk5laf9c"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115163
        nanos: 798558000
      }
      modified_at {
        seconds: 1763115163
        nanos: 798558000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115164
      nanos: 670000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej1fdcsc7598hn-ptqudsej1fdcuk5laf9c"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115163
      nanos: 798558000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "pragma dq.MaxTasksPerStage=\"10\"; \n            pragma s3.UseRuntimeListing=\"true\";\n            \n            $projection = @@ {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${timestamp}\",\n                \"projection.timestamp.type\" : \"date\",\n                \"projection.timestamp.min\" : \"2023-01-14\",\n                \"projection.timestamp.max\" : \"2023-01-14\",\n                \"projection.timestamp.interval\" : \"1\",\n                \"projection.timestamp.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.timestamp.unit\" : \"DAYS\"\n            }\n            @@;\n            \n            SELECT\n                data,\n                timestamp\n            FROM\n                `h6969009485427892182_test_raw_formatrawbucket`.`raw_format`\n            WITH\n            (\n                format=\"raw\",\n                schema=(\n                    `data` String NOT NULL,\n                    `timestamp` Date NOT NULL\n                ),\n                partitioned_by=(`timestamp`),\n                projection=$projection\n            )\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":10,\"level\":1,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":2,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  result_set_meta {
    column {
      name: "data"
      type {
        type_id: STRING
      }
    }
    column {
      name: "timestamp"
      type {
        type_id: DATE
      }
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"dq\" \'\"$all\") \'\"Attr\" \'\"maxtasksperstage\" \'\"10\"))\n(let $3 (Configure! $2 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'\"true\"))\n(let $4 (DataSink \'result))\n(let $5 \'\"h6969009485427892182_test_raw_formatrawbucket\")\n(let $6 (DataSource \'\"s3\" $5))\n(let $7 \'\"Paths {\\n  Name: \\\"raw_format\\\"\\n  Children {\\n    Name: \\\"year=2023\\\"\\n    Children {\\n      Name: \\\"month=01\\\"\\n      Children {\\n        Name: \\\"day=14\\\"\\n        Read: true\\n        IsDirectory: true\\n      }\\n      IsDirectory: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $8 (AsStruct \'(\'\"timestamp\" (Date \'\"2023-01-14\"))))\n(let $9 (S3SourceSettings world \'(\'((String $7) (Bool \'\"true\") $8)) (SecureParam \'\"cluster:default_h6969009485427892182_test_raw_formatrawbucket\") \'\"\" \'\"raw_format \" (Void) \'\"*\" \'\"FilePattern\"))\n(let $10 (DqStage \'((DqSource $6 $9)) (lambda \'($14) (block \'(\n  (let $15 \'\" {\\n                \\\"projection.enabled\\\" : \\\"true\\\",\\n                \\\"storage.location.template\\\" : \\\"/${timestamp}\\\",\\n                \\\"projection.timestamp.type\\\" : \\\"date\\\",\\n                \\\"projection.timestamp.min\\\" : \\\"2023-01-14\\\",\\n                \\\"projection.timestamp.max\\\" : \\\"2023-01-14\\\",\\n                \\\"projection.timestamp.interval\\\" : \\\"1\\\",\\n                \\\"projection.timestamp.format\\\" : \\\"year=%Y/month=%m/day=%d\\\",\\n                \\\"projection.timestamp.unit\\\" : \\\"DAYS\\\"\\n            }\\n            \")\n  (let $16 \'(\'(\'\"partitionedby\" \'\"timestamp\") \'(\'\"projection\" $15) \'(\'directories) \'(\'\"pathpattern\" \'\"*\") \'(\'\"pathpatternvariant\" \'\"FilePattern\")))\n  (let $17 \'(\'(\'format \'\"raw\") \'(\'\"extraColumns\" (Replicate $8 (Uint64 \'1))) \'(\'settings $16)))\n  (let $18 (DqSourceWideWrap $14 $6 (StructType \'(\'\"data\" (DataType \'String)) \'(\'\"timestamp\" (DataType \'Date))) $17))\n  (return (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"timestamp\" $20)))))\n))) \'(\'(\'\"_logical_id\" \'200125))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($21) $21) \'(\'(\'\"_logical_id\" \'200164))))\n(let $12 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"data\" \'\"timestamp\"))))\n(let $13 (ResPull! $3 $4 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) $12 \'\"dq\"))\n(return (Commit! (Commit! $13 $4) (DataSink \'\"s3\" $5)))\n)\n"
  }
}

2025-11-14 10:12:45,721 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej1fdcuk5laf9c"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115163
        nanos: 798558000
      }
      modified_at {
        seconds: 1763115163
        nanos: 798558000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115164
      nanos: 670000000
    }
    finished_at {
      seconds: 1763115165
      nanos: 270000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej1fdcsc7598hn-ptqudsej1fdcuk5laf9c"
    result_expire_at {
      seconds: 1763201564
      nanos: 657656000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115163
      nanos: 798558000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "pragma dq.MaxTasksPerStage=\"10\"; \n            pragma s3.UseRuntimeListing=\"true\";\n            \n            $projection = @@ {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${timestamp}\",\n                \"projection.timestamp.type\" : \"date\",\n                \"projection.timestamp.min\" : \"2023-01-14\",\n                \"projection.timestamp.max\" : \"2023-01-14\",\n                \"projection.timestamp.interval\" : \"1\",\n                \"projection.timestamp.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.timestamp.unit\" : \"DAYS\"\n            }\n            @@;\n            \n            SELECT\n                data,\n                timestamp\n            FROM\n                `h6969009485427892182_test_raw_formatrawbucket`.`raw_format`\n            WITH\n            (\n                format=\"raw\",\n                schema=(\n                    `data` String NOT NULL,\n                    `timestamp` Date NOT NULL\n                ),\n                partitioned_by=(`timestamp`),\n                projection=$projection\n            )\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":10,\"level\":1,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":2,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":11,\"count\":2,\"avg\":5,\"max\":10,\"min\":1},\"CpuTimeUs\":{\"sum\":\"1.11s\",\"count\":11,\"avg\":\"0.10s\",\"max\":\"0.11s\",\"min\":\"3ms\"},\"IngressBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"InputBytes\":{\"sum\":13,\"count\":1,\"avg\":13,\"max\":13,\"min\":13},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":26,\"count\":2,\"avg\":13,\"max\":13,\"min\":13},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":13,\"count\":1,\"avg\":13,\"max\":13,\"min\":13},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":1441792,\"count\":11,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":11,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":11,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "data"
      type {
        type_id: STRING
      }
    }
    column {
      name: "timestamp"
      type {
        type_id: DATE
      }
    }
    rows_count: 1
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"dq\" \'\"$all\") \'\"Attr\" \'\"maxtasksperstage\" \'\"10\"))\n(let $3 (Configure! $2 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'\"true\"))\n(let $4 (DataSink \'result))\n(let $5 \'\"h6969009485427892182_test_raw_formatrawbucket\")\n(let $6 (DataSource \'\"s3\" $5))\n(let $7 \'\"Paths {\\n  Name: \\\"raw_format\\\"\\n  Children {\\n    Name: \\\"year=2023\\\"\\n    Children {\\n      Name: \\\"month=01\\\"\\n      Children {\\n        Name: \\\"day=14\\\"\\n        Read: true\\n        IsDirectory: true\\n      }\\n      IsDirectory: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $8 (AsStruct \'(\'\"timestamp\" (Date \'\"2023-01-14\"))))\n(let $9 (S3SourceSettings world \'(\'((String $7) (Bool \'\"true\") $8)) (SecureParam \'\"cluster:default_h6969009485427892182_test_raw_formatrawbucket\") \'\"\" \'\"raw_format \" (Void) \'\"*\" \'\"FilePattern\"))\n(let $10 (DqStage \'((DqSource $6 $9)) (lambda \'($14) (block \'(\n  (let $15 \'\" {\\n                \\\"projection.enabled\\\" : \\\"true\\\",\\n                \\\"storage.location.template\\\" : \\\"/${timestamp}\\\",\\n                \\\"projection.timestamp.type\\\" : \\\"date\\\",\\n                \\\"projection.timestamp.min\\\" : \\\"2023-01-14\\\",\\n                \\\"projection.timestamp.max\\\" : \\\"2023-01-14\\\",\\n                \\\"projection.timestamp.interval\\\" : \\\"1\\\",\\n                \\\"projection.timestamp.format\\\" : \\\"year=%Y/month=%m/day=%d\\\",\\n                \\\"projection.timestamp.unit\\\" : \\\"DAYS\\\"\\n            }\\n            \")\n  (let $16 \'(\'(\'\"partitionedby\" \'\"timestamp\") \'(\'\"projection\" $15) \'(\'directories) \'(\'\"pathpattern\" \'\"*\") \'(\'\"pathpatternvariant\" \'\"FilePattern\")))\n  (let $17 \'(\'(\'format \'\"raw\") \'(\'\"extraColumns\" (Replicate $8 (Uint64 \'1))) \'(\'settings $16)))\n  (let $18 (DqSourceWideWrap $14 $6 (StructType \'(\'\"data\" (DataType \'String)) \'(\'\"timestamp\" (DataType \'Date))) $17))\n  (return (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"timestamp\" $20)))))\n))) \'(\'(\'\"_logical_id\" \'200125))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($21) $21) \'(\'(\'\"_logical_id\" \'200164))))\n(let $12 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"data\" \'\"timestamp\"))))\n(let $13 (ResPull! $3 $4 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) $12 \'\"dq\"))\n(return (Commit! (Commit! $13 $4) (DataSink \'\"s3\" $5)))\n)\n"
  }
}

2025-11-14 10:12:45,752 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:12:45,752 - INFO - root - test_raw_format: AST: (
(let $1 (Configure! world (DataSource '"config") '"DqEngine" '"force"))
(let $2 (Configure! $1 (DataSource '"dq" '"$all") '"Attr" '"maxtasksperstage" '"10"))
(let $3 (Configure! $2 (DataSource '"s3" '"$all") '"Attr" '"useruntimelisting" '"true"))
(let $4 (DataSink 'result))
(let $5 '"h6969009485427892182_test_raw_formatrawbucket")
(let $6 (DataSource '"s3" $5))
(let $7 '"Paths {\n  Name: \"raw_format\"\n  Children {\n    Name: \"year=2023\"\n    Children {\n      Name: \"month=01\"\n      Children {\n        Name: \"day=14\"\n        Read: true\n        IsDirectory: true\n      }\n      IsDirectory: true\n    }\n    IsDirectory: true\n  }\n  IsDirectory: true\n}\n")
(let $8 (AsStruct '('"timestamp" (Date '"2023-01-14"))))
(let $9 (S3SourceSettings world '('((String $7) (Bool '"true") $8)) (SecureParam '"cluster:default_h6969009485427892182_test_raw_formatrawbucket") '"" '"raw_format " (Void) '"*" '"FilePattern"))
(let $10 (DqStage '((DqSource $6 $9)) (lambda '($14) (block '(
  (let $15 '" {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${timestamp}\",\n                \"projection.timestamp.type\" : \"date\",\n                \"projection.timestamp.min\" : \"2023-01-14\",\n                \"projection.timestamp.max\" : \"2023-01-14\",\n                \"projection.timestamp.interval\" : \"1\",\n                \"projection.timestamp.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.timestamp.unit\" : \"DAYS\"\n            }\n            ")
  (let $16 '('('"partitionedby" '"timestamp") '('"projection" $15) '('directories) '('"pathpattern" '"*") '('"pathpatternvariant" '"FilePattern")))
  (let $17 '('('format '"raw") '('"extraColumns" (Replicate $8 (Uint64 '1))) '('settings $16)))
  (let $18 (DqSourceWideWrap $14 $6 (StructType '('"data" (DataType 'String)) '('"timestamp" (DataType 'Date))) $17))
  (return (NarrowMap $18 (lambda '($19 $20) (AsStruct '('"data" $19) '('"timestamp" $20)))))
))) '('('"_logical_id" '200125))))
(let $11 (DqStage '((DqCnUnionAll (TDqOutput $10 '"0"))) (lambda '($21) $21) '('('"_logical_id" '200164))))
(let $12 '('('type) '('autoref) '('columns '('"data" '"timestamp"))))
(let $13 (ResPull! $3 $4 (Key) (DqCnResult (TDqOutput $11 '"0") '()) $12 '"dq"))
(return (Commit! (Commit! $13 $4) (DataSink '"s3" $5)))
)

2025-11-14 10:12:45,784 - DEBUG - root - test_raw_format: columns {
  name: "data"
  type {
    type_id: STRING
  }
}
columns {
  name: "timestamp"
  type {
    type_id: DATE
  }
}
rows {
  items {
    bytes_value: "text"
  }
  items {
    uint32_value: 19371
  }
}

2025-11-14 10:12:45,794 - INFO - ya.test - pytest_runtest_teardown: Test teardown
