2025-11-14 10:10:28,402 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:10:28,403 - INFO - ya.test - pytest_runtest_setup: test_no_paritioning_columns[v1-false-client0]
2025-11-14 10:10:28,403 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:10:28,403 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-14 10:10:28,543 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_explicit_partitioning_0.py::TestS3, test_name: test_no_paritioning_columns[v1-false-client0])
2025-11-14 10:10:28,544 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f496e4347d0>
2025-11-14 10:10:28,548 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f496e5404d0>
2025-11-14 10:10:28,548 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f496d6e8c50>
2025-11-14 10:10:28,548 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f496e5401d0>
2025-11-14 10:10:28,552 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:10:28,558 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:10:28,559 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:10:28,560 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-14 10:10:28,562 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-14 10:10:28,563 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-14 10:10:28,565 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f496d6e96d0>
2025-11-14 10:10:28,565 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'logs2', 'ACL': 'public-read'}
2025-11-14 10:10:28,566 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f496e436690>
2025-11-14 10:10:28,567 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f496e454f50>
2025-11-14 10:10:28,567 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f496d7a9eb0>>
2025-11-14 10:10:28,567 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f496e436450>
2025-11-14 10:10:28,567 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f496e455190>
2025-11-14 10:10:28,568 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f496d7a9eb0>>
2025-11-14 10:10:28,568 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'logs2', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:27318', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:28,569 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:27318/logs2
2025-11-14 10:10:28,570 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:28,570 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:28,571 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f496e436b10>
2025-11-14 10:10:28,571 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f496e434a10>
2025-11-14 10:10:28,571 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f496e454590>
2025-11-14 10:10:28,572 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/logs2/', 'url': 'http://localhost:27318/logs2', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f4950d7ca60>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'logs2', 'params': {'Bucket': 'logs2', 'ACL': 'public-read'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:28,573 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f4950d7f030>>
2025-11-14 10:10:28,573 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f4950d31500>>
2025-11-14 10:10:28,573 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f496e4362d0>
2025-11-14 10:10:28,574 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f496e4550d0>
2025-11-14 10:10:28,575 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:28,575 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/logs2

host:localhost:27318
x-amz-acl:public-read
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101028Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:28,575 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101028Z
20251114/yandex/s3/aws4_request
5545af0a3e57b245d90536eeae7a6259d6345374e8043724a304bd483a53e9bb
2025-11-14 10:10:28,575 - DEBUG - botocore.auth - add_auth: Signature:
4a72f7a37b93e144a8a4f85803a76264543aa4e729096d889942c6074a4f1efd
2025-11-14 10:10:28,576 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f496e454e90>
2025-11-14 10:10:28,576 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:27318/logs2, headers={'x-amz-acl': b'public-read', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101028Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=4a72f7a37b93e144a8a4f85803a76264543aa4e729096d889942c6074a4f1efd', 'amz-sdk-invocation-id': b'eb750d4c-706c-4b59-8867-f80ee3038c20', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-14 10:10:28,589 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:28 GMT', 'x-amzn-requestid': 'KDmDNTuigJuQfPkMNtJLqSPEX5WOlHR4LxJDvDoB7Uzfer5JmUaE', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '159', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:28,590 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>logs2</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-14 10:10:28,591 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f49510d8b00>
2025-11-14 10:10:28,591 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:28,591 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f496d7a9eb0>>
2025-11-14 10:10:28,592 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'KDmDNTuigJuQfPkMNtJLqSPEX5WOlHR4LxJDvDoB7Uzfer5JmUaE', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:10:28 GMT', 'x-amzn-requestid': 'KDmDNTuigJuQfPkMNtJLqSPEX5WOlHR4LxJDvDoB7Uzfer5JmUaE', 'content-type': 'text/html; charset=utf-8', 'content-length': '159', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-14 10:10:28,593 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f496e4347d0>
2025-11-14 10:10:28,596 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f496e5404d0>
2025-11-14 10:10:28,596 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f496d6e8c50>
2025-11-14 10:10:28,597 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f496e5401d0>
2025-11-14 10:10:28,604 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:10:28,609 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:10:28,616 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:10:28,619 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f496e437710>
2025-11-14 10:10:28,620 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f496e436750>
2025-11-14 10:10:28,620 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f496e454410>
2025-11-14 10:10:28,620 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f496e436690>
2025-11-14 10:10:28,621 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f496e454f50>
2025-11-14 10:10:28,621 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f4951c80dd0>>
2025-11-14 10:10:28,621 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f496e436450>
2025-11-14 10:10:28,622 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f496e455190>
2025-11-14 10:10:28,622 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f4951c80dd0>>
2025-11-14 10:10:28,622 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'logs2', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:27318', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:28,624 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:27318/logs2
2025-11-14 10:10:28,624 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:28,624 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:28,625 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_md5 at 0x7f496e64f650>
2025-11-14 10:10:28,629 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f496e436b10>
2025-11-14 10:10:28,629 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-14 10:10:28,629 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f496e434a10>
2025-11-14 10:10:28,630 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f496e454590>
2025-11-14 10:10:28,630 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/logs/year%3D2023/month%3D01/day%3D16/obj1.json', 'query_string': {}, 'method': 'PUT', 'headers': {'Content-Type': 'text/json', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': 'tLPQyp7jke5bWhXfdrshWA==', 'Expect': '100-continue'}, 'body': <_io.BytesIO object at 0x7f4950d26dd0>, 'auth_path': '/logs2/logs/year%3D2023/month%3D01/day%3D16/obj1.json', 'url': 'http://localhost:27318/logs2/logs/year%3D2023/month%3D01/day%3D16/obj1.json', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f4950e7d000>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'logs2', 'params': {'Body': <_io.BytesIO object at 0x7f4950d26dd0>, 'Bucket': 'logs2', 'Key': 'logs/year=2023/month=01/day=16/obj1.json', 'ContentType': 'text/json'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:28,631 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f4950e7d7d0>>
2025-11-14 10:10:28,632 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f4958b313c0>>
2025-11-14 10:10:28,632 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f496e4362d0>
2025-11-14 10:10:28,632 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f496e4550d0>
2025-11-14 10:10:28,633 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:28,633 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/logs2/logs/year%3D2023/month%3D01/day%3D16/obj1.json

content-md5:tLPQyp7jke5bWhXfdrshWA==
content-type:text/json
host:localhost:27318
x-amz-content-sha256:ba2e0d381bd756d8f39d793eb384fcc0c1ef2256bf3a868a276d17b81a155d10
x-amz-date:20251114T101028Z

content-md5;content-type;host;x-amz-content-sha256;x-amz-date
ba2e0d381bd756d8f39d793eb384fcc0c1ef2256bf3a868a276d17b81a155d10
2025-11-14 10:10:28,634 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101028Z
20251114/yandex/s3/aws4_request
d67e863fb083a848186751681e78d90ada24c7eee4dc7fb19d8c4342739588a0
2025-11-14 10:10:28,638 - DEBUG - botocore.auth - add_auth: Signature:
8a7206851a7ca886db2dbd7a5f410a58b21d71f6d5834474e4473e3cc0eb5593
2025-11-14 10:10:28,638 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f496e454e90>
2025-11-14 10:10:28,639 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:27318/logs2/logs/year%3D2023/month%3D01/day%3D16/obj1.json, headers={'Content-Type': b'text/json', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': b'tLPQyp7jke5bWhXfdrshWA==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251114T101028Z', 'X-Amz-Content-SHA256': b'ba2e0d381bd756d8f39d793eb384fcc0c1ef2256bf3a868a276d17b81a155d10', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;content-type;host;x-amz-content-sha256;x-amz-date, Signature=8a7206851a7ca886db2dbd7a5f410a58b21d71f6d5834474e4473e3cc0eb5593', 'amz-sdk-invocation-id': b'917b6f99-f413-4b04-8f83-1330db028302', 'amz-sdk-request': b'attempt=1', 'Content-Length': '965'}>
2025-11-14 10:10:28,645 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-14 10:10:28,669 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-14 10:10:28,674 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:28 GMT', 'ETag': '"b4b3d0ca9ee391ee5b5a15df76bb2158"', 'last-modified': 'Fri, 14 Nov 2025 10:10:28 GMT', 'Content-Length': '0', 'x-amzn-requestid': 'P5fXwbVRQ8WkwYdbPUD9vqLwV2QobbHMwFy2vRD62jwjPMgVDdKs', 'Content-Type': 'text/html; charset=utf-8', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:28,675 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:10:28,676 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f4951c81a50>
2025-11-14 10:10:28,676 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:28,676 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f4951c80dd0>>
2025-11-14 10:10:28,677 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f496e437710>
2025-11-14 10:10:28,677 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f496e436750>
2025-11-14 10:10:28,686 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f496e454410>
2025-11-14 10:10:28,686 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f496e436690>
2025-11-14 10:10:28,686 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f496e454f50>
2025-11-14 10:10:28,687 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f4951c80dd0>>
2025-11-14 10:10:28,687 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f496e436450>
2025-11-14 10:10:28,687 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f496e455190>
2025-11-14 10:10:28,687 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f4951c80dd0>>
2025-11-14 10:10:28,688 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'logs2', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:27318', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:28,688 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:27318/logs2
2025-11-14 10:10:28,688 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:28,688 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:28,692 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_md5 at 0x7f496e64f650>
2025-11-14 10:10:28,694 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f496e436b10>
2025-11-14 10:10:28,694 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-14 10:10:28,694 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f496e434a10>
2025-11-14 10:10:28,695 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f496e454590>
2025-11-14 10:10:28,695 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/logs/year%3D2023/month%3D01/day%3D16/obj2.json', 'query_string': {}, 'method': 'PUT', 'headers': {'Content-Type': 'text/json', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': 'tLPQyp7jke5bWhXfdrshWA==', 'Expect': '100-continue'}, 'body': <_io.BytesIO object at 0x7f4950d27460>, 'auth_path': '/logs2/logs/year%3D2023/month%3D01/day%3D16/obj2.json', 'url': 'http://localhost:27318/logs2/logs/year%3D2023/month%3D01/day%3D16/obj2.json', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f4950e7d000>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'logs2', 'params': {'Body': <_io.BytesIO object at 0x7f4950d27460>, 'Bucket': 'logs2', 'Key': 'logs/year=2023/month=01/day=16/obj2.json', 'ContentType': 'text/json'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:28,696 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f4950e7d7d0>>
2025-11-14 10:10:28,696 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f4958b313c0>>
2025-11-14 10:10:28,696 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f496e4362d0>
2025-11-14 10:10:28,696 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f496e4550d0>
2025-11-14 10:10:28,697 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:28,697 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/logs2/logs/year%3D2023/month%3D01/day%3D16/obj2.json

content-md5:tLPQyp7jke5bWhXfdrshWA==
content-type:text/json
host:localhost:27318
x-amz-content-sha256:ba2e0d381bd756d8f39d793eb384fcc0c1ef2256bf3a868a276d17b81a155d10
x-amz-date:20251114T101028Z

content-md5;content-type;host;x-amz-content-sha256;x-amz-date
ba2e0d381bd756d8f39d793eb384fcc0c1ef2256bf3a868a276d17b81a155d10
2025-11-14 10:10:28,699 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101028Z
20251114/yandex/s3/aws4_request
3a9a43079107de1056791da9ea828d9730b55de63a1a48cd84d09729a081637b
2025-11-14 10:10:28,700 - DEBUG - botocore.auth - add_auth: Signature:
e525007ce590ad0d76fc4d97b9c9b4c9db2bcece24eb23179661007997534ded
2025-11-14 10:10:28,700 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f496e454e90>
2025-11-14 10:10:28,701 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:27318/logs2/logs/year%3D2023/month%3D01/day%3D16/obj2.json, headers={'Content-Type': b'text/json', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': b'tLPQyp7jke5bWhXfdrshWA==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251114T101028Z', 'X-Amz-Content-SHA256': b'ba2e0d381bd756d8f39d793eb384fcc0c1ef2256bf3a868a276d17b81a155d10', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;content-type;host;x-amz-content-sha256;x-amz-date, Signature=e525007ce590ad0d76fc4d97b9c9b4c9db2bcece24eb23179661007997534ded', 'amz-sdk-invocation-id': b'9b4bf1ca-4023-4785-8180-4f158e379165', 'amz-sdk-request': b'attempt=1', 'Content-Length': '965'}>
2025-11-14 10:10:28,703 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-14 10:10:28,708 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-14 10:10:28,717 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:28 GMT', 'ETag': '"b4b3d0ca9ee391ee5b5a15df76bb2158"', 'last-modified': 'Fri, 14 Nov 2025 10:10:28 GMT', 'Content-Length': '0', 'x-amzn-requestid': 'AWEAGZTUJ1P1z563G4A0ApD2V4BaPqqP1G3n9VWrZpKpJDWy0t1O', 'Content-Type': 'text/html; charset=utf-8', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:28,718 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:10:28,718 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f4951c81a50>
2025-11-14 10:10:28,719 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:28,719 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f4951c80dd0>>
2025-11-14 10:10:28,719 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:10:28,825 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:10:28,940 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            pragma s3.UseRuntimeListing=\"false\";\n            \n            $projection =\n            @@ {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${date}\",\n                \"projection.date.type\" : \"date\",\n                \"projection.date.min\" : \"2023-01-16\",\n                \"projection.date.max\" : \"2023-01-16\",\n                \"projection.date.interval\" : \"1\",\n                \"projection.date.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.date.unit\" : \"DAYS\"\n            }\n            @@;\n            \n            SELECT\n                count(message)\n            FROM\n                `h6366390195914675958_test_no_paritioning_columnslogs2`.`/logs`\n            WITH (FORMAT=\"json_each_row\",\n                SCHEMA=(\n                `@timestamp` String,\n                `cluster` String,\n                `component` String,\n                `host` String,\n                `message` String,\n                `microseconds` Uint64,\n                `npriority` Uint32,\n                `priority` String,\n                `revision` Int32,\n                `tag` String,\n                `date` Date NOT NULL\n                ),\n                partitioned_by=(`date`),\n                projection=$projection)\n            LIMIT 10;\n        "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "1faf6882-83ae-4e94-89e6-0e26462a471a"

2025-11-14 10:10:29,071 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej5fvcligdgfhp"

2025-11-14 10:10:29,112 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5fvcligdgfhp"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115028
        nanos: 991297000
      }
      modified_at {
        seconds: 1763115028
        nanos: 991297000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej5fvciob5mi6v-ptqudsej5fvcligdgfhp"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115028
      nanos: 991297000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n            \n            $projection =\n            @@ {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${date}\",\n                \"projection.date.type\" : \"date\",\n                \"projection.date.min\" : \"2023-01-16\",\n                \"projection.date.max\" : \"2023-01-16\",\n                \"projection.date.interval\" : \"1\",\n                \"projection.date.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.date.unit\" : \"DAYS\"\n            }\n            @@;\n            \n            SELECT\n                count(message)\n            FROM\n                `h6366390195914675958_test_no_paritioning_columnslogs2`.`/logs`\n            WITH (FORMAT=\"json_each_row\",\n                SCHEMA=(\n                `@timestamp` String,\n                `cluster` String,\n                `component` String,\n                `host` String,\n                `message` String,\n                `microseconds` Uint64,\n                `npriority` Uint32,\n                `priority` String,\n                `revision` Int32,\n                `tag` String,\n                `date` Date NOT NULL\n                ),\n                partitioned_by=(`date`),\n                projection=$projection)\n            LIMIT 10;\n        "
    syntax: YQL_V1
  }
}

2025-11-14 10:10:29,649 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5fvcligdgfhp"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115028
        nanos: 991297000
      }
      modified_at {
        seconds: 1763115028
        nanos: 991297000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115029
      nanos: 236000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej5fvciob5mi6v-ptqudsej5fvcligdgfhp"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115028
      nanos: 991297000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n            \n            $projection =\n            @@ {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${date}\",\n                \"projection.date.type\" : \"date\",\n                \"projection.date.min\" : \"2023-01-16\",\n                \"projection.date.max\" : \"2023-01-16\",\n                \"projection.date.interval\" : \"1\",\n                \"projection.date.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.date.unit\" : \"DAYS\"\n            }\n            @@;\n            \n            SELECT\n                count(message)\n            FROM\n                `h6366390195914675958_test_no_paritioning_columnslogs2`.`/logs`\n            WITH (FORMAT=\"json_each_row\",\n                SCHEMA=(\n                `@timestamp` String,\n                `cluster` String,\n                `component` String,\n                `host` String,\n                `message` String,\n                `microseconds` Uint64,\n                `npriority` Uint32,\n                `priority` String,\n                `revision` Int32,\n                `tag` String,\n                `date` Date NOT NULL\n                ),\n                partitioned_by=(`date`),\n                projection=$projection)\n            LIMIT 10;\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":15,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"CombineByKey\"}]}},{\"Id\":13,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"PartitionsByKeys\"},{\"Name\":\"Take\"},{\"Name\":\"Condense\"}]},\"DependsOn\":[15]},{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsList\"},{\"Name\":\"Iterator\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[13]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":4,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":15,\"level\":1,\"name\":\"DqStage #15\",\"type\":\"op\"},{\"id\":13,\"level\":2,\"name\":\"DqStage #13\",\"type\":\"op\"},{\"id\":10,\"level\":3,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":4,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":5,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":15,\"target\":13},{\"source\":13,\"target\":10},{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  result_set_meta {
    column {
      name: "column0"
      type {
        type_id: UINT64
      }
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'false))\n(let $3 (DataSink \'result))\n(let $4 \'\"h6366390195914675958_test_no_paritioning_columnslogs2\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 \'\"Paths {\\n  Name: \\\"logs\\\"\\n  Children {\\n    Name: \\\"year=2023\\\"\\n    Children {\\n      Name: \\\"month=01\\\"\\n      Children {\\n        Name: \\\"day=16\\\"\\n        Children {\\n          Name: \\\"obj1.json\\\"\\n          Size: 965\\n          Read: true\\n        }\\n        Children {\\n          Name: \\\"obj2.json\\\"\\n          Size: 965\\n          Read: true\\n        }\\n        IsDirectory: true\\n      }\\n      IsDirectory: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $7 (Bool \'\"true\"))\n(let $8 \'\"cluster:default_h6366390195914675958_test_no_paritioning_columnslogs2\")\n(let $9 (StructType \'(\'\"message\" (OptionalType (DataType \'String)))))\n(let $10 \'\" {\\n                \\\"projection.enabled\\\" : \\\"true\\\",\\n                \\\"storage.location.template\\\" : \\\"/${date}\\\",\\n                \\\"projection.date.type\\\" : \\\"date\\\",\\n                \\\"projection.date.min\\\" : \\\"2023-01-16\\\",\\n                \\\"projection.date.max\\\" : \\\"2023-01-16\\\",\\n                \\\"projection.date.interval\\\" : \\\"1\\\",\\n                \\\"projection.date.format\\\" : \\\"year=%Y/month=%m/day=%d\\\",\\n                \\\"projection.date.unit\\\" : \\\"DAYS\\\"\\n            }\\n            \")\n(let $11 \'(\'(\'\"partitionedby\" \'\"date\") \'(\'\"projection\" $10) \'(\'\"pathpattern\" \'\"*\") \'(\'\"pathpatternvariant\" \'\"FilePattern\")))\n(let $12 (S3ParseSettings world \'(\'((String $6) $7 (AsStruct))) (SecureParam $8) \'\"\" \'\"/logs \" \'\"json_each_row\" $9 (lambda \'($20) $7) $11))\n(let $13 (Uint32 \'0))\n(let $14 (DqStage \'((DqSource $5 $12)) (lambda \'($21) (block \'(\n  (let $22 (DqSourceWideWrap $21 $5 $9 \'(\'(\'format \'\"json_each_row\"))))\n  (return (CombineByKey (NarrowMap $22 (lambda \'($23) (AsStruct \'(\'\"message\" $23)))) (lambda \'($24) (Just $24)) (lambda \'($25) $13) (lambda \'($26 $27) (AsStruct \'(\'_yql_agg_0 (AggrCountInit (Member $27 \'\"message\"))))) (lambda \'($28 $29 $30) (AsStruct \'(\'_yql_agg_0 (AggrCountUpdate (Member $29 \'\"message\") (Member $30 \'_yql_agg_0))))) (lambda \'($31 $32) (Just $32))))\n))) \'(\'(\'\"_logical_id\" \'201354))))\n(let $15 (DqStage \'((DqCnUnionAll (TDqOutput $14 \'0))) (lambda \'($33) (block \'(\n  (let $34 (lambda \'($36) $13))\n  (let $35 (PartitionsByKeys $33 $34 (Void) (Void) (lambda \'($37) (block \'(\n    (let $38 (Condense1 $37 (lambda \'($39) (Member $39 \'_yql_agg_0)) (lambda \'($40 $41) (IsKeySwitch $40 (AsStruct \'(\'_yql_agg_0 $41)) $34 $34)) (lambda \'($42 $43) (AggrAdd (Member $42 \'_yql_agg_0) $43))))\n    (return (FlatMap $38 (lambda \'($44) (Just (AsStruct \'(\'Count0 $44))))))\n  )))))\n  (return (Condense (Take $35 (Uint64 \'\"1\")) (Nothing (OptionalType (StructType \'(\'Count0 (DataType \'Uint64))))) (lambda \'($45 $46) (Bool \'false)) (lambda \'($47 $48) (Just $47))))\n))) \'(\'(\'\"_logical_id\" \'201636))))\n(let $16 (DqStage \'((DqPhyPrecompute (DqCnValue (TDqOutput $15 \'0)))) (lambda \'($49) (FlatMap (Iterator (AsList $49)) (lambda \'($50) (Just (AsStruct \'(\'\"column0\" (Coalesce (Member $50 \'Count0) (Uint64 \'0)))))))) \'(\'(\'\"_logical_id\" \'201698))))\n(let $17 (DqStage \'((DqCnUnionAll (TDqOutput $16 \'0))) (lambda \'($51) $51) \'(\'(\'\"_logical_id\" \'201788))))\n(let $18 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"column0\"))))\n(let $19 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $17 \'0) \'()) $18 \'\"dq\"))\n(return (Commit! (Commit! $19 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-14 10:10:30,177 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5fvcligdgfhp"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115028
        nanos: 991297000
      }
      modified_at {
        seconds: 1763115028
        nanos: 991297000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115029
      nanos: 236000000
    }
    finished_at {
      seconds: 1763115029
      nanos: 664000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej5fvciob5mi6v-ptqudsej5fvcligdgfhp"
    result_expire_at {
      seconds: 1763201429
      nanos: 222863000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115028
      nanos: 991297000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n            \n            $projection =\n            @@ {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${date}\",\n                \"projection.date.type\" : \"date\",\n                \"projection.date.min\" : \"2023-01-16\",\n                \"projection.date.max\" : \"2023-01-16\",\n                \"projection.date.interval\" : \"1\",\n                \"projection.date.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.date.unit\" : \"DAYS\"\n            }\n            @@;\n            \n            SELECT\n                count(message)\n            FROM\n                `h6366390195914675958_test_no_paritioning_columnslogs2`.`/logs`\n            WITH (FORMAT=\"json_each_row\",\n                SCHEMA=(\n                `@timestamp` String,\n                `cluster` String,\n                `component` String,\n                `host` String,\n                `message` String,\n                `microseconds` Uint64,\n                `npriority` Uint32,\n                `priority` String,\n                `revision` Int32,\n                `tag` String,\n                `date` Date NOT NULL\n                ),\n                partitioned_by=(`date`),\n                projection=$projection)\n            LIMIT 10;\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":15,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"CombineByKey\"}]}},{\"Id\":13,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"PartitionsByKeys\"},{\"Name\":\"Take\"},{\"Name\":\"Condense\"}]},\"DependsOn\":[15]},{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsList\"},{\"Name\":\"Iterator\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[13]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":4,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":15,\"level\":1,\"name\":\"DqStage #15\",\"type\":\"op\"},{\"id\":13,\"level\":2,\"name\":\"DqStage #13\",\"type\":\"op\"},{\"id\":10,\"level\":3,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":4,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":5,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":15,\"target\":13},{\"source\":13,\"target\":10},{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":3,\"count\":2,\"avg\":1,\"max\":2,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.33s\",\"count\":3,\"avg\":\"0.11s\",\"max\":\"0.13s\",\"min\":\"82ms\"},\"IngressBytes\":{\"sum\":1930,\"count\":2,\"avg\":965,\"max\":965,\"min\":965},\"IngressRows\":{\"sum\":4,\"count\":2,\"avg\":2,\"max\":2,\"min\":2},\"InputBytes\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"InputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"OutputBytes\":{\"sum\":10,\"count\":3,\"avg\":3,\"max\":4,\"min\":3},\"OutputRows\":{\"sum\":3,\"count\":3,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":458752,\"count\":3,\"avg\":152917,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":3,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":3,\"avg\":0,\"max\":0,\"min\":0}},\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"40ms\",\"count\":2,\"avg\":\"20ms\",\"max\":\"38ms\",\"min\":\"2ms\"},\"InputBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":6,\"count\":2,\"avg\":3,\"max\":3,\"min\":3},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":327680,\"count\":2,\"avg\":163840,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "column0"
      type {
        type_id: UINT64
      }
    }
    rows_count: 1
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'false))\n(let $3 (DataSink \'result))\n(let $4 \'\"h6366390195914675958_test_no_paritioning_columnslogs2\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 \'\"Paths {\\n  Name: \\\"logs\\\"\\n  Children {\\n    Name: \\\"year=2023\\\"\\n    Children {\\n      Name: \\\"month=01\\\"\\n      Children {\\n        Name: \\\"day=16\\\"\\n        Children {\\n          Name: \\\"obj1.json\\\"\\n          Size: 965\\n          Read: true\\n        }\\n        Children {\\n          Name: \\\"obj2.json\\\"\\n          Size: 965\\n          Read: true\\n        }\\n        IsDirectory: true\\n      }\\n      IsDirectory: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $7 (Bool \'\"true\"))\n(let $8 \'\"cluster:default_h6366390195914675958_test_no_paritioning_columnslogs2\")\n(let $9 (StructType \'(\'\"message\" (OptionalType (DataType \'String)))))\n(let $10 \'\" {\\n                \\\"projection.enabled\\\" : \\\"true\\\",\\n                \\\"storage.location.template\\\" : \\\"/${date}\\\",\\n                \\\"projection.date.type\\\" : \\\"date\\\",\\n                \\\"projection.date.min\\\" : \\\"2023-01-16\\\",\\n                \\\"projection.date.max\\\" : \\\"2023-01-16\\\",\\n                \\\"projection.date.interval\\\" : \\\"1\\\",\\n                \\\"projection.date.format\\\" : \\\"year=%Y/month=%m/day=%d\\\",\\n                \\\"projection.date.unit\\\" : \\\"DAYS\\\"\\n            }\\n            \")\n(let $11 \'(\'(\'\"partitionedby\" \'\"date\") \'(\'\"projection\" $10) \'(\'\"pathpattern\" \'\"*\") \'(\'\"pathpatternvariant\" \'\"FilePattern\")))\n(let $12 (S3ParseSettings world \'(\'((String $6) $7 (AsStruct))) (SecureParam $8) \'\"\" \'\"/logs \" \'\"json_each_row\" $9 (lambda \'($20) $7) $11))\n(let $13 (Uint32 \'0))\n(let $14 (DqStage \'((DqSource $5 $12)) (lambda \'($21) (block \'(\n  (let $22 (DqSourceWideWrap $21 $5 $9 \'(\'(\'format \'\"json_each_row\"))))\n  (return (CombineByKey (NarrowMap $22 (lambda \'($23) (AsStruct \'(\'\"message\" $23)))) (lambda \'($24) (Just $24)) (lambda \'($25) $13) (lambda \'($26 $27) (AsStruct \'(\'_yql_agg_0 (AggrCountInit (Member $27 \'\"message\"))))) (lambda \'($28 $29 $30) (AsStruct \'(\'_yql_agg_0 (AggrCountUpdate (Member $29 \'\"message\") (Member $30 \'_yql_agg_0))))) (lambda \'($31 $32) (Just $32))))\n))) \'(\'(\'\"_logical_id\" \'201354))))\n(let $15 (DqStage \'((DqCnUnionAll (TDqOutput $14 \'0))) (lambda \'($33) (block \'(\n  (let $34 (lambda \'($36) $13))\n  (let $35 (PartitionsByKeys $33 $34 (Void) (Void) (lambda \'($37) (block \'(\n    (let $38 (Condense1 $37 (lambda \'($39) (Member $39 \'_yql_agg_0)) (lambda \'($40 $41) (IsKeySwitch $40 (AsStruct \'(\'_yql_agg_0 $41)) $34 $34)) (lambda \'($42 $43) (AggrAdd (Member $42 \'_yql_agg_0) $43))))\n    (return (FlatMap $38 (lambda \'($44) (Just (AsStruct \'(\'Count0 $44))))))\n  )))))\n  (return (Condense (Take $35 (Uint64 \'\"1\")) (Nothing (OptionalType (StructType \'(\'Count0 (DataType \'Uint64))))) (lambda \'($45 $46) (Bool \'false)) (lambda \'($47 $48) (Just $47))))\n))) \'(\'(\'\"_logical_id\" \'201636))))\n(let $16 (DqStage \'((DqPhyPrecompute (DqCnValue (TDqOutput $15 \'0)))) (lambda \'($49) (FlatMap (Iterator (AsList $49)) (lambda \'($50) (Just (AsStruct \'(\'\"column0\" (Coalesce (Member $50 \'Count0) (Uint64 \'0)))))))) \'(\'(\'\"_logical_id\" \'201698))))\n(let $17 (DqStage \'((DqCnUnionAll (TDqOutput $16 \'0))) (lambda \'($51) $51) \'(\'(\'\"_logical_id\" \'201788))))\n(let $18 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"column0\"))))\n(let $19 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $17 \'0) \'()) $18 \'\"dq\"))\n(return (Commit! (Commit! $19 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-14 10:10:30,212 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:30,213 - INFO - root - test_no_paritioning_columns: AST: (
(let $1 (Configure! world (DataSource '"config") '"DqEngine" '"force"))
(let $2 (Configure! $1 (DataSource '"s3" '"$all") '"Attr" '"useruntimelisting" 'false))
(let $3 (DataSink 'result))
(let $4 '"h6366390195914675958_test_no_paritioning_columnslogs2")
(let $5 (DataSource '"s3" $4))
(let $6 '"Paths {\n  Name: \"logs\"\n  Children {\n    Name: \"year=2023\"\n    Children {\n      Name: \"month=01\"\n      Children {\n        Name: \"day=16\"\n        Children {\n          Name: \"obj1.json\"\n          Size: 965\n          Read: true\n        }\n        Children {\n          Name: \"obj2.json\"\n          Size: 965\n          Read: true\n        }\n        IsDirectory: true\n      }\n      IsDirectory: true\n    }\n    IsDirectory: true\n  }\n  IsDirectory: true\n}\n")
(let $7 (Bool '"true"))
(let $8 '"cluster:default_h6366390195914675958_test_no_paritioning_columnslogs2")
(let $9 (StructType '('"message" (OptionalType (DataType 'String)))))
(let $10 '" {\n                \"projection.enabled\" : \"true\",\n                \"storage.location.template\" : \"/${date}\",\n                \"projection.date.type\" : \"date\",\n                \"projection.date.min\" : \"2023-01-16\",\n                \"projection.date.max\" : \"2023-01-16\",\n                \"projection.date.interval\" : \"1\",\n                \"projection.date.format\" : \"year=%Y/month=%m/day=%d\",\n                \"projection.date.unit\" : \"DAYS\"\n            }\n            ")
(let $11 '('('"partitionedby" '"date") '('"projection" $10) '('"pathpattern" '"*") '('"pathpatternvariant" '"FilePattern")))
(let $12 (S3ParseSettings world '('((String $6) $7 (AsStruct))) (SecureParam $8) '"" '"/logs " '"json_each_row" $9 (lambda '($20) $7) $11))
(let $13 (Uint32 '0))
(let $14 (DqStage '((DqSource $5 $12)) (lambda '($21) (block '(
  (let $22 (DqSourceWideWrap $21 $5 $9 '('('format '"json_each_row"))))
  (return (CombineByKey (NarrowMap $22 (lambda '($23) (AsStruct '('"message" $23)))) (lambda '($24) (Just $24)) (lambda '($25) $13) (lambda '($26 $27) (AsStruct '('_yql_agg_0 (AggrCountInit (Member $27 '"message"))))) (lambda '($28 $29 $30) (AsStruct '('_yql_agg_0 (AggrCountUpdate (Member $29 '"message") (Member $30 '_yql_agg_0))))) (lambda '($31 $32) (Just $32))))
))) '('('"_logical_id" '201354))))
(let $15 (DqStage '((DqCnUnionAll (TDqOutput $14 '0))) (lambda '($33) (block '(
  (let $34 (lambda '($36) $13))
  (let $35 (PartitionsByKeys $33 $34 (Void) (Void) (lambda '($37) (block '(
    (let $38 (Condense1 $37 (lambda '($39) (Member $39 '_yql_agg_0)) (lambda '($40 $41) (IsKeySwitch $40 (AsStruct '('_yql_agg_0 $41)) $34 $34)) (lambda '($42 $43) (AggrAdd (Member $42 '_yql_agg_0) $43))))
    (return (FlatMap $38 (lambda '($44) (Just (AsStruct '('Count0 $44))))))
  )))))
  (return (Condense (Take $35 (Uint64 '"1")) (Nothing (OptionalType (StructType '('Count0 (DataType 'Uint64))))) (lambda '($45 $46) (Bool 'false)) (lambda '($47 $48) (Just $47))))
))) '('('"_logical_id" '201636))))
(let $16 (DqStage '((DqPhyPrecompute (DqCnValue (TDqOutput $15 '0)))) (lambda '($49) (FlatMap (Iterator (AsList $49)) (lambda '($50) (Just (AsStruct '('"column0" (Coalesce (Member $50 'Count0) (Uint64 '0)))))))) '('('"_logical_id" '201698))))
(let $17 (DqStage '((DqCnUnionAll (TDqOutput $16 '0))) (lambda '($51) $51) '('('"_logical_id" '201788))))
(let $18 '('('type) '('autoref) '('columns '('"column0"))))
(let $19 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $17 '0) '()) $18 '"dq"))
(return (Commit! (Commit! $19 $3) (DataSink '"s3" $4)))
)

2025-11-14 10:10:30,250 - DEBUG - root - test_no_paritioning_columns: columns {
  name: "column0"
  type {
    type_id: UINT64
  }
}
rows {
  items {
    uint64_value: 4
  }
}

2025-11-14 10:10:30,262 - INFO - ya.test - pytest_runtest_teardown: Test teardown
