2025-11-14 10:13:31,558 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:13:31,559 - INFO - ya.test - pytest_runtest_setup: test_huge_source[v1-false-client0]
2025-11-14 10:13:31,559 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:13:31,560 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-14 10:13:31,675 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_s3_1.py::TestS3, test_name: test_huge_source[v1-false-client0])
2025-11-14 10:13:31,676 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f9106a18890>
2025-11-14 10:13:31,678 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f9106b24590>
2025-11-14 10:13:31,678 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f90e9b77ad0>
2025-11-14 10:13:31,679 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f9106b24290>
2025-11-14 10:13:31,682 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:13:31,686 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:13:31,687 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:13:31,688 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-14 10:13:31,690 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-14 10:13:31,691 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-14 10:13:31,693 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f90e9b75b50>
2025-11-14 10:13:31,694 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'hbucket', 'ACL': 'public-read'}
2025-11-14 10:13:31,695 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f9106a1a750>
2025-11-14 10:13:31,695 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f9106a3d010>
2025-11-14 10:13:31,695 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,695 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f9106a1a510>
2025-11-14 10:13:31,696 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f9106a3d250>
2025-11-14 10:13:31,696 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,696 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'hbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:28975', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:13:31,698 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:28975/hbucket
2025-11-14 10:13:31,698 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:13:31,698 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:13:31,699 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f9106a1abd0>
2025-11-14 10:13:31,700 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f9106a18ad0>
2025-11-14 10:13:31,700 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f9106a3c650>
2025-11-14 10:13:31,701 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/hbucket/', 'url': 'http://localhost:28975/hbucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f90e9d8ac70>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'hbucket', 'params': {'Bucket': 'hbucket', 'ACL': 'public-read'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:13:31,702 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f90e9d89b40>>
2025-11-14 10:13:31,702 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f90e9be40b0>>
2025-11-14 10:13:31,703 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f9106a1a390>
2025-11-14 10:13:31,703 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f9106a3d190>
2025-11-14 10:13:31,704 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:13:31,704 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/hbucket

host:localhost:28975
x-amz-acl:public-read
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101331Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:13:31,704 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101331Z
20251114/yandex/s3/aws4_request
cd654061ab9ee7855d1fb0c53765927385742999dd863c68b0b9242885bde18c
2025-11-14 10:13:31,705 - DEBUG - botocore.auth - add_auth: Signature:
f0b3ef59a974f802465ad9534c89a6ab36db73f09949a75a5981b287328d114f
2025-11-14 10:13:31,705 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f9106a3cf50>
2025-11-14 10:13:31,706 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:28975/hbucket, headers={'x-amz-acl': b'public-read', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101331Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=f0b3ef59a974f802465ad9534c89a6ab36db73f09949a75a5981b287328d114f', 'amz-sdk-invocation-id': b'142e3026-2332-42ba-a0d8-bc167cf9db6e', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-14 10:13:31,720 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:13:31 GMT', 'x-amzn-requestid': 'MXjfkyPE1DopZzs07GPckH1lpGg877cC2DwKve2MMHBa5tY9EhHq', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '161', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:13:31,720 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>hbucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-14 10:13:31,721 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f90ecb22ef0>
2025-11-14 10:13:31,721 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:13:31,722 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,722 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'MXjfkyPE1DopZzs07GPckH1lpGg877cC2DwKve2MMHBa5tY9EhHq', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:13:31 GMT', 'x-amzn-requestid': 'MXjfkyPE1DopZzs07GPckH1lpGg877cC2DwKve2MMHBa5tY9EhHq', 'content-type': 'text/html; charset=utf-8', 'content-length': '161', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-14 10:13:31,722 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'hbucket'}
2025-11-14 10:13:31,723 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7f9106a3c050>
2025-11-14 10:13:31,723 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7f9106a1a750>
2025-11-14 10:13:31,724 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f9106a3d010>
2025-11-14 10:13:31,724 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,724 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7f9106a1a510>
2025-11-14 10:13:31,724 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f9106a3d250>
2025-11-14 10:13:31,725 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,725 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'hbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:28975', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:13:31,726 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:28975/hbucket
2025-11-14 10:13:31,726 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:13:31,726 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:13:31,727 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7f9106a1abd0>
2025-11-14 10:13:31,727 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7f9106a18ad0>
2025-11-14 10:13:31,727 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7f9106a3c650>
2025-11-14 10:13:31,728 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/hbucket/', 'url': 'http://localhost:28975/hbucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f90e9d8ac70>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'hbucket', 'params': {'Bucket': 'hbucket', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:13:31,729 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f90e9d89b40>>
2025-11-14 10:13:31,729 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f90e9be40b0>>
2025-11-14 10:13:31,730 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7f9106a1a390>
2025-11-14 10:13:31,731 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7f9106a3d190>
2025-11-14 10:13:31,732 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:13:31,732 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/hbucket
encoding-type=url
host:localhost:28975
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101331Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:13:31,733 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101331Z
20251114/yandex/s3/aws4_request
bb2bc7a320e8b317a95f2cc244568188a09259c266d1a45005b842591bc38d84
2025-11-14 10:13:31,733 - DEBUG - botocore.auth - add_auth: Signature:
43f79842528781532449011927031cfc7c80ca9a0247e270461fd788f0171076
2025-11-14 10:13:31,733 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7f9106a3cf50>
2025-11-14 10:13:31,734 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:28975/hbucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101331Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=43f79842528781532449011927031cfc7c80ca9a0247e270461fd788f0171076', 'amz-sdk-invocation-id': b'0a8818f7-4ae4-4cff-ad6f-e320eaaedd3f', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:13:31,747 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:13:31 GMT', 'x-amzn-requestid': 'hjgLU8KY4i6fDBUGmApqDN1PcLXLhCT1Rfek9IdbPsg7q3OYcDdv', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '616', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:13:31,747 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>hbucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>path/ptjudsej044u7gktc6kj_0_h6DqTpW7b0ORwvzQVafKVuW9mbfOFpyw.csv</Key><LastModified>2025-11-14T10:13:29.000Z</LastModified><ETag>&#34;e1bfc9419aaf313da73a28e038f5a84e-2&#34;</ETag><Size>10516484</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-14 10:13:31,749 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f90ecb22ef0>
2025-11-14 10:13:31,750 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:13:31,750 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,751 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7f9106a3c110>
2025-11-14 10:13:31,751 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-14 10:13:31,752 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-14 10:13:31,753 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7f90e9b77410>
2025-11-14 10:13:31,754 - DEBUG - boto3.resources.action - __call__: Calling s3:delete_objects with {'Bucket': 'hbucket', 'Delete': {'Objects': [{'Key': 'path/ptjudsej044u7gktc6kj_0_h6DqTpW7b0ORwvzQVafKVuW9mbfOFpyw.csv'}]}}
2025-11-14 10:13:31,755 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function validate_bucket_name at 0x7f9106a1a750>
2025-11-14 10:13:31,755 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f9106a3d010>
2025-11-14 10:13:31,756 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,756 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function generate_idempotent_uuid at 0x7f9106a1a510>
2025-11-14 10:13:31,756 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f9106a3d250>
2025-11-14 10:13:31,756 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,757 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'hbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:28975', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:13:31,757 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:28975/hbucket
2025-11-14 10:13:31,757 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:13:31,758 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:13:31,759 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function escape_xml_payload at 0x7f9106a1a150>
2025-11-14 10:13:31,759 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_expect_header at 0x7f9106a1abd0>
2025-11-14 10:13:31,760 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_recursion_detection_header at 0x7f9106a18ad0>
2025-11-14 10:13:31,760 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function inject_api_version_header_if_needed at 0x7f9106a3c650>
2025-11-14 10:13:31,760 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=DeleteObjects) with params: {'url_path': '?delete', 'query_string': {}, 'method': 'POST', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'Content-MD5': '4a2iIQwc6/kyIz8vyqc9aA=='}, 'body': b'<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Object><Key>path/ptjudsej044u7gktc6kj_0_h6DqTpW7b0ORwvzQVafKVuW9mbfOFpyw.csv</Key></Object></Delete>', 'auth_path': '/hbucket/', 'url': 'http://localhost:28975/hbucket?delete', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f90e9d8ac70>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'hbucket', 'params': {'Bucket': 'hbucket', 'Delete': {'Objects': [{'Key': 'path/ptjudsej044u7gktc6kj_0_h6DqTpW7b0ORwvzQVafKVuW9mbfOFpyw.csv'}]}}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'checksum': {'request_algorithm': 'conditional-md5'}}}
2025-11-14 10:13:31,761 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f90e9d89b40>>
2025-11-14 10:13:31,762 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f90e9be40b0>>
2025-11-14 10:13:31,762 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <function set_operation_specific_signer at 0x7f9106a1a390>
2025-11-14 10:13:31,763 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <function remove_arn_from_signing_path at 0x7f9106a3d190>
2025-11-14 10:13:31,763 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:13:31,765 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
POST
/hbucket
delete=
content-md5:4a2iIQwc6/kyIz8vyqc9aA==
host:localhost:28975
x-amz-content-sha256:9417795eb2f7f138b45bc4857e82245169ff8ab218fe69e87df2f7b5b2d4ac6d
x-amz-date:20251114T101331Z

content-md5;host;x-amz-content-sha256;x-amz-date
9417795eb2f7f138b45bc4857e82245169ff8ab218fe69e87df2f7b5b2d4ac6d
2025-11-14 10:13:31,765 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101331Z
20251114/yandex/s3/aws4_request
2e1d491edeba92bf5b882bf4366aaf44d1702f4a7ae869ec36b8051957c95040
2025-11-14 10:13:31,765 - DEBUG - botocore.auth - add_auth: Signature:
60f5f8dd44587c74a98202ef36ec204ba32ab733e3e453f757c225615fa1a9a8
2025-11-14 10:13:31,766 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <function add_retry_headers at 0x7f9106a3cf50>
2025-11-14 10:13:31,767 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=http://localhost:28975/hbucket?delete, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'Content-MD5': b'4a2iIQwc6/kyIz8vyqc9aA==', 'X-Amz-Date': b'20251114T101331Z', 'X-Amz-Content-SHA256': b'9417795eb2f7f138b45bc4857e82245169ff8ab218fe69e87df2f7b5b2d4ac6d', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=60f5f8dd44587c74a98202ef36ec204ba32ab733e3e453f757c225615fa1a9a8', 'amz-sdk-invocation-id': b'95a8f7d3-2d89-46f7-8f9b-d80eef5e64fc', 'amz-sdk-request': b'attempt=1', 'Content-Length': '157'}>
2025-11-14 10:13:31,782 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:13:31 GMT', 'x-amzn-requestid': 'v8pOSKFl2ZedfJFt9TxbPxTRN9kjiTEvLDODXc9DsJ1XiaypLimX', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '208', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:13:31,783 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><DeleteResult xmlns="http://s3.amazonaws.com/doc/2006-03-01"><Deleted><Key>path/ptjudsej044u7gktc6kj_0_h6DqTpW7b0ORwvzQVafKVuW9mbfOFpyw.csv</Key></Deleted></DeleteResult>'
2025-11-14 10:13:31,785 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f90ecb22ef0>
2025-11-14 10:13:31,785 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:13:31,786 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f90ecb23760>>
2025-11-14 10:13:31,786 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'v8pOSKFl2ZedfJFt9TxbPxTRN9kjiTEvLDODXc9DsJ1XiaypLimX', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:13:31 GMT', 'x-amzn-requestid': 'v8pOSKFl2ZedfJFt9TxbPxTRN9kjiTEvLDODXc9DsJ1XiaypLimX', 'content-type': 'text/html; charset=utf-8', 'content-length': '208', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'Deleted': [{'Key': 'path/ptjudsej044u7gktc6kj_0_h6DqTpW7b0ORwvzQVafKVuW9mbfOFpyw.csv'}]}
2025-11-14 10:13:31,787 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:13:31,842 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:13:31,882 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            insert into `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names)\n            select * from AS_TABLE(ListReplicate(<|s:\"****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************\"u|>, 1024 * 10));\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "b9e62797-a4ba-4d61-bd67-1b2b069026eb"

2025-11-14 10:13:31,939 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej01h3op71g742"

2025-11-14 10:13:31,958 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej01h3op71g742"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115211
        nanos: 911380000
      }
      modified_at {
        seconds: 1763115211
        nanos: 911380000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej01h3n7hnq66t-ptqudsej01h3op71g742"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115211
      nanos: 911380000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            insert into `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names)\n            select * from AS_TABLE(ListReplicate(<|s:\"****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************\"u|>, 1024 * 10));\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:13:32,476 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej01h3op71g742"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115211
        nanos: 911380000
      }
      modified_at {
        seconds: 1763115211
        nanos: 911380000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115212
      nanos: 82000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej01h3n7hnq66t-ptqudsej01h3op71g742"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115211
      nanos: 911380000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            insert into `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names)\n            select * from AS_TABLE(ListReplicate(<|s:\"****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************\"u|>, 1024 * 10));\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"Replicate\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 5
        column: 13
      }
      message: "At function: RemoveSystemMembers, At function: PersistableRepr, At function: OrderedSqlProject"
      end_position {
        row: 5
        column: 13
      }
      severity: 2
      issues {
        position {
          row: 5
          column: 1092
        }
        message: "At function: ToList"
        end_position {
          row: 5
          column: 1092
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 36
          }
          message: "At function: Replicate"
          end_position {
            row: 5
            column: 36
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 1090
            }
            message: "Failed to convert, type diff: Int32!=Uint64"
            end_position {
              row: 5
              column: 1090
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 1090
              }
              message: "Consider using explicit CAST or BITCAST to convert from Int32 to Uint64"
              end_position {
                row: 5
                column: 1090
              }
              issue_code: 1107
              severity: 2
            }
          }
        }
      }
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'\"false\"))\n(let $3 (DataSink \'\"s3\" \'\"h8827690992310523674_test_huge_sourcehugebucket\"))\n(let $4 (S3SinkSettings \'\"path/\" \'(\'(\'\"multipart\" \'\"true\")) (SecureParam \'\"cluster:default_h8827690992310523674_test_huge_sourcehugebucket\") \'\".csv\" (StructType \'(\'\"s\" (DataType \'Utf8)))))\n(return (Commit! (DqQuery! $2 \'((DqStage \'() (lambda \'() (block \'(\n  (let $5 \'\"****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************\")\n  (let $6 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput (ToFlow (Replicate (AsStruct \'(\'\"s\" (Utf8 $5))) (Convert (* (Int32 \'\"1024\") (Int32 \'\"10\")) (DataType \'Uint64)))) \'\"csv_with_names\" \'() $6))\n))) \'() \'((DqSink \'0 $3 $4))))) $3))\n)\n"
  }
}

2025-11-14 10:13:32,998 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej01h3op71g742"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115211
        nanos: 911380000
      }
      modified_at {
        seconds: 1763115211
        nanos: 911380000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115212
      nanos: 82000000
    }
    finished_at {
      seconds: 1763115212
      nanos: 617000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej01h3n7hnq66t-ptqudsej01h3op71g742"
    result_expire_at {
      seconds: 1763201612
      nanos: 71497000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115211
      nanos: 911380000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            insert into `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names)\n            select * from AS_TABLE(ListReplicate(<|s:\"****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************\"u|>, 1024 * 10));\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"Replicate\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 5
        column: 13
      }
      message: "At function: RemoveSystemMembers, At function: PersistableRepr, At function: OrderedSqlProject"
      end_position {
        row: 5
        column: 13
      }
      severity: 2
      issues {
        position {
          row: 5
          column: 1092
        }
        message: "At function: ToList"
        end_position {
          row: 5
          column: 1092
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 36
          }
          message: "At function: Replicate"
          end_position {
            row: 5
            column: 36
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 1090
            }
            message: "Failed to convert, type diff: Int32!=Uint64"
            end_position {
              row: 5
              column: 1090
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 1090
              }
              message: "Consider using explicit CAST or BITCAST to convert from Int32 to Uint64"
              end_position {
                row: 5
                column: 1090
              }
              issue_code: 1107
              severity: 2
            }
          }
        }
      }
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.14s\",\"count\":1,\"avg\":\"0.14s\",\"max\":\"0.14s\",\"min\":\"0.14s\"},\"EgressBytes\":{\"sum\":10516484,\"count\":1,\"avg\":10516484,\"max\":10516484,\"min\":10516484},\"EgressRows\":{\"sum\":12,\"count\":1,\"avg\":12,\"max\":12,\"min\":12},\"MaxMemoryUsage\":{\"sum\":1240080,\"count\":1,\"avg\":1240080,\"max\":1240080,\"min\":1240080},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'\"false\"))\n(let $3 (DataSink \'\"s3\" \'\"h8827690992310523674_test_huge_sourcehugebucket\"))\n(let $4 (S3SinkSettings \'\"path/\" \'(\'(\'\"multipart\" \'\"true\")) (SecureParam \'\"cluster:default_h8827690992310523674_test_huge_sourcehugebucket\") \'\".csv\" (StructType \'(\'\"s\" (DataType \'Utf8)))))\n(return (Commit! (DqQuery! $2 \'((DqStage \'() (lambda \'() (block \'(\n  (let $5 \'\"****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************\")\n  (let $6 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput (ToFlow (Replicate (AsStruct \'(\'\"s\" (Utf8 $5))) (Convert (* (Int32 \'\"1024\") (Int32 \'\"10\")) (DataType \'Uint64)))) \'\"csv_with_names\" \'() $6))\n))) \'() \'((DqSink \'0 $3 $4))))) $3))\n)\n"
  }
}

2025-11-14 10:13:33,008 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            select count(*) from `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names, schema(\n                s String NOT NULL\n            ))\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "b69e42c3-b711-4137-997a-a735c51edd4d"

2025-11-14 10:13:33,059 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej00f60poctmvu"

2025-11-14 10:13:33,086 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej00f60poctmvu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115213
        nanos: 23196000
      }
      modified_at {
        seconds: 1763115213
        nanos: 23196000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej00f5un8mrhti-ptqudsej00f60poctmvu"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115213
      nanos: 23196000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            select count(*) from `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names, schema(\n                s String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:13:33,621 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej00f60poctmvu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115213
        nanos: 23196000
      }
      modified_at {
        seconds: 1763115213
        nanos: 23196000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115213
      nanos: 114000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej00f5un8mrhti-ptqudsej00f60poctmvu"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115213
      nanos: 23196000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            select count(*) from `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names, schema(\n                s String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:13:34,138 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:13:34,657 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej00f60poctmvu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115213
        nanos: 23196000
      }
      modified_at {
        seconds: 1763115213
        nanos: 23196000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115213
      nanos: 114000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej00f5un8mrhti-ptqudsej00f60poctmvu"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115213
      nanos: 23196000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            select count(*) from `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names, schema(\n                s String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":2,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
}

2025-11-14 10:13:35,170 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej00f60poctmvu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115213
        nanos: 23196000
      }
      modified_at {
        seconds: 1763115213
        nanos: 23196000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115213
      nanos: 114000000
    }
    finished_at {
      seconds: 1763115215
      nanos: 86000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej00f5un8mrhti-ptqudsej00f60poctmvu"
    result_expire_at {
      seconds: 1763201613
      nanos: 76898000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115213
      nanos: 23196000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"false\";\n\n            select count(*) from `h8827690992310523674_test_huge_sourcehugebucket`.`path/` with (format=csv_with_names, schema(\n                s String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":15,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"DqPhyLength\"}]}},{\"Id\":13,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"Condense\"}]},\"DependsOn\":[15]},{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsList\"},{\"Name\":\"Iterator\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[13]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":4,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":15,\"level\":1,\"name\":\"DqStage #15\",\"type\":\"op\"},{\"id\":13,\"level\":2,\"name\":\"DqStage #13\",\"type\":\"op\"},{\"id\":10,\"level\":3,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":4,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":5,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":15,\"target\":13},{\"source\":13,\"target\":10},{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.13s\",\"count\":2,\"avg\":\"66ms\",\"max\":\"75ms\",\"min\":\"57ms\"},\"IngressBytes\":{\"sum\":10516484,\"count\":1,\"avg\":10516484,\"max\":10516484,\"min\":10516484},\"IngressRows\":{\"sum\":10240,\"count\":1,\"avg\":10240,\"max\":10240,\"min\":10240},\"InputBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":8,\"count\":2,\"avg\":4,\"max\":4,\"min\":4},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":327680,\"count\":2,\"avg\":163840,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}},\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"28ms\",\"count\":2,\"avg\":\"14ms\",\"max\":\"25ms\",\"min\":\"2ms\"},\"InputBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":8,\"count\":2,\"avg\":4,\"max\":4,\"min\":4},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":327680,\"count\":2,\"avg\":163840,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "column0"
      type {
        type_id: UINT64
      }
    }
    rows_count: 1
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'false))\n(let $3 (DataSink \'result))\n(let $4 \'\"h8827690992310523674_test_huge_sourcehugebucket\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 \'\"Paths {\\n  Name: \\\"path\\\"\\n  Children {\\n    Name: \\\"ptjudsej01h3n7hnq66t_0_aT3vdONiBEqqs7NgD3rWRTg8kc5FtBIj.csv\\\"\\n    Size: 10516484\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $7 (Bool \'\"true\"))\n(let $8 (S3ParseSettings world \'(\'((String $6) $7 (AsStruct))) (SecureParam \'\"cluster:default_h8827690992310523674_test_huge_sourcehugebucket\") \'\"\" \'\"path/ \" \'\"csv_with_names\" (StructType \'(\'\"s\" (DataType \'String))) (lambda \'($15) $7) \'()))\n(let $9 (DqStage \'((DqSource $5 $8)) (lambda \'($16) (block \'(\n  (let $17 (DqSourceWideWrap $16 $5 (StructType) \'(\'(\'format \'\"csv_with_names\"))))\n  (return (DqPhyLength (NarrowMap $17 (lambda \'() (AsStruct))) \'\"_dq_agg_cnt\"))\n))) \'(\'(\'\"_logical_id\" \'200372))))\n(let $10 (DqStage \'((DqCnUnionAll (TDqOutput $9 \'\"0\"))) (lambda \'($18) (Condense $18 (Uint64 \'\"0\") (lambda \'($19 $20) (Bool \'false)) (lambda \'($21 $22) (AggrAdd $22 (Member $21 \'\"_dq_agg_cnt\"))))) \'(\'(\'\"_logical_id\" \'200397))))\n(let $11 (DqStage \'((DqPhyPrecompute (DqCnValue (TDqOutput $10 \'\"0\")))) (lambda \'($23) (FlatMap (Iterator (AsList $23)) (lambda \'($24) (Just (AsStruct \'(\'\"column0\" $24)))))) \'(\'(\'\"_logical_id\" \'200445))))\n(let $12 (DqStage \'((DqCnUnionAll (TDqOutput $11 \'\"0\"))) (lambda \'($25) $25) \'(\'(\'\"_logical_id\" \'200525))))\n(let $13 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"column0\"))))\n(let $14 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $12 \'\"0\") \'()) $13 \'\"dq\"))\n(return (Commit! (Commit! $14 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-14 10:13:35,190 - DEBUG - root - test_huge_source: columns {
  name: "column0"
  type {
    type_id: UINT64
  }
}
rows {
  items {
    uint64_value: 10240
  }
}

2025-11-14 10:13:35,196 - INFO - ya.test - pytest_runtest_teardown: Test teardown
