2025-11-14 10:09:36,539 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:09:36,540 - INFO - ya.test - pytest_runtest_setup: test_csv[v1-true-client0]
2025-11-14 10:09:36,540 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:09:36,540 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-14 10:09:36,833 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_s3_0.py::TestS3, test_name: test_csv[v1-true-client0])
2025-11-14 10:09:36,835 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f2f1bb28890>
2025-11-14 10:09:36,838 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f2f1bc34590>
2025-11-14 10:09:36,839 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f2f1adea810>
2025-11-14 10:09:36,839 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f2f1bc34290>
2025-11-14 10:09:36,843 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:09:36,847 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:09:36,848 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:09:36,849 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-14 10:09:36,850 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-14 10:09:36,850 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-14 10:09:36,852 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f2f1adeb290>
2025-11-14 10:09:36,852 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'fbucket', 'ACL': 'public-read'}
2025-11-14 10:09:36,853 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:09:36,853 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:09:36,853 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,853 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:09:36,854 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:09:36,854 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,854 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:09:36,856 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/fbucket
2025-11-14 10:09:36,856 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:09:36,856 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:09:36,857 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:09:36,857 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:09:36,857 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:09:36,857 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/fbucket/', 'url': 'http://localhost:12406/fbucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2f03dc75d0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'ACL': 'public-read'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:09:36,859 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2f03dc7cb0>>
2025-11-14 10:09:36,859 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2f1a64c240>>
2025-11-14 10:09:36,859 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:09:36,860 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:09:36,861 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:09:36,861 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/fbucket

host:localhost:12406
x-amz-acl:public-read
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T100936Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:09:36,861 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T100936Z
20251114/yandex/s3/aws4_request
1f76080d96e0fc9e6b33511627bee73b78600e1c92384b97de668df28ec26fb1
2025-11-14 10:09:36,861 - DEBUG - botocore.auth - add_auth: Signature:
cda0b18c68ae1e8d33c801c9fff7215dbca9db66b67a4d9ef1bddf78ff458774
2025-11-14 10:09:36,862 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:09:36,862 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:12406/fbucket, headers={'x-amz-acl': b'public-read', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T100936Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=cda0b18c68ae1e8d33c801c9fff7215dbca9db66b67a4d9ef1bddf78ff458774', 'amz-sdk-invocation-id': b'785323c9-b95e-423f-b34a-e5b1f912c05f', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-14 10:09:36,915 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:09:36 GMT', 'x-amzn-requestid': 'ZoWxJFNXMRXxkE7ruVMlWU58epkFwfYS7zQTeoSRXpGaNBdi1YJT', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '161', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:09:36,915 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>fbucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-14 10:09:36,916 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2f1a8dee00>
2025-11-14 10:09:36,916 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:09:36,917 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,917 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'ZoWxJFNXMRXxkE7ruVMlWU58epkFwfYS7zQTeoSRXpGaNBdi1YJT', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:09:36 GMT', 'x-amzn-requestid': 'ZoWxJFNXMRXxkE7ruVMlWU58epkFwfYS7zQTeoSRXpGaNBdi1YJT', 'content-type': 'text/html; charset=utf-8', 'content-length': '161', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-14 10:09:36,918 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'fbucket'}
2025-11-14 10:09:36,919 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7f2f1bb4c050>
2025-11-14 10:09:36,919 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:09:36,919 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:09:36,919 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,919 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:09:36,920 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:09:36,920 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,920 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:09:36,921 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/fbucket
2025-11-14 10:09:36,921 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:09:36,926 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:09:36,927 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:09:36,927 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:09:36,928 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:09:36,928 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/fbucket/', 'url': 'http://localhost:12406/fbucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2f03dc75d0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:09:36,929 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2f03dc7cb0>>
2025-11-14 10:09:36,929 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2f1a64c240>>
2025-11-14 10:09:36,929 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:09:36,930 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:09:36,930 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:09:36,931 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/fbucket
encoding-type=url
host:localhost:12406
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T100936Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:09:36,931 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T100936Z
20251114/yandex/s3/aws4_request
c81b902495056f2690d9cbd98780a92b47b3a2e0f55b01d63567ae02e5b0dd10
2025-11-14 10:09:36,931 - DEBUG - botocore.auth - add_auth: Signature:
dc8d74cb37f2c960aecf25e286fd1ceca3bdb7d67ccdbba9cf770ac8fc28d37a
2025-11-14 10:09:36,931 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:09:36,932 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:12406/fbucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T100936Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=dc8d74cb37f2c960aecf25e286fd1ceca3bdb7d67ccdbba9cf770ac8fc28d37a', 'amz-sdk-invocation-id': b'bc48a35c-a34b-45c7-addb-df335d57383a', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:09:36,941 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:09:36 GMT', 'x-amzn-requestid': 'GDRMRKdD0IDlvogq8vnUurWWQqHBp6ErGXxokzQhVAY6Dtu3GSWK', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '554', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:09:36,942 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>fbucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>fruits.csv</Key><LastModified>2025-11-14T10:09:33.000Z</LastModified><ETag>&#34;b3296e34788601350ffb9fce7c9b2672&#34;</ETag><Size>53</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-14 10:09:36,945 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2f1a8dee00>
2025-11-14 10:09:36,945 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:09:36,946 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,946 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7f2f1bb4c110>
2025-11-14 10:09:36,947 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-14 10:09:36,947 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-14 10:09:36,949 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7f2f1adeb410>
2025-11-14 10:09:36,950 - DEBUG - boto3.resources.action - __call__: Calling s3:delete_objects with {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'fruits.csv'}]}}
2025-11-14 10:09:36,951 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:09:36,951 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:09:36,952 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,952 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:09:36,953 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:09:36,953 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,955 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:09:36,955 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/fbucket
2025-11-14 10:09:36,955 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:09:36,956 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:09:36,957 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function escape_xml_payload at 0x7f2f1bb2a150>
2025-11-14 10:09:36,958 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:09:36,958 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:09:36,958 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:09:36,959 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=DeleteObjects) with params: {'url_path': '?delete', 'query_string': {}, 'method': 'POST', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'Content-MD5': 'qhYwzsEvymlDQ0qxfrex2g=='}, 'body': b'<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Object><Key>fruits.csv</Key></Object></Delete>', 'auth_path': '/fbucket/', 'url': 'http://localhost:12406/fbucket?delete', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2f03dc75d0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Bucket': 'fbucket', 'Delete': {'Objects': [{'Key': 'fruits.csv'}]}}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'checksum': {'request_algorithm': 'conditional-md5'}}}
2025-11-14 10:09:36,960 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2f03dc7cb0>>
2025-11-14 10:09:36,960 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2f1a64c240>>
2025-11-14 10:09:36,961 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:09:36,961 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:09:36,962 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:09:36,962 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
POST
/fbucket
delete=
content-md5:qhYwzsEvymlDQ0qxfrex2g==
host:localhost:12406
x-amz-content-sha256:c1e075aa57263477fc032bb83fe20baad49e1b1d446bac947bae3aca35a1d621
x-amz-date:20251114T100936Z

content-md5;host;x-amz-content-sha256;x-amz-date
c1e075aa57263477fc032bb83fe20baad49e1b1d446bac947bae3aca35a1d621
2025-11-14 10:09:36,963 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T100936Z
20251114/yandex/s3/aws4_request
bc52699e96418c69eef2a08ddfcdddedd077a74b8e0084467b00a22286f8b1ff
2025-11-14 10:09:36,963 - DEBUG - botocore.auth - add_auth: Signature:
6565c5cef20a7b9f1d71f85f3cd4899b4f0a5d3d73f55c15ab4c72e1f46acabc
2025-11-14 10:09:36,964 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:09:36,964 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=http://localhost:12406/fbucket?delete, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'Content-MD5': b'qhYwzsEvymlDQ0qxfrex2g==', 'X-Amz-Date': b'20251114T100936Z', 'X-Amz-Content-SHA256': b'c1e075aa57263477fc032bb83fe20baad49e1b1d446bac947bae3aca35a1d621', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=6565c5cef20a7b9f1d71f85f3cd4899b4f0a5d3d73f55c15ab4c72e1f46acabc', 'amz-sdk-invocation-id': b'75142c8e-e57a-425d-803c-fc79c6ac276f', 'amz-sdk-request': b'attempt=1', 'Content-Length': '103'}>
2025-11-14 10:09:36,981 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:09:36 GMT', 'x-amzn-requestid': 'puoQw2krvcdrnj3ZfIRkktDLkgZcBHfFElaFIP5eNxpMFDbLXpA0', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '154', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:09:36,982 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><DeleteResult xmlns="http://s3.amazonaws.com/doc/2006-03-01"><Deleted><Key>fruits.csv</Key></Deleted></DeleteResult>'
2025-11-14 10:09:36,983 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2f1a8dee00>
2025-11-14 10:09:36,983 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:09:36,984 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f1aa58b50>>
2025-11-14 10:09:36,984 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'puoQw2krvcdrnj3ZfIRkktDLkgZcBHfFElaFIP5eNxpMFDbLXpA0', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:09:36 GMT', 'x-amzn-requestid': 'puoQw2krvcdrnj3ZfIRkktDLkgZcBHfFElaFIP5eNxpMFDbLXpA0', 'content-type': 'text/html; charset=utf-8', 'content-length': '154', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'Deleted': [{'Key': 'fruits.csv'}]}
2025-11-14 10:09:36,985 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f2f1bb28890>
2025-11-14 10:09:36,988 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f2f1bc34590>
2025-11-14 10:09:36,988 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f2f1adea810>
2025-11-14 10:09:36,989 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f2f1bc34290>
2025-11-14 10:09:36,994 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:09:37,001 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:09:37,002 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:09:37,005 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f2f1bb2b7d0>
2025-11-14 10:09:37,005 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f2f1bb2a810>
2025-11-14 10:09:37,005 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f2f1bb4c4d0>
2025-11-14 10:09:37,005 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:09:37,006 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:09:37,006 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2eff7a3990>>
2025-11-14 10:09:37,006 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:09:37,007 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:09:37,007 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2eff7a3990>>
2025-11-14 10:09:37,007 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'fbucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:09:37,009 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/fbucket
2025-11-14 10:09:37,009 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:09:37,009 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:09:37,012 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_md5 at 0x7f2f1bd3f710>
2025-11-14 10:09:37,013 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:09:37,013 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-14 10:09:37,013 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:09:37,013 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:09:37,014 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/fruits.csv', 'query_string': {}, 'method': 'PUT', 'headers': {'Content-Type': 'text/plain', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': 'syluNHiGATUP+5/OfJsmcg==', 'Expect': '100-continue'}, 'body': <_io.BytesIO object at 0x7f2efed8ff50>, 'auth_path': '/fbucket/fruits.csv', 'url': 'http://localhost:12406/fbucket/fruits.csv', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2efea76ef0>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'fbucket', 'params': {'Body': <_io.BytesIO object at 0x7f2efed8ff50>, 'Bucket': 'fbucket', 'Key': 'fruits.csv', 'ContentType': 'text/plain'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:09:37,015 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2f1aa11410>>
2025-11-14 10:09:37,015 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2f1aaead10>>
2025-11-14 10:09:37,015 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:09:37,016 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:09:37,019 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:09:37,019 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/fbucket/fruits.csv

content-md5:syluNHiGATUP+5/OfJsmcg==
content-type:text/plain
host:localhost:12406
x-amz-content-sha256:be1c1c4a83c407c74f1385ef6ac12822772856cf51582ff70769720688989a00
x-amz-date:20251114T100937Z

content-md5;content-type;host;x-amz-content-sha256;x-amz-date
be1c1c4a83c407c74f1385ef6ac12822772856cf51582ff70769720688989a00
2025-11-14 10:09:37,019 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T100937Z
20251114/yandex/s3/aws4_request
bf63db5e913f76012d05e75f2dda2dc4f675e58ba55177fbe3c19130b008e53e
2025-11-14 10:09:37,019 - DEBUG - botocore.auth - add_auth: Signature:
5d5c2e0265f55ec489dda7f64731b0872c706418cdde4eca1e9d7ff422c0c6cf
2025-11-14 10:09:37,019 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:09:37,020 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:12406/fbucket/fruits.csv, headers={'Content-Type': b'text/plain', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': b'syluNHiGATUP+5/OfJsmcg==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251114T100937Z', 'X-Amz-Content-SHA256': b'be1c1c4a83c407c74f1385ef6ac12822772856cf51582ff70769720688989a00', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;content-type;host;x-amz-content-sha256;x-amz-date, Signature=5d5c2e0265f55ec489dda7f64731b0872c706418cdde4eca1e9d7ff422c0c6cf', 'amz-sdk-invocation-id': b'7b406bd7-9787-49ae-87e0-b3d07375cd2f', 'amz-sdk-request': b'attempt=1', 'Content-Length': '53'}>
2025-11-14 10:09:37,022 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-14 10:09:37,024 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-14 10:09:37,028 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:09:37 GMT', 'ETag': '"b3296e34788601350ffb9fce7c9b2672"', 'last-modified': 'Fri, 14 Nov 2025 10:09:37 GMT', 'Content-Length': '0', 'x-amzn-requestid': 'Y3w2YAPwzHSoXbqcmENykWluFWyDHdllc1wDU0yrIfmsVC0wUlMf', 'Content-Type': 'text/html; charset=utf-8', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:09:37,029 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:09:37,030 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2eff7a0830>
2025-11-14 10:09:37,030 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:09:37,030 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2eff7a3990>>
2025-11-14 10:09:37,031 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:09:37,098 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:09:37,157 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            pragma s3.UseRuntimeListing=\"true\";\n\n            SELECT *\n            FROM `h1079649015862523250_test_csvfruitbucket`.`fruits.csv`\n            WITH (format=csv_with_names, SCHEMA (\n                Fruit String NOT NULL,\n                Price Int NOT NULL,\n                Weight Int NOT NULL\n            ));\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "9f6e1070-e582-4e84-b481-5aa3eee8d834"

2025-11-14 10:09:37,206 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej71crravm8437"

2025-11-14 10:09:37,239 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej71crravm8437"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763114977
        nanos: 169545000
      }
      modified_at {
        seconds: 1763114977
        nanos: 169545000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej71crp64joebf-ptqudsej71crravm8437"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763114977
      nanos: 169545000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"true\";\n\n            SELECT *\n            FROM `h1079649015862523250_test_csvfruitbucket`.`fruits.csv`\n            WITH (format=csv_with_names, SCHEMA (\n                Fruit String NOT NULL,\n                Price Int NOT NULL,\n                Weight Int NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:09:37,769 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:09:38,318 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej71crravm8437"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763114977
        nanos: 169545000
      }
      modified_at {
        seconds: 1763114977
        nanos: 169545000
      }
      revision: 1
    }
    started_at {
      seconds: 1763114977
      nanos: 842000000
    }
    execute_mode: RUN
    status: COMPLETING
    last_job_query_revision: 1
    last_job_id: "ptjudsej71crp64joebf-ptqudsej71crravm8437"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763114977
      nanos: 169545000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"true\";\n\n            SELECT *\n            FROM `h1079649015862523250_test_csvfruitbucket`.`fruits.csv`\n            WITH (format=csv_with_names, SCHEMA (\n                Fruit String NOT NULL,\n                Price Int NOT NULL,\n                Weight Int NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":10,\"level\":1,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":2,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  result_set_meta {
    column {
      name: "Fruit"
      type {
        type_id: STRING
      }
    }
    column {
      name: "Price"
      type {
        type_id: INT32
      }
    }
    column {
      name: "Weight"
      type {
        type_id: INT32
      }
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'\"true\"))\n(let $3 (DataSink \'result))\n(let $4 \'\"h1079649015862523250_test_csvfruitbucket\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 (Bool \'\"true\"))\n(let $7 (DataType \'Int32))\n(let $8 (StructType \'(\'\"Fruit\" (DataType \'String)) \'(\'\"Price\" $7) \'(\'\"Weight\" $7)))\n(let $9 (S3ParseSettings world \'(\'((String \'\"Paths {\\n  Name: \\\"fruits.csv\\\"\\n  Size: 53\\n  Read: true\\n}\\n\") $6 (AsStruct))) (SecureParam \'\"cluster:default_h1079649015862523250_test_csvfruitbucket\") \'\"\" \'\"fruits.csv \" \'\"csv_with_names\" $8 (lambda \'($13) $6) \'()))\n(let $10 (DqStage \'((DqSource $5 $9)) (lambda \'($14) (block \'(\n  (let $15 (DqSourceWideWrap $14 $5 $8 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $15 (lambda \'($16 $17 $18) (AsStruct \'(\'\"Fruit\" $16) \'(\'\"Price\" $17) \'(\'\"Weight\" $18)))))\n))) \'(\'(\'\"_logical_id\" \'200034))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($19) $19) \'(\'(\'\"_logical_id\" \'200075))))\n(let $12 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $12 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-14 10:09:38,829 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej71crravm8437"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763114977
        nanos: 169545000
      }
      modified_at {
        seconds: 1763114977
        nanos: 169545000
      }
      revision: 1
    }
    started_at {
      seconds: 1763114977
      nanos: 842000000
    }
    finished_at {
      seconds: 1763114978
      nanos: 236000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej71crp64joebf-ptqudsej71crravm8437"
    result_expire_at {
      seconds: 1763201377
      nanos: 826323000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763114977
      nanos: 169545000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseRuntimeListing=\"true\";\n\n            SELECT *\n            FROM `h1079649015862523250_test_csvfruitbucket`.`fruits.csv`\n            WITH (format=csv_with_names, SCHEMA (\n                Fruit String NOT NULL,\n                Price Int NOT NULL,\n                Weight Int NOT NULL\n            ));\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":10,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[10]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[8]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":10,\"level\":1,\"name\":\"DqStage #10\",\"type\":\"op\"},{\"id\":8,\"level\":2,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":10,\"target\":8},{\"source\":8,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.15s\",\"count\":2,\"avg\":\"78ms\",\"max\":\"0.14s\",\"min\":\"8ms\"},\"IngressBytes\":{\"sum\":53,\"count\":1,\"avg\":53,\"max\":53,\"min\":53},\"IngressRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"InputBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"InputRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"OutputBytes\":{\"sum\":60,\"count\":2,\"avg\":30,\"max\":30,\"min\":30},\"OutputRows\":{\"sum\":6,\"count\":2,\"avg\":3,\"max\":3,\"min\":3},\"ResultBytes\":{\"sum\":30,\"count\":1,\"avg\":30,\"max\":30,\"min\":30},\"ResultRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"MaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "Fruit"
      type {
        type_id: STRING
      }
    }
    column {
      name: "Price"
      type {
        type_id: INT32
      }
    }
    column {
      name: "Weight"
      type {
        type_id: INT32
      }
    }
    rows_count: 3
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useruntimelisting\" \'\"true\"))\n(let $3 (DataSink \'result))\n(let $4 \'\"h1079649015862523250_test_csvfruitbucket\")\n(let $5 (DataSource \'\"s3\" $4))\n(let $6 (Bool \'\"true\"))\n(let $7 (DataType \'Int32))\n(let $8 (StructType \'(\'\"Fruit\" (DataType \'String)) \'(\'\"Price\" $7) \'(\'\"Weight\" $7)))\n(let $9 (S3ParseSettings world \'(\'((String \'\"Paths {\\n  Name: \\\"fruits.csv\\\"\\n  Size: 53\\n  Read: true\\n}\\n\") $6 (AsStruct))) (SecureParam \'\"cluster:default_h1079649015862523250_test_csvfruitbucket\") \'\"\" \'\"fruits.csv \" \'\"csv_with_names\" $8 (lambda \'($13) $6) \'()))\n(let $10 (DqStage \'((DqSource $5 $9)) (lambda \'($14) (block \'(\n  (let $15 (DqSourceWideWrap $14 $5 $8 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $15 (lambda \'($16 $17 $18) (AsStruct \'(\'\"Fruit\" $16) \'(\'\"Price\" $17) \'(\'\"Weight\" $18)))))\n))) \'(\'(\'\"_logical_id\" \'200034))))\n(let $11 (DqStage \'((DqCnUnionAll (TDqOutput $10 \'\"0\"))) (lambda \'($19) $19) \'(\'(\'\"_logical_id\" \'200075))))\n(let $12 (ResPull! $2 $3 (Key) (DqCnResult (TDqOutput $11 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $12 $3) (DataSink \'\"s3\" $4)))\n)\n"
  }
}

2025-11-14 10:09:38,861 - DEBUG - root - test_csv: columns {
  name: "Fruit"
  type {
    type_id: STRING
  }
}
columns {
  name: "Price"
  type {
    type_id: INT32
  }
}
columns {
  name: "Weight"
  type {
    type_id: INT32
  }
}
rows {
  items {
    bytes_value: "Banana"
  }
  items {
    int32_value: 3
  }
  items {
    int32_value: 100
  }
}
rows {
  items {
    bytes_value: "Apple"
  }
  items {
    int32_value: 2
  }
  items {
    int32_value: 22
  }
}
rows {
  items {
    bytes_value: "Pear"
  }
  items {
    int32_value: 15
  }
  items {
    int32_value: 33
  }
}

2025-11-14 10:09:38,864 - INFO - ya.test - pytest_runtest_teardown: Test teardown
