2025-11-10 09:35:26,671 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 09:35:26,672 - INFO - ya.test - pytest_runtest_setup: test_insert[v1-false-client0-parquet-dataにちは% set]
2025-11-10 09:35:26,672 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-10 09:35:26,672 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-10 09:35:26,758 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_insert.py::TestS3, test_name: test_insert[v1-false-client0-parquet-dataにちは% set])
2025-11-10 09:35:26,785 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f48f3219f10>
2025-11-10 09:35:26,801 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f48f333d6d0>
2025-11-10 09:35:26,825 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f48df846f90>
2025-11-10 09:35:26,825 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f48f333d3d0>
2025-11-10 09:35:26,829 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-10 09:35:26,844 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-10 09:35:26,849 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-10 09:35:26,850 - DEBUG - botocore.utils - register: Registering S3Express Identity Resolver
2025-11-10 09:35:26,869 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-10 09:35:26,871 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-10 09:35:26,872 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-10 09:35:26,874 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f48df847a10>
2025-11-10 09:35:26,874 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'insert_bucket', 'ACL': 'public-read-write'}
2025-11-10 09:35:26,875 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f48f321bdd0>
2025-11-10 09:35:26,876 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f48f3246690>
2025-11-10 09:35:26,876 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:26,876 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f48f24b40b0>>
2025-11-10 09:35:26,876 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f48f321bb90>
2025-11-10 09:35:26,877 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f48f32468d0>
2025-11-10 09:35:26,877 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:26,878 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:6023', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True}
2025-11-10 09:35:26,880 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:6023/insert_bucket
2025-11-10 09:35:26,880 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:35:26,881 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:35:26,882 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f48f3244290>
2025-11-10 09:35:26,882 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48d4e4f670>>
2025-11-10 09:35:26,882 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f48f321a150>
2025-11-10 09:35:26,882 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f48f3245cd0>
2025-11-10 09:35:26,883 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read-write', 'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:6023/insert_bucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f48d53ebe40>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'ACL': 'public-read-write'}}, 'input_params': {'Bucket': 'insert_bucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 09:35:26,885 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f48d53eb300>>
2025-11-10 09:35:26,885 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f48f24b40b0>>
2025-11-10 09:35:26,886 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f48f321ba10>
2025-11-10 09:35:26,886 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f48f3246810>
2025-11-10 09:35:26,886 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48d4e4f670>>
2025-11-10 09:35:26,887 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:35:26,919 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/insert_bucket

host:localhost:6023
x-amz-acl:public-read-write
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T093526Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 09:35:26,920 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093526Z
20251110/yandex/s3/aws4_request
28212b333be3ffe6d8f932afc27291736cda6f3462def4b8366a0a25db8bd9ad
2025-11-10 09:35:26,920 - DEBUG - botocore.auth - add_auth: Signature:
80106921aca51bbf688803ce9afbf0223836260cfa9b92a9dfa1c2b9625eb009
2025-11-10 09:35:26,920 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f48f32465d0>
2025-11-10 09:35:26,921 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:6023/insert_bucket, headers={'x-amz-acl': b'public-read-write', 'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T093526Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=80106921aca51bbf688803ce9afbf0223836260cfa9b92a9dfa1c2b9625eb009', 'amz-sdk-invocation-id': b'644aa215-9b21-47c6-a4de-4a94e75f2d73', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-10 09:35:26,922 - DEBUG - botocore.hooks - _emit: Event before-send.s3.CreateBucket: calling handler <moto.core.botocore_stubber.BotocoreStubber object at 0x7f48f243b580>
2025-11-10 09:35:26,940 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:35:26 GMT', 'x-amzn-requestid': '0lCBPGbUVClhqYCLQZYchfOcuw9lJ89bs1uFa7lPKMD6mkMpDT5X', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '167', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:35:26,940 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>insert_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-10 09:35:26,941 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f48d4e4cf60>
2025-11-10 09:35:26,942 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:35:26,942 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:26,943 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': '0lCBPGbUVClhqYCLQZYchfOcuw9lJ89bs1uFa7lPKMD6mkMpDT5X', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 09:35:26 GMT', 'x-amzn-requestid': '0lCBPGbUVClhqYCLQZYchfOcuw9lJ89bs1uFa7lPKMD6mkMpDT5X', 'content-type': 'text/html; charset=utf-8', 'content-length': '167', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-10 09:35:26,944 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'insert_bucket'}
2025-11-10 09:35:26,945 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7f48f32456d0>
2025-11-10 09:35:26,945 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7f48f321bdd0>
2025-11-10 09:35:26,945 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f48f3246690>
2025-11-10 09:35:26,945 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:26,946 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f48f24b40b0>>
2025-11-10 09:35:26,946 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7f48f321bb90>
2025-11-10 09:35:26,946 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f48f32468d0>
2025-11-10 09:35:26,947 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:26,947 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:6023', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 09:35:26,948 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:6023/insert_bucket
2025-11-10 09:35:26,949 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:35:26,949 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:35:27,011 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7f48f3244290>
2025-11-10 09:35:27,016 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48d4e4f670>>
2025-11-10 09:35:27,036 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7f48f321a150>
2025-11-10 09:35:27,036 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7f48f3245cd0>
2025-11-10 09:35:27,036 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:6023/insert_bucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f48d53ebe40>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'EncodingType': 'url'}}, 'input_params': {'Bucket': 'insert_bucket'}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}}}
2025-11-10 09:35:27,038 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f48d53eb300>>
2025-11-10 09:35:27,038 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f48f24b40b0>>
2025-11-10 09:35:27,038 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7f48f321ba10>
2025-11-10 09:35:27,039 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7f48f3246810>
2025-11-10 09:35:27,039 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48d4e4f670>>
2025-11-10 09:35:27,040 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:35:27,040 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/insert_bucket
encoding-type=url
host:localhost:6023
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251110T093527Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-10 09:35:27,041 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093527Z
20251110/yandex/s3/aws4_request
c70bd84fd84588b55da93791ee3328e8cae02d5c40eeeecc3b59d61d44988529
2025-11-10 09:35:27,041 - DEBUG - botocore.auth - add_auth: Signature:
3e253d877090bb5a2663fb7b3d35551a2dc9b51f831c7ac6b273b9bfbcc05a31
2025-11-10 09:35:27,041 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7f48f32465d0>
2025-11-10 09:35:27,042 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:6023/insert_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'X-Amz-Date': b'20251110T093527Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=3e253d877090bb5a2663fb7b3d35551a2dc9b51f831c7ac6b273b9bfbcc05a31', 'amz-sdk-invocation-id': b'f41f3660-030b-49ce-85aa-e33fbebd2535', 'amz-sdk-request': b'attempt=1'}>
2025-11-10 09:35:27,043 - DEBUG - botocore.hooks - _emit: Event before-send.s3.ListObjects: calling handler <moto.core.botocore_stubber.BotocoreStubber object at 0x7f48f243b580>
2025-11-10 09:35:27,103 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:35:27 GMT', 'x-amzn-requestid': 'LHzTdCbdS2pgdFVb85s2QMIaSfiRmTpJF3Cg830kIvHkoI48gHzn', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '622', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:35:27,141 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>insert_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>dataset/ptjudsomvt0nmkk99gtg_0_ynhi0rm3WEiW1Ltn-Y0wlhlkG2OAgs0s.parquet</Key><LastModified>2025-11-10T09:35:25.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-10 09:35:27,144 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f48d4e4cf60>
2025-11-10 09:35:27,149 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:35:27,149 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:27,150 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7f48f3245790>
2025-11-10 09:35:27,150 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-10 09:35:27,150 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-10 09:35:27,201 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7f48df847b90>
2025-11-10 09:35:27,202 - DEBUG - boto3.resources.action - __call__: Calling s3:delete_objects with {'Bucket': 'insert_bucket', 'Delete': {'Objects': [{'Key': 'dataset/ptjudsomvt0nmkk99gtg_0_ynhi0rm3WEiW1Ltn-Y0wlhlkG2OAgs0s.parquet'}]}}
2025-11-10 09:35:27,203 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function validate_bucket_name at 0x7f48f321bdd0>
2025-11-10 09:35:27,203 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f48f3246690>
2025-11-10 09:35:27,204 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:27,204 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method ClientCreator._inject_s3_input_parameters of <botocore.client.ClientCreator object at 0x7f48f24b40b0>>
2025-11-10 09:35:27,204 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function generate_idempotent_uuid at 0x7f48f321bb90>
2025-11-10 09:35:27,204 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f48f32468d0>
2025-11-10 09:35:27,205 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:27,205 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:6023', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-10 09:35:27,205 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:6023/insert_bucket
2025-11-10 09:35:27,206 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-10 09:35:27,206 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-10 09:35:27,207 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function escape_xml_payload at 0x7f48f321b7d0>
2025-11-10 09:35:27,207 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function conditionally_calculate_checksum at 0x7f48f344ba10>
2025-11-10 09:35:27,208 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_expect_header at 0x7f48f3244290>
2025-11-10 09:35:27,208 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.apply_signing_cache_key of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48d4e4f670>>
2025-11-10 09:35:27,208 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_recursion_detection_header at 0x7f48f321a150>
2025-11-10 09:35:27,239 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function inject_api_version_header_if_needed at 0x7f48f3245cd0>
2025-11-10 09:35:27,243 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=DeleteObjects) with params: {'url_path': '?delete', 'query_string': {}, 'method': 'POST', 'headers': {'User-Agent': 'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': 'rpuAtYlRTPWuhE8OMYVp8Q=='}, 'body': b'<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Object><Key>dataset/ptjudsomvt0nmkk99gtg_0_ynhi0rm3WEiW1Ltn-Y0wlhlkG2OAgs0s.parquet</Key></Object></Delete>', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:6023/insert_bucket?delete', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f48d53ebe40>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'Delete': {'Objects': [{'Key': 'dataset/ptjudsomvt0nmkk99gtg_0_ynhi0rm3WEiW1Ltn-Y0wlhlkG2OAgs0s.parquet'}]}}}, 'input_params': {'Bucket': 'insert_bucket', 'Delete': {'Objects': [{'Key': 'dataset/ptjudsomvt0nmkk99gtg_0_ynhi0rm3WEiW1Ltn-Y0wlhlkG2OAgs0s.parquet'}]}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'yandex'}]}, 'checksum': {'request_algorithm': 'conditional-md5'}}}
2025-11-10 09:35:27,249 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f48d53eb300>>
2025-11-10 09:35:27,250 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f48f24b40b0>>
2025-11-10 09:35:27,263 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <function set_operation_specific_signer at 0x7f48f321ba10>
2025-11-10 09:35:27,264 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <function remove_arn_from_signing_path at 0x7f48f3246810>
2025-11-10 09:35:27,275 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <bound method S3ExpressIdentityResolver.resolve_s3express_identity of <botocore.utils.S3ExpressIdentityResolver object at 0x7f48d4e4f670>>
2025-11-10 09:35:27,276 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-10 09:35:27,286 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
POST
/insert_bucket
delete=
content-md5:rpuAtYlRTPWuhE8OMYVp8Q==
host:localhost:6023
x-amz-content-sha256:de623634516ca6855cee2ca78ca2ea026925dd41addd3e18f3013c446784b64d
x-amz-date:20251110T093527Z

content-md5;host;x-amz-content-sha256;x-amz-date
de623634516ca6855cee2ca78ca2ea026925dd41addd3e18f3013c446784b64d
2025-11-10 09:35:27,286 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251110T093527Z
20251110/yandex/s3/aws4_request
a4509b04653f10a76a8e14206a022540d91a26ba8abdf5f16251759874ca559c
2025-11-10 09:35:27,309 - DEBUG - botocore.auth - add_auth: Signature:
bda5ddb951f6390021fb017a1b9de96943879027026e670f9fd96b1afaa8f8a0
2025-11-10 09:35:27,309 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <function add_retry_headers at 0x7f48f32465d0>
2025-11-10 09:35:27,310 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=http://localhost:6023/insert_bucket?delete, headers={'User-Agent': b'Boto3/1.34.89 md/Botocore#1.34.89 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.12 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.89 Resource', 'Content-MD5': b'rpuAtYlRTPWuhE8OMYVp8Q==', 'X-Amz-Date': b'20251110T093527Z', 'X-Amz-Content-SHA256': b'de623634516ca6855cee2ca78ca2ea026925dd41addd3e18f3013c446784b64d', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251110/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=bda5ddb951f6390021fb017a1b9de96943879027026e670f9fd96b1afaa8f8a0', 'amz-sdk-invocation-id': b'5d4df8e1-ffa6-49ee-9e03-f541fde8da15', 'amz-sdk-request': b'attempt=1', 'Content-Length': '164'}>
2025-11-10 09:35:27,311 - DEBUG - botocore.hooks - _emit: Event before-send.s3.DeleteObjects: calling handler <moto.core.botocore_stubber.BotocoreStubber object at 0x7f48f243b580>
2025-11-10 09:35:27,319 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.12', 'Date': 'Mon, 10 Nov 2025 09:35:27 GMT', 'x-amzn-requestid': '3y3vZT7ESNOysnE8vmknsul8sGLC5VqnVpnrbrd0FK1rRegeXwTA', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '215', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-10 09:35:27,319 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><DeleteResult xmlns="http://s3.amazonaws.com/doc/2006-03-01"><Deleted><Key>dataset/ptjudsomvt0nmkk99gtg_0_ynhi0rm3WEiW1Ltn-Y0wlhlkG2OAgs0s.parquet</Key></Deleted></DeleteResult>'
2025-11-10 09:35:27,321 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f48d4e4cf60>
2025-11-10 09:35:27,322 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-10 09:35:27,322 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f48d4e4fc60>>
2025-11-10 09:35:27,323 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': '3y3vZT7ESNOysnE8vmknsul8sGLC5VqnVpnrbrd0FK1rRegeXwTA', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.12', 'date': 'Mon, 10 Nov 2025 09:35:27 GMT', 'x-amzn-requestid': '3y3vZT7ESNOysnE8vmknsul8sGLC5VqnVpnrbrd0FK1rRegeXwTA', 'content-type': 'text/html; charset=utf-8', 'content-length': '215', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'Deleted': [{'Key': 'dataset/ptjudsomvt0nmkk99gtg_0_ynhi0rm3WEiW1Ltn-Y0wlhlkG2OAgs0s.parquet'}]}
2025-11-10 09:35:27,390 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            pragma s3.UseBlocksSink = \"false\";\n            insert into `h5878366832775029837_test_insertibucket`.`data\343\201\253\343\201\241\343\201\257% set/` with (format=parquet)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "50b0307c-43b3-4344-bf97-73db241b1e6d"

2025-11-10 09:35:27,422 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsomvq1ut040hq5h"

2025-11-10 09:35:27,429 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomvq1ut040hq5h"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767327
        nanos: 396875000
      }
      modified_at {
        seconds: 1762767327
        nanos: 396875000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsomvq1usrfmmt2a-ptqudsomvq1ut040hq5h"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767327
      nanos: 396875000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseBlocksSink = \"false\";\n            insert into `h5878366832775029837_test_insertibucket`.`data\343\201\253\343\201\241\343\201\257% set/` with (format=parquet)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
}

2025-11-10 09:35:27,962 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomvq1ut040hq5h"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767327
        nanos: 396875000
      }
      modified_at {
        seconds: 1762767327
        nanos: 396875000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767327
      nanos: 884000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsomvq1usrfmmt2a-ptqudsomvq1ut040hq5h"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767327
      nanos: 396875000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseBlocksSink = \"false\";\n            insert into `h5878366832775029837_test_insertibucket`.`data\343\201\253\343\201\241\343\201\257% set/` with (format=parquet)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"AsList\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useblockssink\" \'\"false\"))\n(let $3 (DataSink \'\"s3\" \'\"h5878366832775029837_test_insertibucket\"))\n(let $4 (S3SinkSettings \'\"data\\u306B\\u3061\\u306F% set/\" \'(\'(\'\"multipart\" \'\"true\")) (SecureParam \'\"cluster:default_h5878366832775029837_test_insertibucket\") \'\".parquet\" (StructType \'(\'\"bar\" (DataType \'Utf8)) \'(\'\"foo\" (DataType \'Int32)))))\n(return (Commit! (DqQuery! $2 \'((DqStage \'() (lambda \'() (block \'(\n  (let $5 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput (ToFlow (AsList (AsStruct \'(\'\"bar\" (Utf8 \'\"xxx\")) \'(\'\"foo\" (Int32 \'\"123\"))) (AsStruct \'(\'\"bar\" (Utf8 \'\"yyy\")) \'(\'\"foo\" (Int32 \'\"456\"))))) \'\"parquet\" \'() $5))\n))) \'() \'((DqSink \'0 $3 $4))))) $3))\n)\n"
  }
}

2025-11-10 09:35:28,477 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomvq1ut040hq5h"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767327
        nanos: 396875000
      }
      modified_at {
        seconds: 1762767327
        nanos: 396875000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767327
      nanos: 884000000
    }
    finished_at {
      seconds: 1762767328
      nanos: 83000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsomvq1usrfmmt2a-ptqudsomvq1ut040hq5h"
    result_expire_at {
      seconds: 1762853727
      nanos: 874052000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767327
      nanos: 396875000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.UseBlocksSink = \"false\";\n            insert into `h5878366832775029837_test_insertibucket`.`data\343\201\253\343\201\241\343\201\257% set/` with (format=parquet)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"AsList\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"87ms\",\"count\":1,\"avg\":\"87ms\",\"max\":\"87ms\",\"min\":\"87ms\"},\"EgressBytes\":{\"sum\":533,\"count\":1,\"avg\":533,\"max\":533,\"min\":533},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"useblockssink\" \'\"false\"))\n(let $3 (DataSink \'\"s3\" \'\"h5878366832775029837_test_insertibucket\"))\n(let $4 (S3SinkSettings \'\"data\\u306B\\u3061\\u306F% set/\" \'(\'(\'\"multipart\" \'\"true\")) (SecureParam \'\"cluster:default_h5878366832775029837_test_insertibucket\") \'\".parquet\" (StructType \'(\'\"bar\" (DataType \'Utf8)) \'(\'\"foo\" (DataType \'Int32)))))\n(return (Commit! (DqQuery! $2 \'((DqStage \'() (lambda \'() (block \'(\n  (let $5 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput (ToFlow (AsList (AsStruct \'(\'\"bar\" (Utf8 \'\"xxx\")) \'(\'\"foo\" (Int32 \'\"123\"))) (AsStruct \'(\'\"bar\" (Utf8 \'\"yyy\")) \'(\'\"foo\" (Int32 \'\"456\"))))) \'\"parquet\" \'() $5))\n))) \'() \'((DqSink \'0 $3 $4))))) $3))\n)\n"
  }
}

2025-11-10 09:35:28,567 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-10 09:35:28,568 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            select foo, bar from h5878366832775029837_test_insertibucket.`data\343\201\253\343\201\241\343\201\257% set/ptjudsomvq1usrfmmt2a*` with (format=parquet, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "ee1e9750-4f55-4e78-8deb-fc6b1469ee07"

2025-11-10 09:35:28,619 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsomvotgmpf427fg"

2025-11-10 09:35:28,628 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomvotgmpf427fg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767328
        nanos: 591054000
      }
      modified_at {
        seconds: 1762767328
        nanos: 591054000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsomvotgml3hrosm-ptqudsomvotgmpf427fg"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767328
      nanos: 591054000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select foo, bar from h5878366832775029837_test_insertibucket.`data\343\201\253\343\201\241\343\201\257% set/ptjudsomvq1usrfmmt2a*` with (format=parquet, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
}

2025-11-10 09:35:29,138 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomvotgmpf427fg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767328
        nanos: 591054000
      }
      modified_at {
        seconds: 1762767328
        nanos: 591054000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767328
      nanos: 894000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsomvotgml3hrosm-ptqudsomvotgmpf427fg"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767328
      nanos: 591054000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select foo, bar from h5878366832775029837_test_insertibucket.`data\343\201\253\343\201\241\343\201\257% set/ptjudsomvq1usrfmmt2a*` with (format=parquet, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  result_set_meta {
    column {
      name: "foo"
      type {
        type_id: INT32
      }
    }
    column {
      name: "bar"
      type {
        type_id: STRING
      }
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h5878366832775029837_test_insertibucket\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 \'\"Paths {\\n  Name: \\\"data\\\\343\\\\201\\\\253\\\\343\\\\201\\\\241\\\\343\\\\201\\\\257% set\\\"\\n  Children {\\n    Name: \\\"ptjudsomvq1usrfmmt2a_0_vDH46RfCF02Sm6876vbClNZuQZlbgX-s.parquet\\\"\\n    Size: 533\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $6 (Bool \'\"true\"))\n(let $7 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" (DataType \'Int32))))\n(let $8 (S3ParseSettings world \'(\'((String $5) $6 (AsStruct))) (SecureParam \'\"cluster:default_h5878366832775029837_test_insertibucket\") \'\"\" \'\"data\\u306B\\u3061\\u306F% set/ptjudsomvq1usrfmmt2a* \" \'\"parquet\" $7 (lambda \'($13) $6) \'()))\n(let $9 (DqStage \'((DqSource $4 $8)) (lambda \'($14) (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $14 $4 $7 \'(\'(\'format \'\"parquet\")))))) (lambda \'($15 $16) (AsStruct \'(\'\"bar\" $15) \'(\'\"foo\" $16))))) \'(\'(\'\"_logical_id\" \'209304))))\n(let $10 (DqStage \'((DqCnUnionAll (TDqOutput $9 \'\"0\"))) (lambda \'($17) $17) \'(\'(\'\"_logical_id\" \'209346))))\n(let $11 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"foo\" \'\"bar\"))))\n(let $12 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $10 \'\"0\") \'()) $11 \'\"dq\"))\n(return (Commit! (Commit! $12 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-10 09:35:29,646 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsomvotgmpf427fg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762767328
        nanos: 591054000
      }
      modified_at {
        seconds: 1762767328
        nanos: 591054000
      }
      revision: 1
    }
    started_at {
      seconds: 1762767328
      nanos: 894000000
    }
    finished_at {
      seconds: 1762767329
      nanos: 207000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsomvotgml3hrosm-ptqudsomvotgmpf427fg"
    result_expire_at {
      seconds: 1762853728
      nanos: 883331000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762767328
      nanos: 591054000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select foo, bar from h5878366832775029837_test_insertibucket.`data\343\201\253\343\201\241\343\201\257% set/ptjudsomvq1usrfmmt2a*` with (format=parquet, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"93ms\",\"count\":2,\"avg\":\"46ms\",\"max\":\"90ms\",\"min\":\"2ms\"},\"IngressBytes\":{\"sum\":735,\"count\":1,\"avg\":735,\"max\":735,\"min\":735},\"IngressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"InputBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"InputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"OutputBytes\":{\"sum\":34,\"count\":2,\"avg\":17,\"max\":17,\"min\":17},\"OutputRows\":{\"sum\":4,\"count\":2,\"avg\":2,\"max\":2,\"min\":2},\"ResultBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"ResultRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "foo"
      type {
        type_id: INT32
      }
    }
    column {
      name: "bar"
      type {
        type_id: STRING
      }
    }
    rows_count: 2
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h5878366832775029837_test_insertibucket\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 \'\"Paths {\\n  Name: \\\"data\\\\343\\\\201\\\\253\\\\343\\\\201\\\\241\\\\343\\\\201\\\\257% set\\\"\\n  Children {\\n    Name: \\\"ptjudsomvq1usrfmmt2a_0_vDH46RfCF02Sm6876vbClNZuQZlbgX-s.parquet\\\"\\n    Size: 533\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $6 (Bool \'\"true\"))\n(let $7 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" (DataType \'Int32))))\n(let $8 (S3ParseSettings world \'(\'((String $5) $6 (AsStruct))) (SecureParam \'\"cluster:default_h5878366832775029837_test_insertibucket\") \'\"\" \'\"data\\u306B\\u3061\\u306F% set/ptjudsomvq1usrfmmt2a* \" \'\"parquet\" $7 (lambda \'($13) $6) \'()))\n(let $9 (DqStage \'((DqSource $4 $8)) (lambda \'($14) (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $14 $4 $7 \'(\'(\'format \'\"parquet\")))))) (lambda \'($15 $16) (AsStruct \'(\'\"bar\" $15) \'(\'\"foo\" $16))))) \'(\'(\'\"_logical_id\" \'209304))))\n(let $10 (DqStage \'((DqCnUnionAll (TDqOutput $9 \'\"0\"))) (lambda \'($17) $17) \'(\'(\'\"_logical_id\" \'209346))))\n(let $11 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"foo\" \'\"bar\"))))\n(let $12 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $10 \'\"0\") \'()) $11 \'\"dq\"))\n(return (Commit! (Commit! $12 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-10 09:35:29,673 - DEBUG - root - test_insert: columns {
  name: "foo"
  type {
    type_id: INT32
  }
}
columns {
  name: "bar"
  type {
    type_id: STRING
  }
}
rows {
  items {
    int32_value: 123
  }
  items {
    bytes_value: "xxx"
  }
}
rows {
  items {
    int32_value: 456
  }
  items {
    bytes_value: "yyy"
  }
}

2025-11-10 09:35:29,677 - INFO - ya.test - pytest_runtest_teardown: Test teardown
