2025-11-14 10:09:35,889 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:09:35,890 - INFO - ya.test - pytest_runtest_setup: test_egress[v1-client0-parquet]
2025-11-14 10:09:35,890 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:09:35,890 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-14 10:09:36,009 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_statistics.py::TestS3, test_name: test_egress[v1-client0-parquet])
2025-11-14 10:09:36,010 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7ff27a920dd0>
2025-11-14 10:09:36,013 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7ff27aa30ad0>
2025-11-14 10:09:36,013 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7ff267c97590>
2025-11-14 10:09:36,013 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7ff27aa307d0>
2025-11-14 10:09:36,018 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:09:36,023 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:09:36,024 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:09:36,026 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-14 10:09:36,028 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-14 10:09:36,028 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-14 10:09:36,030 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb0050>
2025-11-14 10:09:36,031 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'egress_bucket', 'ACL': 'public-read-write'}
2025-11-14 10:09:36,032 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:09:36,032 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:09:36,033 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:36,033 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:09:36,033 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:09:36,033 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:36,034 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'egress_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:09:36,035 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/egress_bucket
2025-11-14 10:09:36,036 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:09:36,036 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:09:36,037 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:09:36,037 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:09:36,038 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:09:36,038 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read-write', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/egress_bucket/', 'url': 'http://localhost:17732/egress_bucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff25d57c290>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'egress_bucket', 'params': {'Bucket': 'egress_bucket', 'ACL': 'public-read-write'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:09:36,039 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff25d57fd50>>
2025-11-14 10:09:36,039 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff265d48150>>
2025-11-14 10:09:36,040 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:09:36,040 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:09:36,041 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:09:36,041 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/egress_bucket

host:localhost:17732
x-amz-acl:public-read-write
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T100936Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:09:36,041 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T100936Z
20251114/yandex/s3/aws4_request
9e5879146ffbe6e039d08869de05fa8f1397b616e59d7755568d3fef80d00376
2025-11-14 10:09:36,042 - DEBUG - botocore.auth - add_auth: Signature:
3621f242bd6a976830dc13c016866ffc62f9610893ba3148324ed9e0bcbc3ca9
2025-11-14 10:09:36,042 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:09:36,042 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:17732/egress_bucket, headers={'x-amz-acl': b'public-read-write', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T100936Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=3621f242bd6a976830dc13c016866ffc62f9610893ba3148324ed9e0bcbc3ca9', 'amz-sdk-invocation-id': b'e5db5af5-cc18-4e05-b070-8f67b476b24b', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-14 10:09:36,059 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:09:36 GMT', 'x-amzn-requestid': 'ukzdDpK4pAV1fKzXDam4pfTWt7AMhDKBu1tscMYYeM5ONvwjD0Xl', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '167', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:09:36,060 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>egress_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-14 10:09:36,061 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff25d552f90>
2025-11-14 10:09:36,061 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:09:36,061 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:36,062 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'ukzdDpK4pAV1fKzXDam4pfTWt7AMhDKBu1tscMYYeM5ONvwjD0Xl', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:09:36 GMT', 'x-amzn-requestid': 'ukzdDpK4pAV1fKzXDam4pfTWt7AMhDKBu1tscMYYeM5ONvwjD0Xl', 'content-type': 'text/html; charset=utf-8', 'content-length': '167', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-14 10:09:36,063 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:09:36,118 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:09:36,189 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            insert into `h2629958215696641493_test_egresssbucket`.`parquet_v1/` with (format=parquet)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "2862d0b5-3fad-4b9c-8b62-f0dc12c2a6ec"

2025-11-14 10:09:36,230 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej72adq1u6s6gg"

2025-11-14 10:09:36,250 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej72adq1u6s6gg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763114976
        nanos: 200882000
      }
      modified_at {
        seconds: 1763114976
        nanos: 200882000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej72adnriv1jid-ptqudsej72adq1u6s6gg"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763114976
      nanos: 200882000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h2629958215696641493_test_egresssbucket`.`parquet_v1/` with (format=parquet)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:09:36,794 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:09:37,314 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej72adq1u6s6gg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763114976
        nanos: 200882000
      }
      modified_at {
        seconds: 1763114976
        nanos: 200882000
      }
      revision: 1
    }
    started_at {
      seconds: 1763114976
      nanos: 793000000
    }
    finished_at {
      seconds: 1763114977
      nanos: 16000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej72adnriv1jid-ptqudsej72adq1u6s6gg"
    result_expire_at {
      seconds: 1763201376
      nanos: 767694000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763114976
      nanos: 200882000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h2629958215696641493_test_egresssbucket`.`parquet_v1/` with (format=parquet)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"AsList\"},{\"Name\":\"ToFlow\"},{\"Name\":\"ExpandMap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideToBlocks\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"83ms\",\"count\":1,\"avg\":\"83ms\",\"max\":\"83ms\",\"min\":\"83ms\"},\"EgressBytes\":{\"sum\":533,\"count\":1,\"avg\":533,\"max\":533,\"min\":533},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":934208,\"count\":1,\"avg\":934208,\"max\":934208,\"min\":934208},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'\"s3\" \'\"h2629958215696641493_test_egresssbucket\"))\n(let $3 (S3SinkSettings \'\"parquet_v1/\" \'(\'(\'\"multipart\" \'\"true\") \'(\'\"block_output\" \'\"true\")) (SecureParam \'\"cluster:default_h2629958215696641493_test_egresssbucket\") \'\".parquet\" (StructType \'(\'\"bar\" (DataType \'Utf8)) \'(\'\"foo\" (DataType \'Int32)))))\n(return (Commit! (DqQuery! $1 \'((DqStage \'() (lambda \'() (block \'(\n  (let $4 (lambda \'($5) (Member $5 \'\"bar\") (Member $5 \'\"foo\")))\n  (return (WideToBlocks (FromFlow (ExpandMap (ToFlow (AsList (AsStruct \'(\'\"bar\" (Utf8 \'\"xxx\")) \'(\'\"foo\" (Int32 \'\"123\"))) (AsStruct \'(\'\"bar\" (Utf8 \'\"yyy\")) \'(\'\"foo\" (Int32 \'\"456\"))))) $4))))\n))) \'() \'((DqSink \'0 $2 $3))))) $2))\n)\n"
  }
}

2025-11-14 10:09:37,325 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:09:37,326 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'egress_bucket'}
2025-11-14 10:09:37,327 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7ff27a944590>
2025-11-14 10:09:37,327 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:09:37,327 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:09:37,327 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:37,328 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:09:37,328 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:09:37,328 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:37,328 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'egress_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:09:37,330 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/egress_bucket
2025-11-14 10:09:37,330 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:09:37,331 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:09:37,331 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:09:37,332 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:09:37,332 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:09:37,332 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/egress_bucket/', 'url': 'http://localhost:17732/egress_bucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff25d57c290>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'egress_bucket', 'params': {'Bucket': 'egress_bucket', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:09:37,333 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff25d57fd50>>
2025-11-14 10:09:37,334 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff265d48150>>
2025-11-14 10:09:37,334 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:09:37,334 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:09:37,335 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:09:37,335 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/egress_bucket
encoding-type=url
host:localhost:17732
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T100937Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:09:37,335 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T100937Z
20251114/yandex/s3/aws4_request
2e2cbdfc7d9d5745e268aa128f6c223f0ab152efe03e91c6242b7cfd24a6e10e
2025-11-14 10:09:37,336 - DEBUG - botocore.auth - add_auth: Signature:
a6d743ca54071830529665e3734a4491970aa5d0681cc777538b96adae9d0223
2025-11-14 10:09:37,336 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:09:37,336 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:17732/egress_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T100937Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=a6d743ca54071830529665e3734a4491970aa5d0681cc777538b96adae9d0223', 'amz-sdk-invocation-id': b'e448eef4-272d-4efa-8acc-a802c0a895c5', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:09:37,343 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:09:37 GMT', 'x-amzn-requestid': 'CRptXk9fzwLx20XTyWmI7RTtVqy5Mhc2WdpsenNKeBx4fSiDD62m', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '1794', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:09:37,343 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>egress_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>csv_with_names_v1/ptjudsej74j1vi51acvp_0_gp858XDXGke-uNunsng-tJO9O1ENOKoo.csv</Key><LastModified>2025-11-14T10:09:35.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_v1/ptjudsej76dfbsf1gkpo_0_2v-1FI35PUqPIcxYS9PXNcf0xKwH878q.json</Key><LastModified>2025-11-14T10:09:33.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_v1/ptjudsej78uh766hc0un_0_Vt2cXMVAnUGf92pA-J35uwJNxKcFyXtc.json</Key><LastModified>2025-11-14T10:09:30.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_v1/ptjudsej72adnriv1jid_0_4psO3-i8zk-1tTTsq47WhiL2ih07bmrr.parquet</Key><LastModified>2025-11-14T10:09:37.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-14 10:09:37,347 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff25d552f90>
2025-11-14 10:09:37,347 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:09:37,347 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:37,348 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7ff27a944650>
2025-11-14 10:09:37,348 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-14 10:09:37,348 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-14 10:09:37,349 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb01d0>
2025-11-14 10:09:37,350 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Object
2025-11-14 10:09:37,352 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Object: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb0110>
2025-11-14 10:09:37,353 - DEBUG - boto3.resources.action - __call__: Calling s3:head_object with {'Bucket': 'egress_bucket', 'Key': 'parquet_v1/ptjudsej72adnriv1jid_0_4psO3-i8zk-1tTTsq47WhiL2ih07bmrr.parquet'}
2025-11-14 10:09:37,354 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function sse_md5 at 0x7ff27a922d50>
2025-11-14 10:09:37,354 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:09:37,354 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:09:37,354 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:37,355 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:09:37,355 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:09:37,355 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:37,356 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'egress_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:09:37,356 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/egress_bucket
2025-11-14 10:09:37,356 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:09:37,356 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:09:37,357 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:09:37,357 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:09:37,357 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:09:37,358 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=HeadObject) with params: {'url_path': '/parquet_v1/ptjudsej72adnriv1jid_0_4psO3-i8zk-1tTTsq47WhiL2ih07bmrr.parquet', 'query_string': {}, 'method': 'HEAD', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/egress_bucket/parquet_v1/ptjudsej72adnriv1jid_0_4psO3-i8zk-1tTTsq47WhiL2ih07bmrr.parquet', 'url': 'http://localhost:17732/egress_bucket/parquet_v1/ptjudsej72adnriv1jid_0_4psO3-i8zk-1tTTsq47WhiL2ih07bmrr.parquet', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff25d57c290>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'egress_bucket', 'params': {'Bucket': 'egress_bucket', 'Key': 'parquet_v1/ptjudsej72adnriv1jid_0_4psO3-i8zk-1tTTsq47WhiL2ih07bmrr.parquet'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:09:37,359 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff25d57fd50>>
2025-11-14 10:09:37,360 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff265d48150>>
2025-11-14 10:09:37,360 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:09:37,360 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.HeadObject: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:09:37,361 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:09:37,361 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
HEAD
/egress_bucket/parquet_v1/ptjudsej72adnriv1jid_0_4psO3-i8zk-1tTTsq47WhiL2ih07bmrr.parquet

host:localhost:17732
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T100937Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:09:37,362 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T100937Z
20251114/yandex/s3/aws4_request
eaa7f1e9deeaf5351d4d7a1d2eb4c59724d29f49c81a492745b03e004f7a560b
2025-11-14 10:09:37,362 - DEBUG - botocore.auth - add_auth: Signature:
ad750e7b744fc33c713acf86d97acd1789dc0fb8fb478b2369d0ff7d00d910d8
2025-11-14 10:09:37,362 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:09:37,362 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=HEAD, url=http://localhost:17732/egress_bucket/parquet_v1/ptjudsej72adnriv1jid_0_4psO3-i8zk-1tTTsq47WhiL2ih07bmrr.parquet, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T100937Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=ad750e7b744fc33c713acf86d97acd1789dc0fb8fb478b2369d0ff7d00d910d8', 'amz-sdk-invocation-id': b'8c49cd5d-34a3-4a0c-97d2-097af19653e8', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:09:37,370 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:09:37 GMT', 'content-type': 'binary/octet-stream', 'ETag': '"938ee549036fc083f3ad0112127f9622"', 'last-modified': 'Fri, 14 Nov 2025 10:09:37 GMT', 'Content-Length': '533', 'x-amzn-requestid': 'Df5LDPX3rUZ5N46h2WuA4vw2rEl5H713kKPFC5DfaDoip1bb8Mee', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:09:37,370 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:09:37,372 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff25d552f90>
2025-11-14 10:09:37,372 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:09:37,373 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff27a7101a0>>
2025-11-14 10:09:37,373 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'Df5LDPX3rUZ5N46h2WuA4vw2rEl5H713kKPFC5DfaDoip1bb8Mee', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:09:37 GMT', 'content-type': 'binary/octet-stream', 'etag': '"938ee549036fc083f3ad0112127f9622"', 'last-modified': 'Fri, 14 Nov 2025 10:09:37 GMT', 'content-length': '533', 'x-amzn-requestid': 'Df5LDPX3rUZ5N46h2WuA4vw2rEl5H713kKPFC5DfaDoip1bb8Mee', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'LastModified': datetime.datetime(2025, 11, 14, 10, 9, 37, tzinfo=tzutc()), 'ContentLength': 533, 'ETag': '"938ee549036fc083f3ad0112127f9622"', 'ContentType': 'binary/octet-stream', 'Metadata': {}}
2025-11-14 10:09:37,376 - INFO - ya.test - pytest_runtest_teardown: Test teardown
