2025-11-14 10:10:17,575 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:10:17,576 - INFO - ya.test - pytest_runtest_setup: test_convert[v1-client0-csv_with_names-json_list]
2025-11-14 10:10:17,576 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:10:17,576 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-14 10:10:17,666 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_statistics.py::TestS3, test_name: test_convert[v1-client0-csv_with_names-json_list])
2025-11-14 10:10:17,667 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7ff27a920dd0>
2025-11-14 10:10:17,670 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7ff27aa30ad0>
2025-11-14 10:10:17,670 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7ff267c97590>
2025-11-14 10:10:17,670 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7ff27aa307d0>
2025-11-14 10:10:17,674 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:10:17,681 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:10:17,682 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:10:17,683 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-14 10:10:17,685 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-14 10:10:17,686 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-14 10:10:17,687 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb0050>
2025-11-14 10:10:17,688 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'convert_bucket', 'ACL': 'public-read-write'}
2025-11-14 10:10:17,689 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:10:17,689 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:10:17,689 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:17,689 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:10:17,689 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:10:17,690 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:17,690 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'convert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:17,691 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/convert_bucket
2025-11-14 10:10:17,691 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:17,691 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:17,692 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:10:17,692 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:10:17,692 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:10:17,692 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read-write', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/convert_bucket/', 'url': 'http://localhost:17732/convert_bucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff25df9b9e0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'convert_bucket', 'params': {'Bucket': 'convert_bucket', 'ACL': 'public-read-write'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:17,693 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff25df98600>>
2025-11-14 10:10:17,693 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff25e346d10>>
2025-11-14 10:10:17,693 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:10:17,694 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:10:17,694 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:17,694 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/convert_bucket

host:localhost:17732
x-amz-acl:public-read-write
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101017Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:17,694 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101017Z
20251114/yandex/s3/aws4_request
3b9a2c4e842d4e580429af6a211eb830ff7878ab1dc515ef69f84e1a4ff9e82c
2025-11-14 10:10:17,694 - DEBUG - botocore.auth - add_auth: Signature:
7bcddf91bd0857326fd4e8f3248a10c016f148eb768d70180a0513393a0ad407
2025-11-14 10:10:17,695 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:10:17,695 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:17732/convert_bucket, headers={'x-amz-acl': b'public-read-write', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101017Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=7bcddf91bd0857326fd4e8f3248a10c016f148eb768d70180a0513393a0ad407', 'amz-sdk-invocation-id': b'0ec6b51c-4c29-4cd5-ad81-bf7d12d5542e', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-14 10:10:17,707 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:17 GMT', 'x-amzn-requestid': 'iRYVsMDvnQl5EYgwNMzjL8InMcsS7411DDyOvh8tbIQXdZN7ITL5', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '168', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:17,707 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>convert_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-14 10:10:17,708 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff25d552360>
2025-11-14 10:10:17,709 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:17,709 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:17,709 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'iRYVsMDvnQl5EYgwNMzjL8InMcsS7411DDyOvh8tbIQXdZN7ITL5', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:10:17 GMT', 'x-amzn-requestid': 'iRYVsMDvnQl5EYgwNMzjL8InMcsS7411DDyOvh8tbIQXdZN7ITL5', 'content-type': 'text/html; charset=utf-8', 'content-length': '168', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-14 10:10:17,709 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:10:17,758 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:10:17,790 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            insert into `h3082975171226233671_test_convertsbucket`.`json_list_1_csv_with_names_v1/` with (format=json_list)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "d1b23220-e9b0-44bc-b225-6b0262ead2fa"

2025-11-14 10:10:17,813 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej5ql1dqol9snq"

2025-11-14 10:10:17,825 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5ql1dqol9snq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115017
        nanos: 796157000
      }
      modified_at {
        seconds: 1763115017
        nanos: 796157000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej5ql1c8gtjuvp-ptqudsej5ql1dqol9snq"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115017
      nanos: 796157000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h3082975171226233671_test_convertsbucket`.`json_list_1_csv_with_names_v1/` with (format=json_list)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:10:18,341 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:18,858 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5ql1dqol9snq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115017
        nanos: 796157000
      }
      modified_at {
        seconds: 1763115017
        nanos: 796157000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115018
      nanos: 801000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej5ql1c8gtjuvp-ptqudsej5ql1dqol9snq"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115017
      nanos: 796157000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h3082975171226233671_test_convertsbucket`.`json_list_1_csv_with_names_v1/` with (format=json_list)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:10:19,396 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5ql1dqol9snq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115017
        nanos: 796157000
      }
      modified_at {
        seconds: 1763115017
        nanos: 796157000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115018
      nanos: 801000000
    }
    finished_at {
      seconds: 1763115019
      nanos: 80000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej5ql1c8gtjuvp-ptqudsej5ql1dqol9snq"
    result_expire_at {
      seconds: 1763201418
      nanos: 791389000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115017
      nanos: 796157000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h3082975171226233671_test_convertsbucket`.`json_list_1_csv_with_names_v1/` with (format=json_list)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"AsList\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.16s\",\"count\":1,\"avg\":\"0.16s\",\"max\":\"0.16s\",\"min\":\"0.16s\"},\"EgressBytes\":{\"sum\":49,\"count\":1,\"avg\":49,\"max\":49,\"min\":49},\"EgressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'\"s3\" \'\"h3082975171226233671_test_convertsbucket\"))\n(let $3 (S3SinkSettings \'\"json_list_1_csv_with_names_v1/\" \'() (SecureParam \'\"cluster:default_h3082975171226233671_test_convertsbucket\") \'\".json\" (StructType \'(\'\"bar\" (DataType \'Utf8)) \'(\'\"foo\" (DataType \'Int32)))))\n(return (Commit! (DqQuery! $1 \'((DqStage \'() (lambda \'() (S3SinkOutput (ToFlow (AsList (AsStruct \'(\'\"bar\" (Utf8 \'\"xxx\")) \'(\'\"foo\" (Int32 \'\"123\"))) (AsStruct \'(\'\"bar\" (Utf8 \'\"yyy\")) \'(\'\"foo\" (Int32 \'\"456\"))))) \'\"json_list\" \'() \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\")))) \'() \'((DqSink \'0 $2 $3))))) $2))\n)\n"
  }
}

2025-11-14 10:10:19,424 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:19,425 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            insert into `h3082975171226233671_test_convertsbucket`.`json_list_2_csv_with_names_v1/` with (format=csv_with_names)\n            select foo, bar from `h3082975171226233671_test_convertsbucket`.`json_list_1_csv_with_names_v1/*` with (format=json_list, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "7b79a4ec-4186-43c2-9e5d-5dc0003b00fd"

2025-11-14 10:10:19,487 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej5p2dlmdfk0uu"

2025-11-14 10:10:19,506 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5p2dlmdfk0uu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115019
        nanos: 454781000
      }
      modified_at {
        seconds: 1763115019
        nanos: 454781000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej5p2djmsfdvc1-ptqudsej5p2dlmdfk0uu"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115019
      nanos: 454781000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h3082975171226233671_test_convertsbucket`.`json_list_2_csv_with_names_v1/` with (format=csv_with_names)\n            select foo, bar from `h3082975171226233671_test_convertsbucket`.`json_list_1_csv_with_names_v1/*` with (format=json_list, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:10:20,036 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5p2dlmdfk0uu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115019
        nanos: 454781000
      }
      modified_at {
        seconds: 1763115019
        nanos: 454781000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115019
      nanos: 819000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej5p2djmsfdvc1-ptqudsej5p2dlmdfk0uu"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115019
      nanos: 454781000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h3082975171226233671_test_convertsbucket`.`json_list_2_csv_with_names_v1/` with (format=csv_with_names)\n            select foo, bar from `h3082975171226233671_test_convertsbucket`.`json_list_1_csv_with_names_v1/*` with (format=json_list, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 \'\"h3082975171226233671_test_convertsbucket\")\n(let $3 (DataSource \'\"s3\" $2))\n(let $4 \'\"Paths {\\n  Name: \\\"json_list_1_csv_with_names_v1\\\"\\n  Children {\\n    Name: \\\"ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json\\\"\\n    Size: 49\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (SecureParam \'\"cluster:default_h3082975171226233671_test_convertsbucket\"))\n(let $6 (S3SourceSettings $1 \'(\'((String $4) (Bool \'\"true\") (AsStruct))) $5 \'\"\" \'\"json_list_1_csv_with_names_v1/* \" (Void) (Void) (Void)))\n(let $7 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" (DataType \'Int32))))\n(let $8 (DqStage \'((DqSource $3 $6)) (lambda \'($11) (block \'(\n  (let $12 (DqSourceWideWrap $11 $3 $7 \'(\'(\'format \'\"json_list\") \'(\'settings \'()))))\n  (return (NarrowMap $12 (lambda \'($13 $14) (AsStruct \'(\'\"bar\" $13) \'(\'\"foo\" $14)))))\n))) \'(\'(\'\"_logical_id\" \'200034))))\n(let $9 (DataSink \'\"s3\" $2))\n(let $10 (S3SinkSettings \'\"json_list_2_csv_with_names_v1/\" \'(\'(\'\"multipart\" \'\"true\")) $5 \'\".csv\" $7))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqCnMap (TDqOutput $8 \'\"0\"))) (lambda \'($15) (block \'(\n  (let $16 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $15 \'\"csv_with_names\" \'() $16))\n))) \'() \'((DqSink \'\"0\" $9 $10))))) $9))\n)\n"
  }
}

2025-11-14 10:10:20,577 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5p2dlmdfk0uu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115019
        nanos: 454781000
      }
      modified_at {
        seconds: 1763115019
        nanos: 454781000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115019
      nanos: 819000000
    }
    finished_at {
      seconds: 1763115020
      nanos: 117000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej5p2djmsfdvc1-ptqudsej5p2dlmdfk0uu"
    result_expire_at {
      seconds: 1763201419
      nanos: 798327000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115019
      nanos: 454781000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h3082975171226233671_test_convertsbucket`.`json_list_2_csv_with_names_v1/` with (format=csv_with_names)\n            select foo, bar from `h3082975171226233671_test_convertsbucket`.`json_list_1_csv_with_names_v1/*` with (format=json_list, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.16s\",\"count\":2,\"avg\":\"80ms\",\"max\":\"0.11s\",\"min\":\"46ms\"},\"IngressBytes\":{\"sum\":49,\"count\":1,\"avg\":49,\"max\":49,\"min\":49},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"InputBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"InputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"OutputBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"OutputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"EgressBytes\":{\"sum\":32,\"count\":1,\"avg\":32,\"max\":32,\"min\":32},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":327680,\"count\":2,\"avg\":163840,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 \'\"h3082975171226233671_test_convertsbucket\")\n(let $3 (DataSource \'\"s3\" $2))\n(let $4 \'\"Paths {\\n  Name: \\\"json_list_1_csv_with_names_v1\\\"\\n  Children {\\n    Name: \\\"ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json\\\"\\n    Size: 49\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (SecureParam \'\"cluster:default_h3082975171226233671_test_convertsbucket\"))\n(let $6 (S3SourceSettings $1 \'(\'((String $4) (Bool \'\"true\") (AsStruct))) $5 \'\"\" \'\"json_list_1_csv_with_names_v1/* \" (Void) (Void) (Void)))\n(let $7 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" (DataType \'Int32))))\n(let $8 (DqStage \'((DqSource $3 $6)) (lambda \'($11) (block \'(\n  (let $12 (DqSourceWideWrap $11 $3 $7 \'(\'(\'format \'\"json_list\") \'(\'settings \'()))))\n  (return (NarrowMap $12 (lambda \'($13 $14) (AsStruct \'(\'\"bar\" $13) \'(\'\"foo\" $14)))))\n))) \'(\'(\'\"_logical_id\" \'200034))))\n(let $9 (DataSink \'\"s3\" $2))\n(let $10 (S3SinkSettings \'\"json_list_2_csv_with_names_v1/\" \'(\'(\'\"multipart\" \'\"true\")) $5 \'\".csv\" $7))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqCnMap (TDqOutput $8 \'\"0\"))) (lambda \'($15) (block \'(\n  (let $16 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $15 \'\"csv_with_names\" \'() $16))\n))) \'() \'((DqSink \'\"0\" $9 $10))))) $9))\n)\n"
  }
}

2025-11-14 10:10:20,606 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:20,606 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            select foo, bar from `h3082975171226233671_test_convertsbucket`.`json_list_2_csv_with_names_v1/*` with (format=csv_with_names, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "3a4e88fb-22fe-4520-b850-19131bad61e0"

2025-11-14 10:10:20,680 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej5nu8jid44658"

2025-11-14 10:10:20,747 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5nu8jid44658"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115020
        nanos: 639617000
      }
      modified_at {
        seconds: 1763115020
        nanos: 639617000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej5nu8hhncshsa-ptqudsej5nu8jid44658"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115020
      nanos: 639617000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select foo, bar from `h3082975171226233671_test_convertsbucket`.`json_list_2_csv_with_names_v1/*` with (format=csv_with_names, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:10:21,322 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej5nu8jid44658"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115020
        nanos: 639617000
      }
      modified_at {
        seconds: 1763115020
        nanos: 639617000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115020
      nanos: 840000000
    }
    finished_at {
      seconds: 1763115021
      nanos: 121000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej5nu8hhncshsa-ptqudsej5nu8jid44658"
    result_expire_at {
      seconds: 1763201420
      nanos: 821729000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115020
      nanos: 639617000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select foo, bar from `h3082975171226233671_test_convertsbucket`.`json_list_2_csv_with_names_v1/*` with (format=csv_with_names, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"70ms\",\"count\":2,\"avg\":\"35ms\",\"max\":\"67ms\",\"min\":\"3ms\"},\"IngressBytes\":{\"sum\":32,\"count\":1,\"avg\":32,\"max\":32,\"min\":32},\"IngressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"InputBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"InputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"OutputBytes\":{\"sum\":34,\"count\":2,\"avg\":17,\"max\":17,\"min\":17},\"OutputRows\":{\"sum\":4,\"count\":2,\"avg\":2,\"max\":2,\"min\":2},\"ResultBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"ResultRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "foo"
      type {
        type_id: INT32
      }
    }
    column {
      name: "bar"
      type {
        type_id: STRING
      }
    }
    rows_count: 2
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h3082975171226233671_test_convertsbucket\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 \'\"Paths {\\n  Name: \\\"json_list_2_csv_with_names_v1\\\"\\n  Children {\\n    Name: \\\"ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv\\\"\\n    Size: 32\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $6 (Bool \'\"true\"))\n(let $7 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" (DataType \'Int32))))\n(let $8 (S3ParseSettings world \'(\'((String $5) $6 (AsStruct))) (SecureParam \'\"cluster:default_h3082975171226233671_test_convertsbucket\") \'\"\" \'\"json_list_2_csv_with_names_v1/* \" \'\"csv_with_names\" $7 (lambda \'($13) $6) \'()))\n(let $9 (DqStage \'((DqSource $4 $8)) (lambda \'($14) (block \'(\n  (let $15 (DqSourceWideWrap $14 $4 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $15 (lambda \'($16 $17) (AsStruct \'(\'\"bar\" $16) \'(\'\"foo\" $17)))))\n))) \'(\'(\'\"_logical_id\" \'200046))))\n(let $10 (DqStage \'((DqCnUnionAll (TDqOutput $9 \'\"0\"))) (lambda \'($18) $18) \'(\'(\'\"_logical_id\" \'200085))))\n(let $11 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"foo\" \'\"bar\"))))\n(let $12 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $10 \'\"0\") \'()) $11 \'\"dq\"))\n(return (Commit! (Commit! $12 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-14 10:10:21,372 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:21,373 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'convert_bucket'}
2025-11-14 10:10:21,374 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7ff27a944590>
2025-11-14 10:10:21,375 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:10:21,375 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:10:21,375 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,375 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:10:21,376 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:10:21,376 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,376 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'convert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:21,389 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/convert_bucket
2025-11-14 10:10:21,389 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:21,389 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:21,390 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:10:21,391 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:10:21,391 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:10:21,391 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/convert_bucket/', 'url': 'http://localhost:17732/convert_bucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff25df9b9e0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'convert_bucket', 'params': {'Bucket': 'convert_bucket', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:21,398 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff25df98600>>
2025-11-14 10:10:21,399 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff25e346d10>>
2025-11-14 10:10:21,400 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:10:21,400 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:10:21,401 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:21,401 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/convert_bucket
encoding-type=url
host:localhost:17732
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101021Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:21,401 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101021Z
20251114/yandex/s3/aws4_request
4bf6f21a15c9e217b23ff914f59569347e58d28e48922f12b8d6778f12ceadaf
2025-11-14 10:10:21,401 - DEBUG - botocore.auth - add_auth: Signature:
62f2ac486881ac9f5396cf296ad64a12d83c78d406d3e8343ad297bb11334e1d
2025-11-14 10:10:21,410 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:10:21,411 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:17732/convert_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101021Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=62f2ac486881ac9f5396cf296ad64a12d83c78d406d3e8343ad297bb11334e1d', 'amz-sdk-invocation-id': b'd84db284-0788-4b0e-82c2-ab3a9a17e3a3', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:10:21,424 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:21 GMT', 'x-amzn-requestid': 'YHmM5d3eRXivDDBLAMA0vSbhLylN6hiPs3f67mSr4xXhSzPWlP73', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '7494', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:21,424 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>convert_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>csv_with_names_1_json_each_row_v1/ptjudsej61bq16mitcfv_0_YymHq9I7vkuA7yF6EQZHMaBojyNEsMsJ.csv</Key><LastModified>2025-11-14T10:10:10.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_1_json_list_v1/ptjudsej6f4mq3ofger2_0_RpkP3RPVvEuYM9P1XEgMQxH31YkeTBox.csv</Key><LastModified>2025-11-14T10:09:57.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_2_json_each_row_v1/ptjudsej60qh43o29u4m_0_jbKaxQmkxkKD7tedPjnGYjoxmKTCPyRl.json</Key><LastModified>2025-11-14T10:10:11.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_2_json_list_v1/ptjudsej6dvvep02h1s8_0_gaGqE2CGCk65N4UcSaZaApqrko1vxluh.json</Key><LastModified>2025-11-14T10:09:58.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_1_json_each_row_v1/ptjudsej64c5n97p4fc0_0_R2bQEs0T90SgUcIQVSnWwFILmxI9yeY0.json</Key><LastModified>2025-11-14T10:10:07.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_1_json_list_v1/ptjudsej6j2cod0e3cpn_0_eZCYAmsnTEyk0ylaOl7GCWHt9Wo8lDzi.json</Key><LastModified>2025-11-14T10:09:52.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_2_json_each_row_v1/ptjudsej63qu22svkcbv_0_VVUyomz6HESd_a5ExWbfNO_FRCYGJbkT.json</Key><LastModified>2025-11-14T10:10:08.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_2_json_list_v1/ptjudsej6hu3aon91gut_0_hpaBSL2cxU2DPkPVXHJCwEylclkMMgkE.json</Key><LastModified>2025-11-14T10:09:54.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json</Key><LastModified>2025-11-14T10:10:19.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_1_json_each_row_v1/ptjudsej67stcg82h843_0_Tx4aWkuvGkSNn4fyRGfB5qxqCl47o_Uz.json</Key><LastModified>2025-11-14T10:10:05.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_1_json_list_v1/ptjudsej6nkfr9ccvecr_0_gP21NAdG0kmKVR44i64j7iQwHT9GP48U.json</Key><LastModified>2025-11-14T10:09:48.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv</Key><LastModified>2025-11-14T10:10:20.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_2_json_each_row_v1/ptjudsej66b3ao9si7fc_0_cTBSvFt44UKlpZXQc3xgkt8ZuG9J2L_N.json</Key><LastModified>2025-11-14T10:10:06.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_2_json_list_v1/ptjudsej6mi5mshimsvp_0_j5f3kTuYu0a5mca7ZiIwIdaHbBrZzp3l.json</Key><LastModified>2025-11-14T10:09:49.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_1_json_each_row_v1/ptjudsej5u734i6bf0c0_0_NXmnswUZtUK-XYjr0-qxzvxSHzepDuNJ.parquet</Key><LastModified>2025-11-14T10:10:15.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_1_json_list_v1/ptjudsej6boko76he36u_0_qTC-l79s_EeLz8f8MGn7Hgs7pLbT3TZW.parquet</Key><LastModified>2025-11-14T10:10:01.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_2_json_each_row_v1/ptjudsej5t3cilnnjovo_0_cH7YWCtb406GRY59MQiSxjStGdkF3_of.json</Key><LastModified>2025-11-14T10:10:15.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_2_json_list_v1/ptjudsej6a63vugj9fn1_0_lWElX8x2bU69QInO-GTm2o-ke1IAVC37.json</Key><LastModified>2025-11-14T10:10:02.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-14 10:10:21,439 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff25d552360>
2025-11-14 10:10:21,440 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:21,440 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,441 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7ff27a944650>
2025-11-14 10:10:21,441 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-14 10:10:21,442 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-14 10:10:21,443 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb01d0>
2025-11-14 10:10:21,445 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Object
2025-11-14 10:10:21,448 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Object: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb0110>
2025-11-14 10:10:21,451 - DEBUG - boto3.resources.action - __call__: Calling s3:head_object with {'Bucket': 'convert_bucket', 'Key': 'json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json'}
2025-11-14 10:10:21,453 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function sse_md5 at 0x7ff27a922d50>
2025-11-14 10:10:21,453 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:10:21,453 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:10:21,454 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,455 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:10:21,457 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:10:21,457 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,458 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'convert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:21,458 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/convert_bucket
2025-11-14 10:10:21,458 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:21,459 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:21,460 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:10:21,462 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:10:21,462 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:10:21,463 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=HeadObject) with params: {'url_path': '/json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json', 'query_string': {}, 'method': 'HEAD', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/convert_bucket/json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json', 'url': 'http://localhost:17732/convert_bucket/json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff25df9b9e0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'convert_bucket', 'params': {'Bucket': 'convert_bucket', 'Key': 'json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:21,464 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff25df98600>>
2025-11-14 10:10:21,467 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff25e346d10>>
2025-11-14 10:10:21,467 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:10:21,468 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.HeadObject: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:10:21,468 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:21,469 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
HEAD
/convert_bucket/json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json

host:localhost:17732
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101021Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:21,469 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101021Z
20251114/yandex/s3/aws4_request
30126f2fbdf0b3fa225a3ae4dbc951c82a09220345e0673dcd512a8dc7fb5a82
2025-11-14 10:10:21,469 - DEBUG - botocore.auth - add_auth: Signature:
21d0db33121a7f1293f36abf1ba4e97c330216c96041f0cffbc3da79b299e4d7
2025-11-14 10:10:21,469 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:10:21,470 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=HEAD, url=http://localhost:17732/convert_bucket/json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101021Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=21d0db33121a7f1293f36abf1ba4e97c330216c96041f0cffbc3da79b299e4d7', 'amz-sdk-invocation-id': b'8eff138a-f3a4-427b-a581-06f465bb7bcd', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:10:21,579 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:21 GMT', 'content-type': 'binary/octet-stream', 'ETag': '"cbb9a78213607d6448a6602cba86e5cb"', 'last-modified': 'Fri, 14 Nov 2025 10:10:19 GMT', 'Content-Length': '49', 'x-amzn-requestid': 'm31cuouzC7a5ZNagmspfikmOnz253H6t4EXFJuFyxPq9tRZsqYeN', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:21,580 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:10:21,581 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff25d552360>
2025-11-14 10:10:21,581 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:21,586 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,587 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'm31cuouzC7a5ZNagmspfikmOnz253H6t4EXFJuFyxPq9tRZsqYeN', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:10:21 GMT', 'content-type': 'binary/octet-stream', 'etag': '"cbb9a78213607d6448a6602cba86e5cb"', 'last-modified': 'Fri, 14 Nov 2025 10:10:19 GMT', 'content-length': '49', 'x-amzn-requestid': 'm31cuouzC7a5ZNagmspfikmOnz253H6t4EXFJuFyxPq9tRZsqYeN', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'LastModified': datetime.datetime(2025, 11, 14, 10, 10, 19, tzinfo=tzutc()), 'ContentLength': 49, 'ETag': '"cbb9a78213607d6448a6602cba86e5cb"', 'ContentType': 'binary/octet-stream', 'Metadata': {}}
2025-11-14 10:10:21,587 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Object
2025-11-14 10:10:21,591 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Object: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb0110>
2025-11-14 10:10:21,591 - DEBUG - boto3.resources.action - __call__: Calling s3:head_object with {'Bucket': 'convert_bucket', 'Key': 'json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv'}
2025-11-14 10:10:21,592 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function sse_md5 at 0x7ff27a922d50>
2025-11-14 10:10:21,592 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:10:21,592 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:10:21,593 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,593 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:10:21,593 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:10:21,593 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,594 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'convert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:21,594 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/convert_bucket
2025-11-14 10:10:21,594 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:21,594 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:21,595 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:10:21,595 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:10:21,595 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:10:21,596 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=HeadObject) with params: {'url_path': '/json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv', 'query_string': {}, 'method': 'HEAD', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/convert_bucket/json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv', 'url': 'http://localhost:17732/convert_bucket/json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff25df9b9e0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'convert_bucket', 'params': {'Bucket': 'convert_bucket', 'Key': 'json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:21,596 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff25df98600>>
2025-11-14 10:10:21,596 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff25e346d10>>
2025-11-14 10:10:21,596 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:10:21,596 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.HeadObject: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:10:21,597 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:21,597 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
HEAD
/convert_bucket/json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv

host:localhost:17732
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101021Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:21,597 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101021Z
20251114/yandex/s3/aws4_request
c66851cd75206ee909cf0708fd59f680c6d2288218f3d4cd063633e28192a06a
2025-11-14 10:10:21,598 - DEBUG - botocore.auth - add_auth: Signature:
9660d7b28226369d56322a6a12cb8ae119e48926389a42a3956608d45c01fdeb
2025-11-14 10:10:21,598 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:10:21,598 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=HEAD, url=http://localhost:17732/convert_bucket/json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101021Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=9660d7b28226369d56322a6a12cb8ae119e48926389a42a3956608d45c01fdeb', 'amz-sdk-invocation-id': b'357120ac-ff3e-423a-81e3-0dc5e6e5a078', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:10:21,608 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:21 GMT', 'content-type': 'binary/octet-stream', 'ETag': '"b11a078e95b84e19937572f9018e592d"', 'last-modified': 'Fri, 14 Nov 2025 10:10:20 GMT', 'Content-Length': '32', 'x-amzn-requestid': 'QQ1Rbh0iiDaxVeAAYrlTcGCyWLBDxHLA3MGCQfuvrN7b15NWG8Qa', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:21,609 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:10:21,610 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff25d552360>
2025-11-14 10:10:21,610 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:21,611 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25df99050>>
2025-11-14 10:10:21,611 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'QQ1Rbh0iiDaxVeAAYrlTcGCyWLBDxHLA3MGCQfuvrN7b15NWG8Qa', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:10:21 GMT', 'content-type': 'binary/octet-stream', 'etag': '"b11a078e95b84e19937572f9018e592d"', 'last-modified': 'Fri, 14 Nov 2025 10:10:20 GMT', 'content-length': '32', 'x-amzn-requestid': 'QQ1Rbh0iiDaxVeAAYrlTcGCyWLBDxHLA3MGCQfuvrN7b15NWG8Qa', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'LastModified': datetime.datetime(2025, 11, 14, 10, 10, 20, tzinfo=tzutc()), 'ContentLength': 32, 'ETag': '"b11a078e95b84e19937572f9018e592d"', 'ContentType': 'binary/octet-stream', 'Metadata': {}}
2025-11-14 10:10:21,615 - INFO - ya.test - pytest_runtest_teardown: Test teardown
