2025-11-14 10:10:43,915 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:10:43,916 - INFO - ya.test - pytest_runtest_setup: test_convert[v1-client0-parquet-csv_with_names]
2025-11-14 10:10:43,916 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:10:43,916 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-14 10:10:44,041 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_statistics.py::TestS3, test_name: test_convert[v1-client0-parquet-csv_with_names])
2025-11-14 10:10:44,051 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7ff27a920dd0>
2025-11-14 10:10:44,055 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7ff27aa30ad0>
2025-11-14 10:10:44,055 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7ff267c97590>
2025-11-14 10:10:44,056 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7ff27aa307d0>
2025-11-14 10:10:44,064 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:10:44,073 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:10:44,074 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:10:44,075 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-14 10:10:44,077 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-14 10:10:44,078 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-14 10:10:44,080 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb0050>
2025-11-14 10:10:44,080 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'convert_bucket', 'ACL': 'public-read-write'}
2025-11-14 10:10:44,081 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:10:44,081 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:10:44,082 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:44,082 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:10:44,082 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:10:44,082 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:44,083 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'convert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:44,084 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/convert_bucket
2025-11-14 10:10:44,085 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:44,085 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:44,086 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:10:44,086 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:10:44,086 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:10:44,087 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read-write', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/convert_bucket/', 'url': 'http://localhost:17732/convert_bucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff265dedcd0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'convert_bucket', 'params': {'Bucket': 'convert_bucket', 'ACL': 'public-read-write'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:44,088 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff265ded640>>
2025-11-14 10:10:44,088 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff260d76590>>
2025-11-14 10:10:44,088 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:10:44,089 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:10:44,090 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:44,090 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/convert_bucket

host:localhost:17732
x-amz-acl:public-read-write
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101044Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:44,090 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101044Z
20251114/yandex/s3/aws4_request
4bcdc1d5d0c21a9e47dcec4ee12a5b6ee30fbc011d165bdcc20a37e4175298ba
2025-11-14 10:10:44,090 - DEBUG - botocore.auth - add_auth: Signature:
1b71db350da497d8d7045f5da808b24c7272c598c4df2afd2b1e659af967a391
2025-11-14 10:10:44,091 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:10:44,091 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:17732/convert_bucket, headers={'x-amz-acl': b'public-read-write', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101044Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=1b71db350da497d8d7045f5da808b24c7272c598c4df2afd2b1e659af967a391', 'amz-sdk-invocation-id': b'816b0f13-fabe-4c97-999f-a1c562341c2c', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-14 10:10:44,104 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:44 GMT', 'x-amzn-requestid': 'WnaZ8IrKCKCRkDsGlNf7MXhQmrq6o5QSjzpT9zBSK5xMEOCxcHgz', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '168', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:44,104 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>convert_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-14 10:10:44,106 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff263db50a0>
2025-11-14 10:10:44,106 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:44,106 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:44,107 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'WnaZ8IrKCKCRkDsGlNf7MXhQmrq6o5QSjzpT9zBSK5xMEOCxcHgz', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:10:44 GMT', 'x-amzn-requestid': 'WnaZ8IrKCKCRkDsGlNf7MXhQmrq6o5QSjzpT9zBSK5xMEOCxcHgz', 'content-type': 'text/html; charset=utf-8', 'content-length': '168', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-14 10:10:44,107 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:10:44,155 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:10:44,199 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            insert into `h1408148362637437782_test_convertsbucket`.`csv_with_names_1_parquet_v1/` with (format=csv_with_names)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "6fb749dd-c192-424b-9018-3dc8854fe7b4"

2025-11-14 10:10:44,226 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej51f0jhl2e70p"

2025-11-14 10:10:44,237 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej51f0jhl2e70p"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115044
        nanos: 208004000
      }
      modified_at {
        seconds: 1763115044
        nanos: 208004000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej51f0hf0un4p5-ptqudsej51f0jhl2e70p"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115044
      nanos: 208004000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h1408148362637437782_test_convertsbucket`.`csv_with_names_1_parquet_v1/` with (format=csv_with_names)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:10:44,798 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:45,309 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej51f0jhl2e70p"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115044
        nanos: 208004000
      }
      modified_at {
        seconds: 1763115044
        nanos: 208004000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115044
      nanos: 888000000
    }
    finished_at {
      seconds: 1763115045
      nanos: 133000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej51f0hf0un4p5-ptqudsej51f0jhl2e70p"
    result_expire_at {
      seconds: 1763201444
      nanos: 858994000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115044
      nanos: 208004000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h1408148362637437782_test_convertsbucket`.`csv_with_names_1_parquet_v1/` with (format=csv_with_names)\n            select * from AS_TABLE([<|foo:123, bar:\"xxx\"u|>,<|foo:456, bar:\"yyy\"u|>]);\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsStruct\"},{\"Name\":\"AsList\"},{\"Name\":\"ToFlow\"},{\"Name\":\"S3SinkOutput\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"85ms\",\"count\":1,\"avg\":\"85ms\",\"max\":\"85ms\",\"min\":\"85ms\"},\"EgressBytes\":{\"sum\":32,\"count\":1,\"avg\":32,\"max\":32,\"min\":32},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'\"s3\" \'\"h1408148362637437782_test_convertsbucket\"))\n(let $3 (S3SinkSettings \'\"csv_with_names_1_parquet_v1/\" \'(\'(\'\"multipart\" \'\"true\")) (SecureParam \'\"cluster:default_h1408148362637437782_test_convertsbucket\") \'\".csv\" (StructType \'(\'\"bar\" (DataType \'Utf8)) \'(\'\"foo\" (DataType \'Int32)))))\n(return (Commit! (DqQuery! $1 \'((DqStage \'() (lambda \'() (block \'(\n  (let $4 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput (ToFlow (AsList (AsStruct \'(\'\"bar\" (Utf8 \'\"xxx\")) \'(\'\"foo\" (Int32 \'\"123\"))) (AsStruct \'(\'\"bar\" (Utf8 \'\"yyy\")) \'(\'\"foo\" (Int32 \'\"456\"))))) \'\"csv_with_names\" \'() $4))\n))) \'() \'((DqSink \'0 $2 $3))))) $2))\n)\n"
  }
}

2025-11-14 10:10:45,321 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:45,321 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            insert into `h1408148362637437782_test_convertsbucket`.`csv_with_names_2_parquet_v1/` with (format=parquet)\n            select foo, bar from `h1408148362637437782_test_convertsbucket`.`csv_with_names_1_parquet_v1/*` with (format=csv_with_names, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "b82e2b9a-daf2-4203-9b4f-95657f5efb0f"

2025-11-14 10:10:45,342 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej50cs17lbp0sm"

2025-11-14 10:10:45,353 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej50cs17lbp0sm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115045
        nanos: 326798000
      }
      modified_at {
        seconds: 1763115045
        nanos: 326798000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej50crvmhiotii-ptqudsej50cs17lbp0sm"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115045
      nanos: 326798000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h1408148362637437782_test_convertsbucket`.`csv_with_names_2_parquet_v1/` with (format=parquet)\n            select foo, bar from `h1408148362637437782_test_convertsbucket`.`csv_with_names_1_parquet_v1/*` with (format=csv_with_names, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:10:45,894 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:46,411 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej50cs17lbp0sm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115045
        nanos: 326798000
      }
      modified_at {
        seconds: 1763115045
        nanos: 326798000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115045
      nanos: 862000000
    }
    finished_at {
      seconds: 1763115046
      nanos: 144000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej50crvmhiotii-ptqudsej50cs17lbp0sm"
    result_expire_at {
      seconds: 1763201445
      nanos: 849980000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115045
      nanos: 326798000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            insert into `h1408148362637437782_test_convertsbucket`.`csv_with_names_2_parquet_v1/` with (format=parquet)\n            select foo, bar from `h1408148362637437782_test_convertsbucket`.`csv_with_names_1_parquet_v1/*` with (format=csv_with_names, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"ExpandMap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideToBlocks\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.16s\",\"count\":2,\"avg\":\"81ms\",\"max\":\"0.10s\",\"min\":\"57ms\"},\"IngressBytes\":{\"sum\":32,\"count\":1,\"avg\":32,\"max\":32,\"min\":32},\"IngressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"InputBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"InputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"OutputBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"OutputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"EgressBytes\":{\"sum\":533,\"count\":1,\"avg\":533,\"max\":533,\"min\":533},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":999744,\"count\":2,\"avg\":499872,\"max\":868672,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 \'\"h1408148362637437782_test_convertsbucket\")\n(let $3 (DataSource \'\"s3\" $2))\n(let $4 \'\"Paths {\\n  Name: \\\"csv_with_names_1_parquet_v1\\\"\\n  Children {\\n    Name: \\\"ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv\\\"\\n    Size: 32\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_h1408148362637437782_test_convertsbucket\"))\n(let $7 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $1 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"csv_with_names_1_parquet_v1/* \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15 $16) (AsStruct \'(\'\"bar\" $15) \'(\'\"foo\" $16)))))\n))) \'(\'(\'\"_logical_id\" \'200031))))\n(let $10 (DataSink \'\"s3\" $2))\n(let $11 (S3SinkSettings \'\"csv_with_names_2_parquet_v1/\" \'(\'(\'\"multipart\" \'\"true\") \'(\'\"block_output\" \'\"true\")) $6 \'\".parquet\" $7))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($17) (block \'(\n  (let $18 (lambda \'($19) (Member $19 \'\"bar\") (Member $19 \'\"foo\")))\n  (return (WideToBlocks (FromFlow (ExpandMap $17 $18))))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-14 10:10:46,427 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:46,428 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            select foo, bar from `h1408148362637437782_test_convertsbucket`.`csv_with_names_2_parquet_v1/*` with (format=parquet, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "58d0c5b2-84f6-43bf-bb66-cd132351dc41"

2025-11-14 10:10:46,477 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej4vatmtk27n9k"

2025-11-14 10:10:46,495 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej4vatmtk27n9k"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115046
        nanos: 439190000
      }
      modified_at {
        seconds: 1763115046
        nanos: 439190000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej4vatkkkqki5s-ptqudsej4vatmtk27n9k"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115046
      nanos: 439190000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select foo, bar from `h1408148362637437782_test_convertsbucket`.`csv_with_names_2_parquet_v1/*` with (format=parquet, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:10:47,015 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej4vatmtk27n9k"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115046
        nanos: 439190000
      }
      modified_at {
        seconds: 1763115046
        nanos: 439190000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115046
      nanos: 867000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej4vatkkkqki5s-ptqudsej4vatmtk27n9k"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115046
      nanos: 439190000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select foo, bar from `h1408148362637437782_test_convertsbucket`.`csv_with_names_2_parquet_v1/*` with (format=parquet, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h1408148362637437782_test_convertsbucket\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 \'\"Paths {\\n  Name: \\\"csv_with_names_2_parquet_v1\\\"\\n  Children {\\n    Name: \\\"ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet\\\"\\n    Size: 533\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $6 (Bool \'\"true\"))\n(let $7 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" (DataType \'Int32))))\n(let $8 (S3ParseSettings world \'(\'((String $5) $6 (AsStruct))) (SecureParam \'\"cluster:default_h1408148362637437782_test_convertsbucket\") \'\"\" \'\"csv_with_names_2_parquet_v1/* \" \'\"parquet\" $7 (lambda \'($13) $6) \'()))\n(let $9 (DqStage \'((DqSource $4 $8)) (lambda \'($14) (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $14 $4 $7 \'(\'(\'format \'\"parquet\")))))) (lambda \'($15 $16) (AsStruct \'(\'\"bar\" $15) \'(\'\"foo\" $16))))) \'(\'(\'\"_logical_id\" \'200049))))\n(let $10 (DqStage \'((DqCnUnionAll (TDqOutput $9 \'\"0\"))) (lambda \'($17) $17) \'(\'(\'\"_logical_id\" \'200091))))\n(let $11 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"foo\" \'\"bar\"))))\n(let $12 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $10 \'\"0\") \'()) $11 \'\"dq\"))\n(return (Commit! (Commit! $12 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-14 10:10:47,527 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej4vatmtk27n9k"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115046
        nanos: 439190000
      }
      modified_at {
        seconds: 1763115046
        nanos: 439190000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115046
      nanos: 867000000
    }
    finished_at {
      seconds: 1763115047
      nanos: 150000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudsej4vatkkkqki5s-ptqudsej4vatmtk27n9k"
    result_expire_at {
      seconds: 1763201446
      nanos: 857400000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115046
      nanos: 439190000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select foo, bar from `h1408148362637437782_test_convertsbucket`.`csv_with_names_2_parquet_v1/*` with (format=parquet, schema(\n                foo Int NOT NULL,\n                bar String NOT NULL\n            ))\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideBlockWrap\"},{\"Name\":\"FromFlow\"},{\"Name\":\"WideFromBlocks\"},{\"Name\":\"ToFlow\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"96ms\",\"count\":2,\"avg\":\"48ms\",\"max\":\"94ms\",\"min\":\"2ms\"},\"IngressBytes\":{\"sum\":735,\"count\":1,\"avg\":735,\"max\":735,\"min\":735},\"IngressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"InputBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"InputRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"OutputBytes\":{\"sum\":34,\"count\":2,\"avg\":17,\"max\":17,\"min\":17},\"OutputRows\":{\"sum\":4,\"count\":2,\"avg\":2,\"max\":2,\"min\":2},\"ResultBytes\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"ResultRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "foo"
      type {
        type_id: INT32
      }
    }
    column {
      name: "bar"
      type {
        type_id: STRING
      }
    }
    rows_count: 2
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 \'\"h1408148362637437782_test_convertsbucket\")\n(let $4 (DataSource \'\"s3\" $3))\n(let $5 \'\"Paths {\\n  Name: \\\"csv_with_names_2_parquet_v1\\\"\\n  Children {\\n    Name: \\\"ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet\\\"\\n    Size: 533\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $6 (Bool \'\"true\"))\n(let $7 (StructType \'(\'\"bar\" (DataType \'String)) \'(\'\"foo\" (DataType \'Int32))))\n(let $8 (S3ParseSettings world \'(\'((String $5) $6 (AsStruct))) (SecureParam \'\"cluster:default_h1408148362637437782_test_convertsbucket\") \'\"\" \'\"csv_with_names_2_parquet_v1/* \" \'\"parquet\" $7 (lambda \'($13) $6) \'()))\n(let $9 (DqStage \'((DqSource $4 $8)) (lambda \'($14) (NarrowMap (ToFlow (WideFromBlocks (FromFlow (DqSourceWideBlockWrap $14 $4 $7 \'(\'(\'format \'\"parquet\")))))) (lambda \'($15 $16) (AsStruct \'(\'\"bar\" $15) \'(\'\"foo\" $16))))) \'(\'(\'\"_logical_id\" \'200049))))\n(let $10 (DqStage \'((DqCnUnionAll (TDqOutput $9 \'\"0\"))) (lambda \'($17) $17) \'(\'(\'\"_logical_id\" \'200091))))\n(let $11 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"foo\" \'\"bar\"))))\n(let $12 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $10 \'\"0\") \'()) $11 \'\"dq\"))\n(return (Commit! (Commit! $12 $2) (DataSink \'\"s3\" $3)))\n)\n"
  }
}

2025-11-14 10:10:47,548 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:10:47,558 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'convert_bucket'}
2025-11-14 10:10:47,559 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7ff27a944590>
2025-11-14 10:10:47,560 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:10:47,560 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:10:47,560 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,560 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:10:47,561 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:10:47,561 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,561 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'convert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:47,563 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/convert_bucket
2025-11-14 10:10:47,563 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:47,564 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:47,565 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:10:47,565 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:10:47,565 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:10:47,565 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/convert_bucket/', 'url': 'http://localhost:17732/convert_bucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff265dedcd0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'convert_bucket', 'params': {'Bucket': 'convert_bucket', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:47,567 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff265ded640>>
2025-11-14 10:10:47,567 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff260d76590>>
2025-11-14 10:10:47,567 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:10:47,568 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:10:47,568 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:47,569 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/convert_bucket
encoding-type=url
host:localhost:17732
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101047Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:47,569 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101047Z
20251114/yandex/s3/aws4_request
0b3ed8990cdf7af0fd70becd03ef46f9819fe1784a51acc125c86bcf03e948ab
2025-11-14 10:10:47,569 - DEBUG - botocore.auth - add_auth: Signature:
f6de2981bd65c52a92dee79dcca898398cf39ad67fc422e701d100bb7a963597
2025-11-14 10:10:47,569 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:10:47,570 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:17732/convert_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101047Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=f6de2981bd65c52a92dee79dcca898398cf39ad67fc422e701d100bb7a963597', 'amz-sdk-invocation-id': b'64abffab-11c2-42c3-a11b-d82796d5818e', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:10:47,578 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:47 GMT', 'x-amzn-requestid': '0LvdI0wN8nnNvD6vFewoza3NuSNFkzjRjck3HDSvM4GHAeNpLfsn', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '12343', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:47,579 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>convert_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>csv_with_names_1_csv_with_names_v1/ptjudsej5imrgh0t7500_0_QMMJZwCRoEuBVbFHxHdJZI6Lfp5_yMEV.csv</Key><LastModified>2025-11-14T10:10:27.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_1_json_each_row_v1/ptjudsej61bq16mitcfv_0_YymHq9I7vkuA7yF6EQZHMaBojyNEsMsJ.csv</Key><LastModified>2025-11-14T10:10:10.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_1_json_list_v1/ptjudsej6f4mq3ofger2_0_RpkP3RPVvEuYM9P1XEgMQxH31YkeTBox.csv</Key><LastModified>2025-11-14T10:09:57.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_1_parquet_v1/ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv</Key><LastModified>2025-11-14T10:10:45.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_2_csv_with_names_v1/ptjudsej5hgsrfobh8po_0_H8pVDxVcx0OdHyVkOC5JTOM7EvF_wYMY.csv</Key><LastModified>2025-11-14T10:10:28.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_2_json_each_row_v1/ptjudsej60qh43o29u4m_0_jbKaxQmkxkKD7tedPjnGYjoxmKTCPyRl.json</Key><LastModified>2025-11-14T10:10:11.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_2_json_list_v1/ptjudsej6dvvep02h1s8_0_gaGqE2CGCk65N4UcSaZaApqrko1vxluh.json</Key><LastModified>2025-11-14T10:09:58.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>csv_with_names_2_parquet_v1/ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet</Key><LastModified>2025-11-14T10:10:46.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_1_csv_with_names_v1/ptjudsej5mhru67ritp7_0_QpYnbOOcYEW-o8WD77ppgLLGNe36k249.json</Key><LastModified>2025-11-14T10:10:23.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_1_json_each_row_v1/ptjudsej64c5n97p4fc0_0_R2bQEs0T90SgUcIQVSnWwFILmxI9yeY0.json</Key><LastModified>2025-11-14T10:10:07.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_1_json_list_v1/ptjudsej6j2cod0e3cpn_0_eZCYAmsnTEyk0ylaOl7GCWHt9Wo8lDzi.json</Key><LastModified>2025-11-14T10:09:52.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_1_parquet_v1/ptjudsej56bi7ist0j35_0_5eO9jyrLUUqVJEkptvpRLMH4h4VI0w9W.json</Key><LastModified>2025-11-14T10:10:40.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_2_csv_with_names_v1/ptjudsej5lf5ve9hdcqi_0_rXIfiDG4Mkest58yBiSmIQuCLjXnYk_5.csv</Key><LastModified>2025-11-14T10:10:24.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_2_json_each_row_v1/ptjudsej63qu22svkcbv_0_VVUyomz6HESd_a5ExWbfNO_FRCYGJbkT.json</Key><LastModified>2025-11-14T10:10:08.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_2_json_list_v1/ptjudsej6hu3aon91gut_0_hpaBSL2cxU2DPkPVXHJCwEylclkMMgkE.json</Key><LastModified>2025-11-14T10:09:54.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_each_row_2_parquet_v1/ptjudsej54lgifcdq28h_0_0Dr_VZ0OckWstMCe5zIbxQHwh1ToQCoU.parquet</Key><LastModified>2025-11-14T10:10:42.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_1_csv_with_names_v1/ptjudsej5ql1c8gtjuvp_0_HkLrNwRmmkG-09WLQFJkjOCEbcXkLayT.json</Key><LastModified>2025-11-14T10:10:19.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_1_json_each_row_v1/ptjudsej67stcg82h843_0_Tx4aWkuvGkSNn4fyRGfB5qxqCl47o_Uz.json</Key><LastModified>2025-11-14T10:10:05.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_1_json_list_v1/ptjudsej6nkfr9ccvecr_0_gP21NAdG0kmKVR44i64j7iQwHT9GP48U.json</Key><LastModified>2025-11-14T10:09:48.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_1_parquet_v1/ptjudsej5bb79b1qh4tp_0_VqOsw1UVMkyGDyvWirDaYaiODx8-LnKJ.json</Key><LastModified>2025-11-14T10:10:35.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_2_csv_with_names_v1/ptjudsej5p2djmsfdvc1_0_0hb7JhXeKUOj50lzj8pZaHbPrF_ZYNzO.csv</Key><LastModified>2025-11-14T10:10:20.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_2_json_each_row_v1/ptjudsej66b3ao9si7fc_0_cTBSvFt44UKlpZXQc3xgkt8ZuG9J2L_N.json</Key><LastModified>2025-11-14T10:10:06.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_2_json_list_v1/ptjudsej6mi5mshimsvp_0_j5f3kTuYu0a5mca7ZiIwIdaHbBrZzp3l.json</Key><LastModified>2025-11-14T10:09:49.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>json_list_2_parquet_v1/ptjudsej59nj4l3h8qr3_0_38HWnDE1Fky15LWJzNES4YOpmpsSy0CL.parquet</Key><LastModified>2025-11-14T10:10:36.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_1_csv_with_names_v1/ptjudsej5ea86bmt2e54_0_JqvD4mzV7Em9Y1A1PtIxUH9SogCRDM0j.parquet</Key><LastModified>2025-11-14T10:10:31.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_1_json_each_row_v1/ptjudsej5u734i6bf0c0_0_NXmnswUZtUK-XYjr0-qxzvxSHzepDuNJ.parquet</Key><LastModified>2025-11-14T10:10:15.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_1_json_list_v1/ptjudsej6boko76he36u_0_qTC-l79s_EeLz8f8MGn7Hgs7pLbT3TZW.parquet</Key><LastModified>2025-11-14T10:10:01.000Z</LastModified><ETag>&#34;938ee549036fc083f3ad0112127f9622&#34;</ETag><Size>533</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_2_csv_with_names_v1/ptjudsej5dlsdo6t0c05_0_quZAorHPH0e2LYvBCmng6JWejbrkE6d_.csv</Key><LastModified>2025-11-14T10:10:32.000Z</LastModified><ETag>&#34;b11a078e95b84e19937572f9018e592d&#34;</ETag><Size>32</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_2_json_each_row_v1/ptjudsej5t3cilnnjovo_0_cH7YWCtb406GRY59MQiSxjStGdkF3_of.json</Key><LastModified>2025-11-14T10:10:15.000Z</LastModified><ETag>&#34;8c77c177a307b4819bb1a45e6b5aebac&#34;</ETag><Size>48</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents><Contents><Key>parquet_2_json_list_v1/ptjudsej6a63vugj9fn1_0_lWElX8x2bU69QInO-GTm2o-ke1IAVC37.json</Key><LastModified>2025-11-14T10:10:02.000Z</LastModified><ETag>&#34;cbb9a78213607d6448a6602cba86e5cb&#34;</ETag><Size>49</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-14 10:10:47,592 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff263db50a0>
2025-11-14 10:10:47,592 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:47,593 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,593 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7ff27a944650>
2025-11-14 10:10:47,594 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-14 10:10:47,594 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-14 10:10:47,595 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb01d0>
2025-11-14 10:10:47,597 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Object
2025-11-14 10:10:47,600 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Object: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb0110>
2025-11-14 10:10:47,601 - DEBUG - boto3.resources.action - __call__: Calling s3:head_object with {'Bucket': 'convert_bucket', 'Key': 'csv_with_names_1_parquet_v1/ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv'}
2025-11-14 10:10:47,602 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function sse_md5 at 0x7ff27a922d50>
2025-11-14 10:10:47,616 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:10:47,621 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:10:47,621 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,621 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:10:47,622 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:10:47,624 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,625 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'convert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:47,628 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/convert_bucket
2025-11-14 10:10:47,628 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:47,629 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:47,630 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:10:47,630 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:10:47,631 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:10:47,631 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=HeadObject) with params: {'url_path': '/csv_with_names_1_parquet_v1/ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv', 'query_string': {}, 'method': 'HEAD', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/convert_bucket/csv_with_names_1_parquet_v1/ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv', 'url': 'http://localhost:17732/convert_bucket/csv_with_names_1_parquet_v1/ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff265dedcd0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'convert_bucket', 'params': {'Bucket': 'convert_bucket', 'Key': 'csv_with_names_1_parquet_v1/ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:47,633 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff265ded640>>
2025-11-14 10:10:47,634 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff260d76590>>
2025-11-14 10:10:47,634 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:10:47,634 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.HeadObject: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:10:47,636 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:47,636 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
HEAD
/convert_bucket/csv_with_names_1_parquet_v1/ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv

host:localhost:17732
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101047Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:47,636 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101047Z
20251114/yandex/s3/aws4_request
54104cc3715117f6394556cab693116958160c8c227f15ea0a67db6b49088522
2025-11-14 10:10:47,636 - DEBUG - botocore.auth - add_auth: Signature:
43d0e66272d95890b4ac698961078ecd8f55b0c5782ec7f144ad7058e7cb66ea
2025-11-14 10:10:47,637 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:10:47,637 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=HEAD, url=http://localhost:17732/convert_bucket/csv_with_names_1_parquet_v1/ptjudsej51f0hf0un4p5_0_XT_zPzmq90KqSbHcJowh1-UqllQVHq9S.csv, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101047Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=43d0e66272d95890b4ac698961078ecd8f55b0c5782ec7f144ad7058e7cb66ea', 'amz-sdk-invocation-id': b'c7d6c8d6-cffc-4491-aeae-0c8e42f6f1e3', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:10:47,646 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:47 GMT', 'content-type': 'binary/octet-stream', 'ETag': '"b11a078e95b84e19937572f9018e592d"', 'last-modified': 'Fri, 14 Nov 2025 10:10:45 GMT', 'Content-Length': '32', 'x-amzn-requestid': 'vteJ9QbNhaBw0V4E8HiBiwN2O66xGeHEVujp8ZP0ml37POp6QSpI', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:47,646 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:10:47,648 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff263db50a0>
2025-11-14 10:10:47,649 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:47,649 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,650 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'vteJ9QbNhaBw0V4E8HiBiwN2O66xGeHEVujp8ZP0ml37POp6QSpI', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:10:47 GMT', 'content-type': 'binary/octet-stream', 'etag': '"b11a078e95b84e19937572f9018e592d"', 'last-modified': 'Fri, 14 Nov 2025 10:10:45 GMT', 'content-length': '32', 'x-amzn-requestid': 'vteJ9QbNhaBw0V4E8HiBiwN2O66xGeHEVujp8ZP0ml37POp6QSpI', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'LastModified': datetime.datetime(2025, 11, 14, 10, 10, 45, tzinfo=tzutc()), 'ContentLength': 32, 'ETag': '"b11a078e95b84e19937572f9018e592d"', 'ContentType': 'binary/octet-stream', 'Metadata': {}}
2025-11-14 10:10:47,650 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Object
2025-11-14 10:10:47,653 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Object: calling handler <function lazy_call.<locals>._handler at 0x7ff261bb0110>
2025-11-14 10:10:47,655 - DEBUG - boto3.resources.action - __call__: Calling s3:head_object with {'Bucket': 'convert_bucket', 'Key': 'csv_with_names_2_parquet_v1/ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet'}
2025-11-14 10:10:47,655 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function sse_md5 at 0x7ff27a922d50>
2025-11-14 10:10:47,655 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function validate_bucket_name at 0x7ff27a922c90>
2025-11-14 10:10:47,656 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7ff27a945550>
2025-11-14 10:10:47,656 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,656 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.HeadObject: calling handler <function generate_idempotent_uuid at 0x7ff27a922a50>
2025-11-14 10:10:47,656 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7ff27a945790>
2025-11-14 10:10:47,657 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,657 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'convert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:17732', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:10:47,657 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:17732/convert_bucket
2025-11-14 10:10:47,657 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:10:47,658 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:10:47,658 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_expect_header at 0x7ff27a923110>
2025-11-14 10:10:47,658 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function add_recursion_detection_header at 0x7ff27a921010>
2025-11-14 10:10:47,659 - DEBUG - botocore.hooks - _emit: Event before-call.s3.HeadObject: calling handler <function inject_api_version_header_if_needed at 0x7ff27a944b90>
2025-11-14 10:10:47,659 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=HeadObject) with params: {'url_path': '/csv_with_names_2_parquet_v1/ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet', 'query_string': {}, 'method': 'HEAD', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/convert_bucket/csv_with_names_2_parquet_v1/ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet', 'url': 'http://localhost:17732/convert_bucket/csv_with_names_2_parquet_v1/ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7ff265dedcd0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'convert_bucket', 'params': {'Bucket': 'convert_bucket', 'Key': 'csv_with_names_2_parquet_v1/ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:10:47,660 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7ff265ded640>>
2025-11-14 10:10:47,660 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7ff260d76590>>
2025-11-14 10:10:47,660 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.HeadObject: calling handler <function set_operation_specific_signer at 0x7ff27a9228d0>
2025-11-14 10:10:47,660 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.HeadObject: calling handler <function remove_arn_from_signing_path at 0x7ff27a9456d0>
2025-11-14 10:10:47,661 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:10:47,661 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
HEAD
/convert_bucket/csv_with_names_2_parquet_v1/ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet

host:localhost:17732
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101047Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:10:47,661 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101047Z
20251114/yandex/s3/aws4_request
757f4a4986b5d296c21bdd3035e1d99dad772fa3b99ce7e93e06d1ffa6a0a11b
2025-11-14 10:10:47,662 - DEBUG - botocore.auth - add_auth: Signature:
e6bd56d32c605be0ec2a78fbf6e686e08602ec67779ab6413b46942ce5ccfefe
2025-11-14 10:10:47,662 - DEBUG - botocore.hooks - _emit: Event request-created.s3.HeadObject: calling handler <function add_retry_headers at 0x7ff27a945490>
2025-11-14 10:10:47,662 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=HEAD, url=http://localhost:17732/convert_bucket/csv_with_names_2_parquet_v1/ptjudsej50crvmhiotii_0_6QDbSJB3rkWQjAYvbnpU9qtBRNXa2AMl.parquet, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101047Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=e6bd56d32c605be0ec2a78fbf6e686e08602ec67779ab6413b46942ce5ccfefe', 'amz-sdk-invocation-id': b'462d38e6-1e2b-4835-95fe-d974331717c5', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:10:47,669 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:10:47 GMT', 'content-type': 'binary/octet-stream', 'ETag': '"938ee549036fc083f3ad0112127f9622"', 'last-modified': 'Fri, 14 Nov 2025 10:10:46 GMT', 'Content-Length': '533', 'x-amzn-requestid': 'd0YQ53yPZvI0XGV9q3EkcdAAOUR9HYMxNwgKWX9A6hVv8psGlrMM', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:10:47,670 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:10:47,671 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7ff263db50a0>
2025-11-14 10:10:47,671 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:10:47,671 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.HeadObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7ff25e017b70>>
2025-11-14 10:10:47,672 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'd0YQ53yPZvI0XGV9q3EkcdAAOUR9HYMxNwgKWX9A6hVv8psGlrMM', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:10:47 GMT', 'content-type': 'binary/octet-stream', 'etag': '"938ee549036fc083f3ad0112127f9622"', 'last-modified': 'Fri, 14 Nov 2025 10:10:46 GMT', 'content-length': '533', 'x-amzn-requestid': 'd0YQ53yPZvI0XGV9q3EkcdAAOUR9HYMxNwgKWX9A6hVv8psGlrMM', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'LastModified': datetime.datetime(2025, 11, 14, 10, 10, 46, tzinfo=tzutc()), 'ContentLength': 533, 'ETag': '"938ee549036fc083f3ad0112127f9622"', 'ContentType': 'binary/octet-stream', 'Metadata': {}}
2025-11-14 10:10:47,683 - INFO - ya.test - pytest_runtest_teardown: Test teardown
