2025-11-11 12:58:25,652 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-11 12:58:25,652 - INFO - ya.test - pytest_runtest_setup: test_atomic_upload_commit[v1-client0]
2025-11-11 12:58:25,652 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-11 12:58:25,653 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-11 12:58:25,655 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/4107
2025-11-11 12:58:25,657 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/8135
2025-11-11 12:58:25,774 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd
2025-11-11 12:58:25,775 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/23192
2025-11-11 12:58:25,777 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/20209
2025-11-11 12:58:25,778 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-11-11 12:58:25,781 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-11-11 12:58:25,782 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-11-11 12:58:25,790 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-11-11 12:58:25,791 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 75f855f4-9dc4-4cae-ba2b-28174647bc09, localhost:3423): creating call state
2025-11-11 12:58:25,791 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 75f855f4-9dc4-4cae-ba2b-28174647bc09, localhost:3423): request = { database: "local" }
2025-11-11 12:58:25,797 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 75f855f4-9dc4-4cae-ba2b-28174647bc09, localhost:3423): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-7dc5lolkfm.auto.internal" port: 3423 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-11-11 12:58:25,798 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-7dc5lolkfm.auto.internal:3423, location 1, ssl: False>]>
2025-11-11 12:58:25,798 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-11-11 12:58:25,815 - INFO - ydb.connection - close: Closing channel for endpoint localhost:3423
2025-11-11 12:58:25,817 - DEBUG - ydb.table.SessionPool - subscribe: Active session queue is empty, subscribe waiter for a session
2025-11-11 12:58:25,817 - DEBUG - ydb.table.SessionPool - subscribe: Subscribe waiter <Future at 0x7b748bdfc1b0 state=pending>
2025-11-11 12:58:25,818 - DEBUG - ydb.table.SessionPool - subscribe: Session pool is not large enough (active_count < size: 0 < 1). will create a new session.
2025-11-11 12:58:25,818 - DEBUG - ydb.table.SessionPool - _create: Created session <ydb.table.Session object at 0x7b748be95f30>
2025-11-11 12:58:25,818 - DEBUG - ydb.table.SessionPool - _prepare: Preparing session <ydb.table.Session object at 0x7b748be95f30>
2025-11-11 12:58:25,819 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateSession, b09656c2-eb10-453d-8a7a-a3c0ef1b1692, ghrun-7dc5lolkfm.auto.internal:3423): creating call state
2025-11-11 12:58:25,820 - DEBUG - ydb.connection - _log_request: RpcState(CreateSession, b09656c2-eb10-453d-8a7a-a3c0ef1b1692, ghrun-7dc5lolkfm.auto.internal:3423): request = { operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } }
2025-11-11 12:58:25,827 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, b09656c2-eb10-453d-8a7a-a3c0ef1b1692, ghrun-7dc5lolkfm.auto.internal:3423): on response callback started
2025-11-11 12:58:25,828 - DEBUG - ydb.connection - _log_response: RpcState(CreateSession, b09656c2-eb10-453d-8a7a-a3c0ef1b1692, ghrun-7dc5lolkfm.auto.internal:3423): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.CreateSessionResult] { session_id: "ydb://session/3?node_id=1&id=YTQ1YWM1OTEtMTZlY2I1ZjYtOGE1NWQ3NmEtZWExNjRmNmI=" } } } }
2025-11-11 12:58:25,829 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7b748be95f30>
2025-11-11 12:58:25,829 - DEBUG - ydb.table.SessionPool - put: Replying to waiter with a session <ydb.table.Session object at 0x7b748be95f30>
2025-11-11 12:58:25,830 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, b09656c2-eb10-453d-8a7a-a3c0ef1b1692, ghrun-7dc5lolkfm.auto.internal:3423): on response callback success
2025-11-11 12:58:25,831 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 88a4d7a0-7717-4d39-b5eb-530e428d8e47, ghrun-7dc5lolkfm.auto.internal:3423): creating call state
2025-11-11 12:58:25,833 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 88a4d7a0-7717-4d39-b5eb-530e428d8e47, ghrun-7dc5lolkfm.auto.internal:3423): request = { session_id: "ydb://session/3?node_id=1&id=YTQ1YWM1OTEtMTZlY2I1ZjYtOGE1NWQ3NmEtZWExNjRmNmI=" path: "local/DbPoolStorage_db181073-3de0-4d45-81ee-a67b969ab08c/tenants" columns { name: "tenant" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "common" type { optional_type { item { type_id: BOOL } } } } columns { name: "state" type { optional_type { item { type_id: UINT32 } } } } columns { name: "state_time" type { optional_type { item { type_id: TIMESTAMP } } } } primary_key: "tenant" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-11 12:58:25,928 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 88a4d7a0-7717-4d39-b5eb-530e428d8e47, ghrun-7dc5lolkfm.auto.internal:3423): response = { operation { ready: true status: SUCCESS } }
2025-11-11 12:58:25,929 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7b748be95f30>
2025-11-11 12:58:25,930 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 758853b4-8e7c-4df4-9446-1463f9a1eda3, ghrun-7dc5lolkfm.auto.internal:3423): creating call state
2025-11-11 12:58:25,931 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 758853b4-8e7c-4df4-9446-1463f9a1eda3, ghrun-7dc5lolkfm.auto.internal:3423): request = { session_id: "ydb://session/3?node_id=1&id=YTQ1YWM1OTEtMTZlY2I1ZjYtOGE1NWQ3NmEtZWExNjRmNmI=" path: "local/DbPoolStorage_db181073-3de0-4d45-81ee-a67b969ab08c/mappings" columns { name: "subject_type" type { optional_type { item { type_id: STRING } } } } columns { name: "subject_id" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "node" type { optional_type { item { type_id: STRING } } } } primary_key: "subject_type" primary_key: "subject_id" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-11 12:58:26,027 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 758853b4-8e7c-4df4-9446-1463f9a1eda3, ghrun-7dc5lolkfm.auto.internal:3423): response = { operation { ready: true status: SUCCESS } }
2025-11-11 12:58:26,028 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7b748be95f30>
2025-11-11 12:58:26,029 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteDataQuery, cddbaf64-49fe-4ec7-ac94-7a12d3e33581, ghrun-7dc5lolkfm.auto.internal:3423): creating call state
2025-11-11 12:58:26,030 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteDataQuery, cddbaf64-49fe-4ec7-ac94-7a12d3e33581, ghrun-7dc5lolkfm.auto.internal:3423): request = { session_id: "ydb://session/3?node_id=1&id=YTQ1YWM1OTEtMTZlY2I1ZjYtOGE1NWQ3NmEtZWExNjRmNmI=" tx_control { begin_tx { serializable_read_write { } } commit_tx: true } query { yql_text: "--!syntax_v1\n            PRAGMA TablePathPrefix(\"local/DbPoolStorage_db181073-3de0-4d45-81ee-a67b969ab08c\");\n            UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/default\", \"/default\", true, 0, CurrentUtcTimestamp());\n                " } operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-11 12:58:26,177 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteDataQuery, cddbaf64-49fe-4ec7-ac94-7a12d3e33581, ghrun-7dc5lolkfm.auto.internal:3423): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.ExecuteQueryResult] { tx_meta { } } } } }
2025-11-11 12:58:26,177 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7b748be95f30>
2025-11-11 12:58:26,314 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd
2025-11-11 12:58:26,317 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16376
2025-11-11 12:58:26,318 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/21945
2025-11-11 12:58:26,318 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/6487
2025-11-11 12:58:26,320 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/kikimr_configs"
2025-11-11 12:58:26,321 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/node_1/logfile_k0i3_73p.log --grpc-port=20209 --mon-port=16376 --ic-port=23192
2025-11-11 12:58:26,322 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/kikimr_configs"
2025-11-11 12:58:26,322 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/node_1/logfile_k0i3_73p.log --grpc-port=20209 --mon-port=16376 --ic-port=23192
2025-11-11 12:58:26,325 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/kikimr_configs/config.yaml', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/node_1/logfile_k0i3_73p.log', '--grpc-port=20209', '--mon-port=16376', '--ic-port=23192')' in '/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/node_1' (no wait)
2025-11-11 12:58:26,329 - DEBUG - ya.test - execute: Command pid: 1213295
2025-11-11 12:58:26,331 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:20209/1
2025-11-11 12:58:26,333 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.4
2025-11-11 12:58:26,334 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.4
2025-11-11 12:58:26,335 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-11-11 12:58:26,344 - DEBUG - ya.test - execute: Command pid: 1213296
2025-11-11 12:58:27,167 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) rc: 0
2025-11-11 12:58:27,168 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) elapsed time (sec): 0.8223233222961426
2025-11-11 12:58:27,169 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) idrss: 0
2025-11-11 12:58:27,169 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) inblock: 0
2025-11-11 12:58:27,170 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) isrss: 0
2025-11-11 12:58:27,170 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) ixrss: 0
2025-11-11 12:58:27,171 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) majflt: 0
2025-11-11 12:58:27,172 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) maxrss: 928148
2025-11-11 12:58:27,173 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) minflt: 45339
2025-11-11 12:58:27,173 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) msgrcv: 0
2025-11-11 12:58:27,173 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) msgsnd: 0
2025-11-11 12:58:27,174 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) nivcsw: 47
2025-11-11 12:58:27,174 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) nsignals: 0
2025-11-11 12:58:27,175 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) nswap: 0
2025-11-11 12:58:27,175 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) nvcsw: 12
2025-11-11 12:58:27,176 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) oublock: 8
2025-11-11 12:58:27,177 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) stime: 0.18197
2025-11-11 12:58:27,177 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) utime: 0.566691
2025-11-11 12:58:27,178 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) wtime: 0.831
2025-11-11 12:58:27,178 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) output:
Git info:
    Commit: edc42c4313d1ecf4073f2f2b8dc05dd5cba26c17
    Branch: 
    Author: ubyte <himeraster@gmail.com>
    Summary: Merge 0e8f5d4b993a763788a819dc96a27139b4faa153 into d428e61cc4e3c2ff244c18f2eff147ecafd8254a

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-7dc5lolkfm
    Host information: 
        Linux ghrun-7dc5lolkfm 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -DNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -fsanitize=address -Daddress_sanitizer_enabled -fno-omit-frame-pointer -fsanitize-blacklist=/home/runner/actions_runner/_work/ydb/ydb/build/sanitize-blacklist.txt -fno-sanitize-link-runtime -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -DNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-11-11 12:58:27,179 - DEBUG - ya.test - _save_outputs: Command (pid 1213296) errors:

2025-11-11 12:58:27,180 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: edc42c4313d1ecf4073f2f2b8dc05dd5cba26c17
    Branch: 
    Author: ubyte <himeraster@gmail.com>
    Summary: Merge 0e8f5d4b993a763788a819dc96a27139b4faa153 into d428e61cc4e3c2ff244c18f2eff147ecafd8254a
2025-11-11 12:58:27,181 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-11-11 12:58:27,191 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_insert_restarts.py::TestS3, test_name: test_atomic_upload_commit[v1-client0])
2025-11-11 12:58:27,195 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7c148aa50050>
2025-11-11 12:58:27,214 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7c148a2e56f0>
2025-11-11 12:58:27,214 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7c148b664ed0>
2025-11-11 12:58:27,215 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7c148a2e3310>
2025-11-11 12:58:27,228 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-11 12:58:27,248 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-11 12:58:27,251 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-11 12:58:27,255 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-11 12:58:27,262 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-11 12:58:27,264 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-11 12:58:27,268 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7c148b665090>
2025-11-11 12:58:27,269 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'insert_bucket', 'ACL': 'public-read-write'}
2025-11-11 12:58:27,272 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7c148aa50910>
2025-11-11 12:58:27,273 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c148aa53d90>
2025-11-11 12:58:27,273 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,274 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7c148aa50670>
2025-11-11 12:58:27,275 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c148aa54030>
2025-11-11 12:58:27,276 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,277 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:19486', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 12:58:27,281 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:19486/insert_bucket
2025-11-11 12:58:27,282 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 12:58:27,283 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 12:58:27,287 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7c148aa50e50>
2025-11-11 12:58:27,288 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7c148aa50130>
2025-11-11 12:58:27,289 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7c148aa53af0>
2025-11-11 12:58:27,290 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read-write', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:19486/insert_bucket', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7b748ba6c5b0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'ACL': 'public-read-write'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 12:58:27,293 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b748ba6cef0>>
2025-11-11 12:58:27,298 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b748bfd0ff0>>
2025-11-11 12:58:27,303 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7c148aa504b0>
2025-11-11 12:58:27,304 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7c148aa53f50>
2025-11-11 12:58:27,307 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 12:58:27,308 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/insert_bucket

host:localhost:19486
x-amz-acl:public-read-write
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251111T125827Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-11 12:58:27,309 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T125827Z
20251111/yandex/s3/aws4_request
32c572b198af33519bc0ebe27f6667c17b5ecf25b88f9e6025533972816041cd
2025-11-11 12:58:27,310 - DEBUG - botocore.auth - add_auth: Signature:
45ba4778766df729fcf21232fe5a836909551a6a3d88b9d6cd0e0622e2618e48
2025-11-11 12:58:27,312 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7c148aa53cb0>
2025-11-11 12:58:27,313 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:19486/insert_bucket, headers={'x-amz-acl': b'public-read-write', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251111T125827Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251111/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=45ba4778766df729fcf21232fe5a836909551a6a3d88b9d6cd0e0622e2618e48', 'amz-sdk-invocation-id': b'1d85efe0-4563-4fe8-9070-4de0612aafa6', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-11 12:58:27,346 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 12:58:27 GMT', 'x-amzn-requestid': '47f6HDK623d6vEXP7M4L8bIhoAhm9UbKUE4HtO3lG5MTvTc62xvj', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '167', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 12:58:27,347 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>insert_bucket</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-11 12:58:27,351 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7b748b96d2b0>
2025-11-11 12:58:27,351 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 12:58:27,352 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,354 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': '47f6HDK623d6vEXP7M4L8bIhoAhm9UbKUE4HtO3lG5MTvTc62xvj', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.11', 'date': 'Tue, 11 Nov 2025 12:58:27 GMT', 'x-amzn-requestid': '47f6HDK623d6vEXP7M4L8bIhoAhm9UbKUE4HtO3lG5MTvTc62xvj', 'content-type': 'text/html; charset=utf-8', 'content-length': '167', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-11 12:58:27,355 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'insert_bucket'}
2025-11-11 12:58:27,359 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7c148aa526d0>
2025-11-11 12:58:27,360 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7c148aa50910>
2025-11-11 12:58:27,361 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c148aa53d90>
2025-11-11 12:58:27,361 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,362 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7c148aa50670>
2025-11-11 12:58:27,363 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c148aa54030>
2025-11-11 12:58:27,364 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,364 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:19486', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 12:58:27,368 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:19486/insert_bucket
2025-11-11 12:58:27,369 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 12:58:27,370 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 12:58:27,373 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7c148aa50e50>
2025-11-11 12:58:27,374 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7c148aa50130>
2025-11-11 12:58:27,374 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7c148aa53af0>
2025-11-11 12:58:27,375 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:19486/insert_bucket?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7b748ba6c5b0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 12:58:27,379 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b748ba6cef0>>
2025-11-11 12:58:27,381 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b748bfd0ff0>>
2025-11-11 12:58:27,382 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7c148aa504b0>
2025-11-11 12:58:27,384 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7c148aa53f50>
2025-11-11 12:58:27,385 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 12:58:27,386 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/insert_bucket
encoding-type=url
host:localhost:19486
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251111T125827Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-11 12:58:27,386 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T125827Z
20251111/yandex/s3/aws4_request
37ae5b91d9b2784a0075b55057afb311e95563c66374cd3f1207bb1e46cdb973
2025-11-11 12:58:27,387 - DEBUG - botocore.auth - add_auth: Signature:
58339c46dee340dbf37a8f695e76968ff04718797d972e4f2509f9ca76bb8fee
2025-11-11 12:58:27,388 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7c148aa53cb0>
2025-11-11 12:58:27,389 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:19486/insert_bucket?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251111T125827Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251111/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=58339c46dee340dbf37a8f695e76968ff04718797d972e4f2509f9ca76bb8fee', 'amz-sdk-invocation-id': b'4c200787-979c-4279-afa8-f9f960fb8e34', 'amz-sdk-request': b'attempt=1'}>
2025-11-11 12:58:27,403 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 12:58:27 GMT', 'x-amzn-requestid': 'Bpdc9ZG56elZQtGrQlcLyGXKSojz2JWGtzuOUqO9Qlqt9IFb8Mic', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '571', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 12:58:27,404 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>insert_bucket</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>select/test.csv</Key><LastModified>2025-11-11T12:55:05.000Z</LastModified><ETag>&#34;65358cf837c7ed8402f2860eda3fc7df&#34;</ETag><Size>20000004</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-11 12:58:27,596 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7b748b96d2b0>
2025-11-11 12:58:27,596 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 12:58:27,597 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,598 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7c148aa527b0>
2025-11-11 12:58:27,599 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-11 12:58:27,600 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-11 12:58:27,602 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7c148b66bb50>
2025-11-11 12:58:27,603 - DEBUG - boto3.resources.action - __call__: Calling s3:delete_objects with {'Bucket': 'insert_bucket', 'Delete': {'Objects': [{'Key': 'select/test.csv'}]}}
2025-11-11 12:58:27,606 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function validate_bucket_name at 0x7c148aa50910>
2025-11-11 12:58:27,606 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c148aa53d90>
2025-11-11 12:58:27,607 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,607 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.DeleteObjects: calling handler <function generate_idempotent_uuid at 0x7c148aa50670>
2025-11-11 12:58:27,608 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c148aa54030>
2025-11-11 12:58:27,609 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,609 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:19486', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 12:58:27,610 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:19486/insert_bucket
2025-11-11 12:58:27,610 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 12:58:27,611 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 12:58:27,614 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function escape_xml_payload at 0x7c148aa50210>
2025-11-11 12:58:27,614 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_expect_header at 0x7c148aa50e50>
2025-11-11 12:58:27,615 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function add_recursion_detection_header at 0x7c148aa50130>
2025-11-11 12:58:27,615 - DEBUG - botocore.hooks - _emit: Event before-call.s3.DeleteObjects: calling handler <function inject_api_version_header_if_needed at 0x7c148aa53af0>
2025-11-11 12:58:27,616 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=DeleteObjects) with params: {'url_path': '?delete', 'query_string': {}, 'method': 'POST', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'Content-MD5': 'MHf/6vNY2rkmxtQJsHrVCA=='}, 'body': b'<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Object><Key>select/test.csv</Key></Object></Delete>', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:19486/insert_bucket?delete', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7b748ba6c5b0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'Delete': {'Objects': [{'Key': 'select/test.csv'}]}}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'checksum': {'request_algorithm': 'conditional-md5'}}}
2025-11-11 12:58:27,618 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b748ba6cef0>>
2025-11-11 12:58:27,619 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b748bfd0ff0>>
2025-11-11 12:58:27,619 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.DeleteObjects: calling handler <function set_operation_specific_signer at 0x7c148aa504b0>
2025-11-11 12:58:27,620 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.DeleteObjects: calling handler <function remove_arn_from_signing_path at 0x7c148aa53f50>
2025-11-11 12:58:27,622 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 12:58:27,622 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
POST
/insert_bucket
delete=
content-md5:MHf/6vNY2rkmxtQJsHrVCA==
host:localhost:19486
x-amz-content-sha256:3b10f8644f98831d530130e3f1cf5ff321b69da39f07fe31a7814aa8943ad31d
x-amz-date:20251111T125827Z

content-md5;host;x-amz-content-sha256;x-amz-date
3b10f8644f98831d530130e3f1cf5ff321b69da39f07fe31a7814aa8943ad31d
2025-11-11 12:58:27,622 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T125827Z
20251111/yandex/s3/aws4_request
86d461154565d0f0e176148efb380ea0d5d49ea657afb2460e1166e3ef43f408
2025-11-11 12:58:27,623 - DEBUG - botocore.auth - add_auth: Signature:
c4ab374ba4e305ffb08f27b33da19082a636ccbfb293ce1a2472bccd50689478
2025-11-11 12:58:27,623 - DEBUG - botocore.hooks - _emit: Event request-created.s3.DeleteObjects: calling handler <function add_retry_headers at 0x7c148aa53cb0>
2025-11-11 12:58:27,624 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=http://localhost:19486/insert_bucket?delete, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'Content-MD5': b'MHf/6vNY2rkmxtQJsHrVCA==', 'X-Amz-Date': b'20251111T125827Z', 'X-Amz-Content-SHA256': b'3b10f8644f98831d530130e3f1cf5ff321b69da39f07fe31a7814aa8943ad31d', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251111/yandex/s3/aws4_request, SignedHeaders=content-md5;host;x-amz-content-sha256;x-amz-date, Signature=c4ab374ba4e305ffb08f27b33da19082a636ccbfb293ce1a2472bccd50689478', 'amz-sdk-invocation-id': b'3ccc7770-0d54-4afb-86fe-ce410600ac28', 'amz-sdk-request': b'attempt=1', 'Content-Length': '108'}>
2025-11-11 12:58:27,656 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 12:58:27 GMT', 'x-amzn-requestid': 'f6XTdOBBZlgR9J8oDPpD3MgsNCuusYMRxIObhUgyqjbb8TMZvP8d', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '159', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 12:58:27,662 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><DeleteResult xmlns="http://s3.amazonaws.com/doc/2006-03-01"><Deleted><Key>select/test.csv</Key></Deleted></DeleteResult>'
2025-11-11 12:58:27,665 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7b748b96d2b0>
2025-11-11 12:58:27,666 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 12:58:27,666 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.DeleteObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:27,668 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'f6XTdOBBZlgR9J8oDPpD3MgsNCuusYMRxIObhUgyqjbb8TMZvP8d', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.11', 'date': 'Tue, 11 Nov 2025 12:58:27 GMT', 'x-amzn-requestid': 'f6XTdOBBZlgR9J8oDPpD3MgsNCuusYMRxIObhUgyqjbb8TMZvP8d', 'content-type': 'text/html; charset=utf-8', 'content-length': '159', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}, 'Deleted': [{'Key': 'select/test.csv'}]}
2025-11-11 12:58:27,669 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7c148aa50050>
2025-11-11 12:58:27,675 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7c148a2e56f0>
2025-11-11 12:58:27,676 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7c148b664ed0>
2025-11-11 12:58:27,676 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7c148a2e3310>
2025-11-11 12:58:27,682 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-11 12:58:27,693 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-11 12:58:27,696 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-11 12:58:27,739 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7c148aa51d30>
2025-11-11 12:58:27,740 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7c148aa509f0>
2025-11-11 12:58:27,740 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7c148aa52c10>
2025-11-11 12:58:27,758 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7c148aa50910>
2025-11-11 12:58:27,758 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c148aa53d90>
2025-11-11 12:58:27,759 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748aaf6030>>
2025-11-11 12:58:27,759 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7c148aa50670>
2025-11-11 12:58:27,760 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c148aa54030>
2025-11-11 12:58:27,760 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748aaf6030>>
2025-11-11 12:58:27,761 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:19486', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 12:58:27,763 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:19486/insert_bucket
2025-11-11 12:58:27,763 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 12:58:27,763 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 12:58:27,765 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_md5 at 0x7c148aa145b0>
2025-11-11 12:58:27,872 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7c148aa50e50>
2025-11-11 12:58:27,872 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-11 12:58:27,873 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7c148aa50130>
2025-11-11 12:58:27,873 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7c148aa53af0>
2025-11-11 12:58:27,874 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/select/test.csv', 'query_string': {}, 'method': 'PUT', 'headers': {'Content-Type': 'text/plain', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': 'ZTWM+DfH7YQC8oYO2j/H3w==', 'Expect': '100-continue'}, 'body': <_io.BytesIO object at 0x7ba48bab13b0>, 'auth_path': '/insert_bucket/select/test.csv', 'url': 'http://localhost:19486/insert_bucket/select/test.csv', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7b748ab21ab0>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Body': <_io.BytesIO object at 0x7ba48bab13b0>, 'Bucket': 'insert_bucket', 'Key': 'select/test.csv', 'ContentType': 'text/plain'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 12:58:27,877 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b748ab22130>>
2025-11-11 12:58:27,878 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b748ab3a870>>
2025-11-11 12:58:27,879 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7c148aa504b0>
2025-11-11 12:58:27,880 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7c148aa53f50>
2025-11-11 12:58:27,972 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 12:58:27,972 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/insert_bucket/select/test.csv

content-md5:ZTWM+DfH7YQC8oYO2j/H3w==
content-type:text/plain
host:localhost:19486
x-amz-content-sha256:ddbf434c0dad8b668933d04aa7565ec562349f8c361838a11ba0d8734b6f7d7d
x-amz-date:20251111T125827Z

content-md5;content-type;host;x-amz-content-sha256;x-amz-date
ddbf434c0dad8b668933d04aa7565ec562349f8c361838a11ba0d8734b6f7d7d
2025-11-11 12:58:27,973 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T125827Z
20251111/yandex/s3/aws4_request
9f1ccade62fd66d863583e549b8f2a24425dbf2bc9dc63e7ab1cce03cb5720fa
2025-11-11 12:58:27,974 - DEBUG - botocore.auth - add_auth: Signature:
b0198c3a803684b9bc483d50353e3327e28fb1d0048fd59009edcffd1fb66306
2025-11-11 12:58:27,974 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7c148aa53cb0>
2025-11-11 12:58:27,975 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:19486/insert_bucket/select/test.csv, headers={'Content-Type': b'text/plain', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': b'ZTWM+DfH7YQC8oYO2j/H3w==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251111T125827Z', 'X-Amz-Content-SHA256': b'ddbf434c0dad8b668933d04aa7565ec562349f8c361838a11ba0d8734b6f7d7d', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251111/yandex/s3/aws4_request, SignedHeaders=content-md5;content-type;host;x-amz-content-sha256;x-amz-date, Signature=b0198c3a803684b9bc483d50353e3327e28fb1d0048fd59009edcffd1fb66306', 'amz-sdk-invocation-id': b'105872c7-ff1a-4599-b8cd-3d080af74e06', 'amz-sdk-request': b'attempt=1', 'Content-Length': '20000004'}>
2025-11-11 12:58:27,979 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-11 12:58:27,982 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-11 12:58:28,461 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 12:58:28 GMT', 'ETag': '"65358cf837c7ed8402f2860eda3fc7df"', 'last-modified': 'Tue, 11 Nov 2025 12:58:28 GMT', 'x-amzn-requestid': 'ziqlmByOAX5K7x6a2HKhjOCFkFkLfHEdCHyASEVVPdy8c6iAKXaR', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '0', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 12:58:28,462 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-11 12:58:28,464 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7b748aaf8270>
2025-11-11 12:58:28,465 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 12:58:28,465 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748aaf6030>>
2025-11-11 12:58:35,790 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-11-11 12:58:35,791 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-11-11 12:58:35,811 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-11-11 12:58:35,812 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 26691ebf-d66d-49dc-a2b3-9a01cfa5c9df, localhost:3423): creating call state
2025-11-11 12:58:35,813 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 26691ebf-d66d-49dc-a2b3-9a01cfa5c9df, localhost:3423): request = { database: "local" }
2025-11-11 12:58:35,823 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 26691ebf-d66d-49dc-a2b3-9a01cfa5c9df, localhost:3423): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-7dc5lolkfm.auto.internal" port: 3423 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-11-11 12:58:35,824 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-7dc5lolkfm.auto.internal:3423, location 1, ssl: False>]>
2025-11-11 12:58:35,825 - INFO - ydb.connection - close: Closing channel for endpoint localhost:3423
2025-11-11 12:58:39,525 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "93d0aa13-5cdc-4e3b-a065-34ac0db7f051"

2025-11-11 12:58:41,470 - DEBUG - root - create_query_impl: Result: query_id: "ptqudslr5h7ovjf5bl9e"

2025-11-11 12:58:41,471 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'insert_bucket', 'Prefix': 'insert/'}
2025-11-11 12:58:41,472 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7c148aa526d0>
2025-11-11 12:58:41,473 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7c148aa50910>
2025-11-11 12:58:41,473 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c148aa53d90>
2025-11-11 12:58:41,473 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:41,474 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7c148aa50670>
2025-11-11 12:58:41,474 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c148aa54030>
2025-11-11 12:58:41,474 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:41,475 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:19486', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 12:58:41,475 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:19486/insert_bucket
2025-11-11 12:58:41,475 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 12:58:41,476 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 12:58:41,477 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7c148aa50e50>
2025-11-11 12:58:41,478 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7c148aa50130>
2025-11-11 12:58:41,478 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7c148aa53af0>
2025-11-11 12:58:41,478 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'prefix': 'insert/', 'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:19486/insert_bucket?prefix=insert%2F&encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7b748ba6c5b0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'Prefix': 'insert/', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 12:58:41,480 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b748ba6cef0>>
2025-11-11 12:58:41,480 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b748bfd0ff0>>
2025-11-11 12:58:41,481 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7c148aa504b0>
2025-11-11 12:58:41,482 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7c148aa53f50>
2025-11-11 12:58:41,483 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 12:58:41,483 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/insert_bucket
encoding-type=url&prefix=insert%2F
host:localhost:19486
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251111T125841Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-11 12:58:41,484 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T125841Z
20251111/yandex/s3/aws4_request
01aa8545a5e156df7e0aa7b09c07b0541a0445c77d4520c1a4b8fc7726a23242
2025-11-11 12:58:41,484 - DEBUG - botocore.auth - add_auth: Signature:
8b341b774334030a2a955563a42791a7a43e184400ba2152a9583d619cf4fb08
2025-11-11 12:58:41,486 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7c148aa53cb0>
2025-11-11 12:58:41,486 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:19486/insert_bucket?prefix=insert%2F&encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251111T125841Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251111/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=8b341b774334030a2a955563a42791a7a43e184400ba2152a9583d619cf4fb08', 'amz-sdk-invocation-id': b'6c580750-b85b-438c-8108-4a1bc5864aee', 'amz-sdk-request': b'attempt=1'}>
2025-11-11 12:58:41,498 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 12:58:41 GMT', 'x-amzn-requestid': 'K0ccQvTApoRe8CvnnQR3vaIOzg3b2TAQbr7wvngaz0dYYfBPgpEA', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '260', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 12:58:41,498 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>insert_bucket</Name><Prefix>insert/</Prefix><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated></ListBucketResult>'
2025-11-11 12:58:41,500 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7b748b96d2b0>
2025-11-11 12:58:41,500 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 12:58:41,500 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:41,502 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7c148aa527b0>
2025-11-11 12:58:41,503 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-11 12:58:41,504 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-11 12:58:41,506 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7c148b66bb50>
2025-11-11 12:58:41,507 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_multipart_uploads with {'Bucket': 'insert_bucket'}
2025-11-11 12:58:41,509 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListMultipartUploads: calling handler <function validate_bucket_name at 0x7c148aa50910>
2025-11-11 12:58:41,511 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListMultipartUploads: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c148aa53d90>
2025-11-11 12:58:41,511 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListMultipartUploads: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:41,512 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListMultipartUploads: calling handler <function generate_idempotent_uuid at 0x7c148aa50670>
2025-11-11 12:58:41,513 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c148aa54030>
2025-11-11 12:58:41,513 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:41,515 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:19486', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 12:58:41,516 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:19486/insert_bucket
2025-11-11 12:58:41,516 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 12:58:41,517 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 12:58:41,519 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListMultipartUploads: calling handler <function add_expect_header at 0x7c148aa50e50>
2025-11-11 12:58:41,519 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListMultipartUploads: calling handler <function add_recursion_detection_header at 0x7c148aa50130>
2025-11-11 12:58:41,520 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListMultipartUploads: calling handler <function inject_api_version_header_if_needed at 0x7c148aa53af0>
2025-11-11 12:58:41,520 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListMultipartUploads) with params: {'url_path': '?uploads', 'query_string': {}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:19486/insert_bucket?uploads', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7b748ba6c5b0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 12:58:41,523 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListMultipartUploads: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b748ba6cef0>>
2025-11-11 12:58:41,524 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListMultipartUploads: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b748bfd0ff0>>
2025-11-11 12:58:41,524 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListMultipartUploads: calling handler <function set_operation_specific_signer at 0x7c148aa504b0>
2025-11-11 12:58:41,526 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListMultipartUploads: calling handler <function remove_arn_from_signing_path at 0x7c148aa53f50>
2025-11-11 12:58:41,527 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 12:58:41,527 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/insert_bucket
uploads=
host:localhost:19486
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251111T125841Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-11 12:58:41,528 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T125841Z
20251111/yandex/s3/aws4_request
64d6487713e12ebfd04736071ee7c31a56b82417ee07e98510a123ff76300a85
2025-11-11 12:58:41,528 - DEBUG - botocore.auth - add_auth: Signature:
5e3b46211a6602e2385032c5645b54666b0310bb4b39868798f257aaf2945dc6
2025-11-11 12:58:41,529 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListMultipartUploads: calling handler <function add_retry_headers at 0x7c148aa53cb0>
2025-11-11 12:58:41,530 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:19486/insert_bucket?uploads, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251111T125841Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251111/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=5e3b46211a6602e2385032c5645b54666b0310bb4b39868798f257aaf2945dc6', 'amz-sdk-invocation-id': b'aa8bce68-b3ac-4d01-b633-75a9d37b1dda', 'amz-sdk-request': b'attempt=1'}>
2025-11-11 12:58:41,542 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 12:58:41 GMT', 'x-amzn-requestid': 's8MO7jnctQNEqxPpdps9sRJ5OQkmcE1KUOS17xIkMCj5HBPWlKJT', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '839', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 12:58:41,543 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListMultipartUploadsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Bucket>insert_bucket</Bucket><KeyMarker></KeyMarker><UploadIdMarker></UploadIdMarker><MaxUploads>1000</MaxUploads><IsTruncated>false</IsTruncated><Upload><Key>insert/ptjudslrbndrb0521ojp_0_tWZyR_YowEC1wga-lVGVfg0rGX0lziRm.csv</Key><UploadId>QpWYh6g47xjGkHdsMFF2UoemEtUkhYvYILe5bCG1lb3qaSaXxYwuCQ</UploadId><Initiator><ID>arn:aws:iam::123456789012:user/user1-11111a31-17b5-4fb7-9df5-b111111f13de</ID><DisplayName>user1-11111a31-17b5-4fb7-9df5-b111111f13de</DisplayName></Initiator><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner><StorageClass>STANDARD</StorageClass><Initiated>2010-11-10T20:48:33.000Z</Initiated></Upload></ListMultipartUploadsResult>'
2025-11-11 12:58:41,548 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListMultipartUploads: calling handler <botocore.retryhandler.RetryHandler object at 0x7b748b96d2b0>
2025-11-11 12:58:41,549 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 12:58:41,549 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListMultipartUploads: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 12:58:41,550 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:MultipartUpload
2025-11-11 12:58:48,554 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:20209/1
2025-11-11 12:58:48,554 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/kikimr_configs"
2025-11-11 12:58:48,555 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/node_1/logfile_k0i3_73p.log --grpc-port=20209 --mon-port=16376 --ic-port=23192
2025-11-11 12:58:48,556 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/kikimr_configs/config.yaml', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/node_1/logfile_k0i3_73p.log', '--grpc-port=20209', '--mon-port=16376', '--ic-port=23192')' in '/home/runner/.ya/build/build_root/jwjy/001056/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v1-client0/default/node_1' (no wait)
2025-11-11 12:58:48,560 - DEBUG - ya.test - execute: Command pid: 1219827
2025-11-11 12:58:48,561 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:20209/1
2025-11-11 12:58:48,563 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.5
2025-11-11 12:58:48,564 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.5
2025-11-11 12:58:48,564 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jwjy/001056/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-11-11 12:58:48,566 - DEBUG - ya.test - execute: Command pid: 1219828
2025-11-11 12:58:49,359 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) rc: 0
2025-11-11 12:58:49,360 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) elapsed time (sec): 0.792283296585083
2025-11-11 12:58:49,360 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) idrss: 0
2025-11-11 12:58:49,361 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) inblock: 0
2025-11-11 12:58:49,361 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) isrss: 0
2025-11-11 12:58:49,361 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) ixrss: 0
2025-11-11 12:58:49,362 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) majflt: 0
2025-11-11 12:58:49,362 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) maxrss: 956960
2025-11-11 12:58:49,362 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) minflt: 45332
2025-11-11 12:58:49,362 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) msgrcv: 0
2025-11-11 12:58:49,363 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) msgsnd: 0
2025-11-11 12:58:49,363 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) nivcsw: 29
2025-11-11 12:58:49,363 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) nsignals: 0
2025-11-11 12:58:49,364 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) nswap: 0
2025-11-11 12:58:49,364 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) nvcsw: 15
2025-11-11 12:58:49,364 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) oublock: 8
2025-11-11 12:58:49,365 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) stime: 0.227452
2025-11-11 12:58:49,365 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) utime: 0.51677
2025-11-11 12:58:49,365 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) wtime: 0.794
2025-11-11 12:58:49,366 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) output:
Git info:
    Commit: edc42c4313d1ecf4073f2f2b8dc05dd5cba26c17
    Branch: 
    Author: ubyte <himeraster@gmail.com>
    Summary: Merge 0e8f5d4b993a763788a819dc96a27139b4faa153 into d428e61cc4e3c2ff244c18f2eff147ecafd8254a

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-7dc5lolkfm
    Host information: 
        Linux ghrun-7dc5lolkfm 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -DNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -fsanitize=address -Daddress_sanitizer_enabled -fno-omit-frame-pointer -fsanitize-blacklist=/home/runner/actions_runner/_work/ydb/ydb/build/sanitize-blacklist.txt -fno-sanitize-link-runtime -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -DNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-11-11 12:58:49,366 - DEBUG - ya.test - _save_outputs: Command (pid 1219828) errors:

2025-11-11 12:58:49,367 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: edc42c4313d1ecf4073f2f2b8dc05dd5cba26c17
    Branch: 
    Author: ubyte <himeraster@gmail.com>
    Summary: Merge 0e8f5d4b993a763788a819dc96a27139b4faa153 into d428e61cc4e3c2ff244c18f2eff147ecafd8254a
2025-11-11 12:58:49,367 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-11 12:58:53,288 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-11 12:58:53,883 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
}

2025-11-11 12:58:55,953 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:58:58,007 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":2,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:00,066 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:02,141 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:04,225 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"5.49s\",\"count\":2,\"avg\":\"2.74s\",\"max\":\"5.49s\",\"min\":\"0.00s\"},\"IngressBytes\":{\"sum\":11763712,\"count\":1,\"avg\":11763712,\"max\":11763712,\"min\":11763712},\"IngressRows\":{\"sum\":5881000,\"count\":1,\"avg\":5881000,\"max\":5881000,\"min\":5881000},\"OutputBytes\":{\"sum\":1528049,\"count\":1,\"avg\":1528049,\"max\":1528049,\"min\":1528049},\"OutputRows\":{\"sum\":1528000,\"count\":1,\"avg\":1528000,\"max\":1528000,\"min\":1528000},\"MaxMemoryUsage\":{\"sum\":2228224,\"count\":1,\"avg\":2228224,\"max\":2228224,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:06,282 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"9.04s\",\"count\":2,\"avg\":\"4.52s\",\"max\":\"5.49s\",\"min\":\"3.54s\"},\"IngressBytes\":{\"sum\":11763712,\"count\":1,\"avg\":11763712,\"max\":11763712,\"min\":11763712},\"IngressRows\":{\"sum\":5881000,\"count\":1,\"avg\":5881000,\"max\":5881000,\"min\":5881000},\"InputBytes\":{\"sum\":1028035,\"count\":1,\"avg\":1028035,\"max\":1028035,\"min\":1028035},\"InputRows\":{\"sum\":1028000,\"count\":1,\"avg\":1028000,\"max\":1028000,\"min\":1028000},\"OutputBytes\":{\"sum\":1528049,\"count\":1,\"avg\":1528049,\"max\":1528049,\"min\":1528049},\"OutputRows\":{\"sum\":1528000,\"count\":1,\"avg\":1528000,\"max\":1528000,\"min\":1528000},\"EgressRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"MaxMemoryUsage\":{\"sum\":33030208,\"count\":2,\"avg\":16515104,\"max\":30801984,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:08,337 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"13.72s\",\"count\":2,\"avg\":\"6.86s\",\"max\":\"10.17s\",\"min\":\"3.54s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":1028035,\"count\":1,\"avg\":1028035,\"max\":1028035,\"min\":1028035},\"InputRows\":{\"sum\":1028000,\"count\":1,\"avg\":1028000,\"max\":1028000,\"min\":1028000},\"OutputBytes\":{\"sum\":3028063,\"count\":1,\"avg\":3028063,\"max\":3028063,\"min\":3028063},\"OutputRows\":{\"sum\":3028000,\"count\":1,\"avg\":3028000,\"max\":3028000,\"min\":3028000},\"EgressRows\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"MaxMemoryUsage\":{\"sum\":33030208,\"count\":2,\"avg\":16515104,\"max\":30801984,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:10,421 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:12,504 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:14,688 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"24.05s\",\"count\":2,\"avg\":\"12.02s\",\"max\":\"12.71s\",\"min\":\"11.33s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":4028057,\"count\":1,\"avg\":4028057,\"max\":4028057,\"min\":4028057},\"InputRows\":{\"sum\":4027987,\"count\":1,\"avg\":4027987,\"max\":4027987,\"min\":4027987},\"OutputBytes\":{\"sum\":4028057,\"count\":1,\"avg\":4028057,\"max\":4028057,\"min\":4028057},\"OutputRows\":{\"sum\":4027987,\"count\":1,\"avg\":4027987,\"max\":4027987,\"min\":4027987},\"EgressRows\":{\"sum\":9,\"count\":1,\"avg\":9,\"max\":9,\"min\":9},\"MaxMemoryUsage\":{\"sum\":92471424,\"count\":2,\"avg\":46235712,\"max\":90243200,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:16,830 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:18,908 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"25.84s\",\"count\":2,\"avg\":\"12.92s\",\"max\":\"14.50s\",\"min\":\"11.33s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":4028057,\"count\":1,\"avg\":4028057,\"max\":4028057,\"min\":4028057},\"InputRows\":{\"sum\":4027987,\"count\":1,\"avg\":4027987,\"max\":4027987,\"min\":4027987},\"OutputBytes\":{\"sum\":6028045,\"count\":1,\"avg\":6028045,\"max\":6028045,\"min\":6028045},\"OutputRows\":{\"sum\":6027961,\"count\":1,\"avg\":6027961,\"max\":6027961,\"min\":6027961},\"EgressRows\":{\"sum\":9,\"count\":1,\"avg\":9,\"max\":9,\"min\":9},\"MaxMemoryUsage\":{\"sum\":92471424,\"count\":2,\"avg\":46235712,\"max\":90243200,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:20,977 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"33.85s\",\"count\":2,\"avg\":\"16.92s\",\"max\":\"19.35s\",\"min\":\"14.50s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":6028045,\"count\":1,\"avg\":6028045,\"max\":6028045,\"min\":6028045},\"InputRows\":{\"sum\":6027961,\"count\":1,\"avg\":6027961,\"max\":6027961,\"min\":6027961},\"OutputBytes\":{\"sum\":6028045,\"count\":1,\"avg\":6028045,\"max\":6028045,\"min\":6028045},\"OutputRows\":{\"sum\":6027961,\"count\":1,\"avg\":6027961,\"max\":6027961,\"min\":6027961},\"EgressRows\":{\"sum\":13,\"count\":1,\"avg\":13,\"max\":13,\"min\":13},\"MaxMemoryUsage\":{\"sum\":210305152,\"count\":2,\"avg\":105152576,\"max\":208076928,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:23,035 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"35.76s\",\"count\":2,\"avg\":\"17.88s\",\"max\":\"19.35s\",\"min\":\"16.41s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":6028045,\"count\":1,\"avg\":6028045,\"max\":6028045,\"min\":6028045},\"InputRows\":{\"sum\":6027961,\"count\":1,\"avg\":6027961,\"max\":6027961,\"min\":6027961},\"OutputBytes\":{\"sum\":6028045,\"count\":1,\"avg\":6028045,\"max\":6028045,\"min\":6028045},\"OutputRows\":{\"sum\":6027961,\"count\":1,\"avg\":6027961,\"max\":6027961,\"min\":6027961},\"EgressRows\":{\"sum\":13,\"count\":1,\"avg\":13,\"max\":13,\"min\":13},\"MaxMemoryUsage\":{\"sum\":210305152,\"count\":2,\"avg\":105152576,\"max\":208076928,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:25,089 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:27,152 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:29,214 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"42.31s\",\"count\":2,\"avg\":\"21.15s\",\"max\":\"25.89s\",\"min\":\"16.41s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":6028045,\"count\":1,\"avg\":6028045,\"max\":6028045,\"min\":6028045},\"InputRows\":{\"sum\":6027961,\"count\":1,\"avg\":6027961,\"max\":6027961,\"min\":6027961},\"OutputBytes\":{\"sum\":7028039,\"count\":1,\"avg\":7028039,\"max\":7028039,\"min\":7028039},\"OutputRows\":{\"sum\":7027948,\"count\":1,\"avg\":7027948,\"max\":7027948,\"min\":7027948},\"EgressRows\":{\"sum\":17,\"count\":1,\"avg\":17,\"max\":17,\"min\":17},\"MaxMemoryUsage\":{\"sum\":210305152,\"count\":2,\"avg\":105152576,\"max\":208076928,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:31,288 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:33,395 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:35,455 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"51.41s\",\"count\":2,\"avg\":\"25.70s\",\"max\":\"33.01s\",\"min\":\"18.39s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":7278098,\"count\":1,\"avg\":7278098,\"max\":7278098,\"min\":7278098},\"InputRows\":{\"sum\":7278000,\"count\":1,\"avg\":7278000,\"max\":7278000,\"min\":7278000},\"OutputBytes\":{\"sum\":7278098,\"count\":1,\"avg\":7278098,\"max\":7278098,\"min\":7278098},\"OutputRows\":{\"sum\":7278000,\"count\":1,\"avg\":7278000,\"max\":7278000,\"min\":7278000},\"EgressRows\":{\"sum\":21,\"count\":1,\"avg\":21,\"max\":21,\"min\":21},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:37,572 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:39,649 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"52.46s\",\"count\":2,\"avg\":\"26.23s\",\"max\":\"33.01s\",\"min\":\"19.45s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":7278098,\"count\":1,\"avg\":7278098,\"max\":7278098,\"min\":7278098},\"InputRows\":{\"sum\":7278000,\"count\":1,\"avg\":7278000,\"max\":7278000,\"min\":7278000},\"OutputBytes\":{\"sum\":8528112,\"count\":1,\"avg\":8528112,\"max\":8528112,\"min\":8528112},\"OutputRows\":{\"sum\":8528000,\"count\":1,\"avg\":8528000,\"max\":8528000,\"min\":8528000},\"EgressRows\":{\"sum\":21,\"count\":1,\"avg\":21,\"max\":21,\"min\":21},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:41,723 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"59.01s\",\"count\":2,\"avg\":\"29.50s\",\"max\":\"39.55s\",\"min\":\"19.45s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":8278092,\"count\":1,\"avg\":8278092,\"max\":8278092,\"min\":8278092},\"InputRows\":{\"sum\":8277987,\"count\":1,\"avg\":8277987,\"max\":8277987,\"min\":8277987},\"OutputBytes\":{\"sum\":8528112,\"count\":1,\"avg\":8528112,\"max\":8528112,\"min\":8528112},\"OutputRows\":{\"sum\":8528000,\"count\":1,\"avg\":8528000,\"max\":8528000,\"min\":8528000},\"EgressRows\":{\"sum\":25,\"count\":1,\"avg\":25,\"max\":25,\"min\":25},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:43,825 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:45,921 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"59.83s\",\"count\":2,\"avg\":\"29.91s\",\"max\":\"39.55s\",\"min\":\"20.27s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":8278092,\"count\":1,\"avg\":8278092,\"max\":8278092,\"min\":8278092},\"InputRows\":{\"sum\":8277987,\"count\":1,\"avg\":8277987,\"max\":8277987,\"min\":8277987},\"OutputBytes\":{\"sum\":8528112,\"count\":1,\"avg\":8528112,\"max\":8528112,\"min\":8528112},\"OutputRows\":{\"sum\":8528000,\"count\":1,\"avg\":8528000,\"max\":8528000,\"min\":8528000},\"EgressRows\":{\"sum\":25,\"count\":1,\"avg\":25,\"max\":25,\"min\":25},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:48,038 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:50,108 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"1m 06s\",\"count\":2,\"avg\":\"33.38s\",\"max\":\"45.58s\",\"min\":\"21.18s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":8528112,\"count\":1,\"avg\":8528112,\"max\":8528112,\"min\":8528112},\"InputRows\":{\"sum\":8528000,\"count\":1,\"avg\":8528000,\"max\":8528000,\"min\":8528000},\"OutputBytes\":{\"sum\":9778126,\"count\":1,\"avg\":9778126,\"max\":9778126,\"min\":9778126},\"OutputRows\":{\"sum\":9778000,\"count\":1,\"avg\":9778000,\"max\":9778000,\"min\":9778000},\"EgressRows\":{\"sum\":29,\"count\":1,\"avg\":29,\"max\":29,\"min\":29},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:52,185 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:54,256 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 12:59:56,327 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"1m 14s\",\"count\":2,\"avg\":\"37.21s\",\"max\":\"53.24s\",\"min\":\"21.18s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":9778126,\"count\":1,\"avg\":9778126,\"max\":9778126,\"min\":9778126},\"InputRows\":{\"sum\":9778000,\"count\":1,\"avg\":9778000,\"max\":9778000,\"min\":9778000},\"OutputBytes\":{\"sum\":10000133,\"count\":1,\"avg\":10000133,\"max\":10000133,\"min\":10000133},\"OutputRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"EgressRows\":{\"sum\":33,\"count\":1,\"avg\":33,\"max\":33,\"min\":33},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 12:59:58,392 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 13:00:00,452 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 13:00:02,528 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"1m 21s\",\"count\":2,\"avg\":\"40.58s\",\"max\":\"59.98s\",\"min\":\"21.18s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":10000133,\"count\":1,\"avg\":10000133,\"max\":10000133,\"min\":10000133},\"InputRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"OutputBytes\":{\"sum\":10000133,\"count\":1,\"avg\":10000133,\"max\":10000133,\"min\":10000133},\"OutputRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"EgressRows\":{\"sum\":37,\"count\":1,\"avg\":37,\"max\":37,\"min\":37},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 13:00:04,588 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    finished_at {
      seconds: 1762866002
      nanos: 516000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    result_expire_at {
      seconds: 1762952333
      nanos: 639480000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "Unknown uncommitted upload with prefix: http://localhost:19486/insert_bucket/insert/"
    severity: 3
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"1m 26s\",\"count\":2,\"avg\":\"43.06s\",\"max\":\"1m 04s\",\"min\":\"21.18s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":10000133,\"count\":1,\"avg\":10000133,\"max\":10000133,\"min\":10000133},\"InputRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"OutputBytes\":{\"sum\":10000133,\"count\":1,\"avg\":10000133,\"max\":10000133,\"min\":10000133},\"OutputRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"EgressBytes\":{\"sum\":20000006,\"count\":1,\"avg\":20000006,\"max\":20000006,\"min\":20000006},\"EgressRows\":{\"sum\":40,\"count\":1,\"avg\":40,\"max\":40,\"min\":40},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 13:00:04,590 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'insert_bucket', 'Prefix': 'insert/'}
2025-11-11 13:00:04,591 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7c148aa526d0>
2025-11-11 13:00:04,591 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7c148aa50910>
2025-11-11 13:00:04,592 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c148aa53d90>
2025-11-11 13:00:04,592 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 13:00:04,593 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7c148aa50670>
2025-11-11 13:00:04,593 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c148aa54030>
2025-11-11 13:00:04,594 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 13:00:04,595 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:19486', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 13:00:04,595 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:19486/insert_bucket
2025-11-11 13:00:04,596 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 13:00:04,597 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 13:00:04,598 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7c148aa50e50>
2025-11-11 13:00:04,599 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7c148aa50130>
2025-11-11 13:00:04,600 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7c148aa53af0>
2025-11-11 13:00:04,600 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'prefix': 'insert/', 'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:19486/insert_bucket?prefix=insert%2F&encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7b748ba6c5b0>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket', 'Prefix': 'insert/', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 13:00:04,601 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b748ba6cef0>>
2025-11-11 13:00:04,602 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b748bfd0ff0>>
2025-11-11 13:00:04,602 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7c148aa504b0>
2025-11-11 13:00:04,603 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7c148aa53f50>
2025-11-11 13:00:04,604 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 13:00:04,605 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/insert_bucket
encoding-type=url&prefix=insert%2F
host:localhost:19486
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251111T130004Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-11 13:00:04,605 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T130004Z
20251111/yandex/s3/aws4_request
38334053c140a8c991268ea62e4ae35b478e8fd2959a932928f4177cbcd64949
2025-11-11 13:00:04,606 - DEBUG - botocore.auth - add_auth: Signature:
e1194d5d0581559db829a1a6852299e374ef576be2b6f076c17dd6a37df15a3e
2025-11-11 13:00:04,606 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7c148aa53cb0>
2025-11-11 13:00:04,607 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:19486/insert_bucket?prefix=insert%2F&encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251111T130004Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251111/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=e1194d5d0581559db829a1a6852299e374ef576be2b6f076c17dd6a37df15a3e', 'amz-sdk-invocation-id': b'a86c1022-659d-494d-a564-608959da5bfe', 'amz-sdk-request': b'attempt=1'}>
2025-11-11 13:00:04,619 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 13:00:04 GMT', 'x-amzn-requestid': 'J593cxytDRGqjVWNwG3O0DXDY472MWibumO6v84kATQvkSv3Wp1b', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '648', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 13:00:04,620 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>insert_bucket</Name><Prefix>insert/</Prefix><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated><Contents><Key>insert/ptjudslr5h7ou3rd0k95_0_BsigdPfrikGKKK7cBWRhERUjYDOve0xk.csv</Key><LastModified>2025-11-11T13:00:02.000Z</LastModified><ETag>&#34;9af6ca18a79d7ab781c0a3adb3a8b2b1-4&#34;</ETag><Size>20000006</Size><StorageClass>STANDARD</StorageClass><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner></Contents></ListBucketResult>'
2025-11-11 13:00:04,623 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7b748b96d2b0>
2025-11-11 13:00:04,623 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 13:00:04,624 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 13:00:04,625 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7c148aa527b0>
2025-11-11 13:00:04,628 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-11 13:00:04,629 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-11 13:00:04,632 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7c148b66bb50>
2025-11-11 13:00:04,634 - DEBUG - root - create_query_impl: Request: content {
  type: ANALYTICS
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            select COUNT(idx) from ibucket.`insert/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ))\n        "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "82c248be-f39f-4ef6-997f-13974f030c40"

2025-11-11 13:00:04,784 - DEBUG - root - create_query_impl: Result: query_id: "ptqudslr301n3nub8qu5"

2025-11-11 13:00:04,844 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr301n3nub8qu5"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762866004
        nanos: 697625000
      }
      modified_at {
        seconds: 1762866004
        nanos: 697625000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudslr301n31iao6an-ptqudslr301n3nub8qu5"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762866004
      nanos: 697625000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select COUNT(idx) from ibucket.`insert/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ))\n        "
    syntax: YQL_V1
  }
}

2025-11-11 13:00:06,904 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr301n3nub8qu5"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762866004
        nanos: 697625000
      }
      modified_at {
        seconds: 1762866004
        nanos: 697625000
      }
      revision: 1
    }
    started_at {
      seconds: 1762866005
      nanos: 333000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr301n31iao6an-ptqudslr301n3nub8qu5"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762866004
      nanos: 697625000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select COUNT(idx) from ibucket.`insert/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ))\n        "
    syntax: YQL_V1
  }
}

2025-11-11 13:00:09,007 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr301n3nub8qu5"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762866004
        nanos: 697625000
      }
      modified_at {
        seconds: 1762866004
        nanos: 697625000
      }
      revision: 1
    }
    started_at {
      seconds: 1762866005
      nanos: 333000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr301n31iao6an-ptqudslr301n3nub8qu5"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762866004
      nanos: 697625000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select COUNT(idx) from ibucket.`insert/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ))\n        "
    syntax: YQL_V1
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":2,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
}

2025-11-11 13:00:10,904 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-11-11 13:00:10,904 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-11-11 13:00:10,944 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-11-11 13:00:10,945 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 7f91b1da-0ca9-4423-a660-9d0c2d208bd8, localhost:3423): creating call state
2025-11-11 13:00:10,948 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 7f91b1da-0ca9-4423-a660-9d0c2d208bd8, localhost:3423): request = { database: "local" }
2025-11-11 13:00:10,957 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 7f91b1da-0ca9-4423-a660-9d0c2d208bd8, localhost:3423): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-7dc5lolkfm.auto.internal" port: 3423 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-11-11 13:00:10,959 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-7dc5lolkfm.auto.internal:3423, location 1, ssl: False>]>
2025-11-11 13:00:10,964 - INFO - ydb.connection - close: Closing channel for endpoint localhost:3423
2025-11-11 13:00:11,109 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr301n3nub8qu5"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762866004
        nanos: 697625000
      }
      modified_at {
        seconds: 1762866004
        nanos: 697625000
      }
      revision: 1
    }
    started_at {
      seconds: 1762866005
      nanos: 333000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr301n31iao6an-ptqudslr301n3nub8qu5"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762866004
      nanos: 697625000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select COUNT(idx) from ibucket.`insert/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ))\n        "
    syntax: YQL_V1
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"3.94s\",\"count\":2,\"avg\":\"1.97s\",\"max\":\"3.72s\",\"min\":\"0.22s\"},\"IngressBytes\":{\"sum\":9912320,\"count\":1,\"avg\":9912320,\"max\":9912320,\"min\":9912320},\"IngressRows\":{\"sum\":4956000,\"count\":1,\"avg\":4956000,\"max\":4956000,\"min\":4956000},\"MaxMemoryUsage\":{\"sum\":393216,\"count\":2,\"avg\":196608,\"max\":262144,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
}

2025-11-11 13:00:13,226 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-11 13:00:15,381 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr301n3nub8qu5"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762866004
        nanos: 697625000
      }
      modified_at {
        seconds: 1762866004
        nanos: 697625000
      }
      revision: 1
    }
    started_at {
      seconds: 1762866005
      nanos: 333000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudslr301n31iao6an-ptqudslr301n3nub8qu5"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762866004
      nanos: 697625000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select COUNT(idx) from ibucket.`insert/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ))\n        "
    syntax: YQL_V1
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"7.64s\",\"count\":2,\"avg\":\"3.82s\",\"max\":\"7.41s\",\"min\":\"0.22s\"},\"IngressBytes\":{\"sum\":19841024,\"count\":1,\"avg\":19841024,\"max\":19841024,\"min\":19841024},\"IngressRows\":{\"sum\":9920000,\"count\":1,\"avg\":9920000,\"max\":9920000,\"min\":9920000},\"MaxMemoryUsage\":{\"sum\":393216,\"count\":2,\"avg\":196608,\"max\":262144,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
}

2025-11-11 13:00:17,436 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr301n3nub8qu5"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762866004
        nanos: 697625000
      }
      modified_at {
        seconds: 1762866004
        nanos: 697625000
      }
      revision: 1
    }
    started_at {
      seconds: 1762866005
      nanos: 333000000
    }
    finished_at {
      seconds: 1762866017
      nanos: 36000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudslr301n31iao6an-ptqudslr301n3nub8qu5"
    result_expire_at {
      seconds: 1762952405
      nanos: 297345000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762866004
      nanos: 697625000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            select COUNT(idx) from ibucket.`insert/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ))\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":13,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"DqPhyLength\"}]}},{\"Id\":11,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"Condense\"}]},\"DependsOn\":[13]},{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"AsList\"},{\"Name\":\"Iterator\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[11]},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":4,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":13,\"level\":1,\"name\":\"DqStage #13\",\"type\":\"op\"},{\"id\":11,\"level\":2,\"name\":\"DqStage #11\",\"type\":\"op\"},{\"id\":8,\"level\":3,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":4,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":5,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":13,\"target\":11},{\"source\":11,\"target\":8},{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Precompute=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"9.66s\",\"count\":2,\"avg\":\"4.83s\",\"max\":\"9.44s\",\"min\":\"0.22s\"},\"IngressBytes\":{\"sum\":20000006,\"count\":1,\"avg\":20000006,\"max\":20000006,\"min\":20000006},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":12,\"count\":2,\"avg\":6,\"max\":6,\"min\":6},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":393216,\"count\":2,\"avg\":196608,\"max\":262144,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}},\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.22s\",\"count\":2,\"avg\":\"0.11s\",\"max\":\"0.18s\",\"min\":\"34ms\"},\"InputBytes\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"InputRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"OutputBytes\":{\"sum\":12,\"count\":2,\"avg\":6,\"max\":6,\"min\":6},\"OutputRows\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"ResultBytes\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"ResultRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"MaxMemoryUsage\":{\"sum\":327680,\"count\":2,\"avg\":163840,\"max\":196608,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  result_set_meta {
    column {
      name: "column0"
      type {
        type_id: UINT64
      }
    }
    rows_count: 1
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"insert\\\"\\n  Children {\\n    Name: \\\"ptjudslr5h7ou3rd0k95_0_BsigdPfrikGKKK7cBWRhERUjYDOve0xk.csv\\\"\\n    Size: 20000006\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (S3ParseSettings world \'(\'((String $4) $5 (AsStruct))) (SecureParam \'\"cluster:default_ibucket\") \'\"\" \'\"insert/ \" \'\"csv_with_names\" (StructType \'(\'\"idx\" (DataType \'Int32))) (lambda \'($13) $5) \'()))\n(let $7 (DqStage \'((DqSource $3 $6)) (lambda \'($14) (block \'(\n  (let $15 (DqSourceWideWrap $14 $3 (StructType) \'(\'(\'format \'\"csv_with_names\"))))\n  (return (DqPhyLength (NarrowMap $15 (lambda \'() (AsStruct))) \'\"_dq_agg_cnt\"))\n))) \'(\'(\'\"_logical_id\" \'200476))))\n(let $8 (DqStage \'((DqCnUnionAll (TDqOutput $7 \'\"0\"))) (lambda \'($16) (Condense $16 (Uint64 \'\"0\") (lambda \'($17 $18) (Bool \'false)) (lambda \'($19 $20) (AggrAdd $20 (Member $19 \'\"_dq_agg_cnt\"))))) \'(\'(\'\"_logical_id\" \'200501))))\n(let $9 (DqStage \'((DqPhyPrecompute (DqCnValue (TDqOutput $8 \'\"0\")))) (lambda \'($21) (FlatMap (Iterator (AsList $21)) (lambda \'($22) (Just (AsStruct \'(\'\"column0\" $22)))))) \'(\'(\'\"_logical_id\" \'200549))))\n(let $10 (DqStage \'((DqCnUnionAll (TDqOutput $9 \'\"0\"))) (lambda \'($23) $23) \'(\'(\'\"_logical_id\" \'200629))))\n(let $11 \'(\'(\'type) \'(\'autoref) \'(\'columns \'(\'\"column0\"))))\n(let $12 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $10 \'\"0\") \'()) $11 \'\"dq\"))\n(return (Commit! (Commit! $12 $2) (DataSink \'\"s3\" \'\"ibucket\")))\n)\n"
  }
}

2025-11-11 13:00:19,149 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudslr5h7ovjf5bl9e"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1762865919
        nanos: 564481000
      }
      modified_at {
        seconds: 1762865919
        nanos: 564481000
      }
      revision: 1
    }
    started_at {
      seconds: 1762865934
      nanos: 120000000
    }
    finished_at {
      seconds: 1762866002
      nanos: 516000000
    }
    execute_mode: RUN
    status: COMPLETED
    last_job_query_revision: 1
    last_job_id: "ptjudslr5h7ou3rd0k95-ptqudslr5h7ovjf5bl9e"
    result_expire_at {
      seconds: 1762952333
      nanos: 639480000
    }
    started_by: "root@builtin"
    submitted_at {
      seconds: 1762865919
      nanos: 564481000
    }
  }
  content {
    type: ANALYTICS
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            pragma s3.AtomicUploadCommit = \"true\";\n\n            insert into ibucket.`insert/` with (format=csv_with_names)\n            select * from ibucket.`select/` with (format=csv_with_names, schema(\n                idx Int NOT NULL\n            ));\n        "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":5,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"S3SinkOutput\"}]},\"DependsOn\":[5]},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":2}},\"Basic\":{\"nodes\":[{\"id\":5,\"level\":1,\"name\":\"DqStage #5\",\"type\":\"op\"},{\"id\":3,\"level\":2,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":3,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":5,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "Unknown uncommitted upload with prefix: http://localhost:19486/insert_bucket/insert/"
    severity: 3
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"1m 26s\",\"count\":2,\"avg\":\"43.06s\",\"max\":\"1m 04s\",\"min\":\"21.18s\"},\"IngressBytes\":{\"sum\":20000004,\"count\":1,\"avg\":20000004,\"max\":20000004,\"min\":20000004},\"IngressRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"InputBytes\":{\"sum\":10000133,\"count\":1,\"avg\":10000133,\"max\":10000133,\"min\":10000133},\"InputRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"OutputBytes\":{\"sum\":10000133,\"count\":1,\"avg\":10000133,\"max\":10000133,\"min\":10000133},\"OutputRows\":{\"sum\":10000000,\"count\":1,\"avg\":10000000,\"max\":10000000,\"min\":10000000},\"EgressBytes\":{\"sum\":20000006,\"count\":1,\"avg\":20000006,\"max\":20000006,\"min\":20000006},\"EgressRows\":{\"sum\":40,\"count\":1,\"avg\":40,\"max\":40,\"min\":40},\"MaxMemoryUsage\":{\"sum\":240779392,\"count\":2,\"avg\":120389696,\"max\":238551168,\"min\":2228224},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"s3\" \'\"$all\") \'\"Attr\" \'\"atomicuploadcommit\" \'\"true\"))\n(let $3 (DataSource \'\"s3\" \'\"ibucket\"))\n(let $4 \'\"Paths {\\n  Name: \\\"select\\\"\\n  Children {\\n    Name: \\\"test.csv\\\"\\n    Size: 20000004\\n    Read: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $5 (Bool \'\"true\"))\n(let $6 (SecureParam \'\"cluster:default_ibucket\"))\n(let $7 (StructType \'(\'\"idx\" (DataType \'Int32))))\n(let $8 (S3ParseSettings $2 \'(\'((String $4) $5 (AsStruct))) $6 \'\"\" \'\"select/ \" \'\"csv_with_names\" $7 (lambda \'($12) $5) \'()))\n(let $9 (DqStage \'((DqSource $3 $8)) (lambda \'($13) (block \'(\n  (let $14 (DqSourceWideWrap $13 $3 $7 \'(\'(\'format \'\"csv_with_names\"))))\n  (return (NarrowMap $14 (lambda \'($15) (AsStruct \'(\'\"idx\" $15)))))\n))) \'(\'(\'\"_logical_id\" \'200083))))\n(let $10 (DataSink \'\"s3\" \'\"ibucket\"))\n(let $11 (S3SinkSettings \'\"insert/\" \'(\'(\'\"multipart\" \'\"true\")) $6 \'\".csv\" $7))\n(return (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $9 \'\"0\"))) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\") \'(\'\"file_size_limit\" \'\"52428800\")))\n  (return (S3SinkOutput $16 \'\"csv_with_names\" \'() $17))\n))) \'() \'((DqSink \'\"0\" $10 $11))))) $10))\n)\n"
  }
}

2025-11-11 13:00:19,151 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_multipart_uploads with {'Bucket': 'insert_bucket'}
2025-11-11 13:00:19,152 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListMultipartUploads: calling handler <function validate_bucket_name at 0x7c148aa50910>
2025-11-11 13:00:19,152 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListMultipartUploads: calling handler <function remove_bucket_from_url_paths_from_model at 0x7c148aa53d90>
2025-11-11 13:00:19,153 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListMultipartUploads: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 13:00:19,153 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListMultipartUploads: calling handler <function generate_idempotent_uuid at 0x7c148aa50670>
2025-11-11 13:00:19,153 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7c148aa54030>
2025-11-11 13:00:19,154 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 13:00:19,154 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'insert_bucket', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:19486', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-11 13:00:19,155 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:19486/insert_bucket
2025-11-11 13:00:19,155 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-11 13:00:19,160 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-11 13:00:19,162 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListMultipartUploads: calling handler <function add_expect_header at 0x7c148aa50e50>
2025-11-11 13:00:19,162 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListMultipartUploads: calling handler <function add_recursion_detection_header at 0x7c148aa50130>
2025-11-11 13:00:19,163 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListMultipartUploads: calling handler <function inject_api_version_header_if_needed at 0x7c148aa53af0>
2025-11-11 13:00:19,163 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListMultipartUploads) with params: {'url_path': '?uploads', 'query_string': {}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/insert_bucket/', 'url': 'http://localhost:19486/insert_bucket?uploads', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7b748ba6c5b0>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'insert_bucket', 'params': {'Bucket': 'insert_bucket'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-11 13:00:19,164 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListMultipartUploads: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7b748ba6cef0>>
2025-11-11 13:00:19,165 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListMultipartUploads: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7b748bfd0ff0>>
2025-11-11 13:00:19,166 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListMultipartUploads: calling handler <function set_operation_specific_signer at 0x7c148aa504b0>
2025-11-11 13:00:19,166 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListMultipartUploads: calling handler <function remove_arn_from_signing_path at 0x7c148aa53f50>
2025-11-11 13:00:19,167 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-11 13:00:19,168 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/insert_bucket
uploads=
host:localhost:19486
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251111T130019Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-11 13:00:19,169 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251111T130019Z
20251111/yandex/s3/aws4_request
699c8944de8af865ce09571a06e95297eb2cef47a2376906c718e4cee4b14fa9
2025-11-11 13:00:19,170 - DEBUG - botocore.auth - add_auth: Signature:
cc1bcfe2fd1dec9dbcac2085906536e0f8e00c3d444a840c8d2d89a6a34ac3e6
2025-11-11 13:00:19,171 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListMultipartUploads: calling handler <function add_retry_headers at 0x7c148aa53cb0>
2025-11-11 13:00:19,172 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:19486/insert_bucket?uploads, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.11 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251111T130019Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251111/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=cc1bcfe2fd1dec9dbcac2085906536e0f8e00c3d444a840c8d2d89a6a34ac3e6', 'amz-sdk-invocation-id': b'37fc6561-636b-4439-8d1b-5ff6744c5811', 'amz-sdk-request': b'attempt=1'}>
2025-11-11 13:00:19,210 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.11', 'Date': 'Tue, 11 Nov 2025 13:00:19 GMT', 'x-amzn-requestid': 'M9LTshmVS2UsEJ3RLsIyUcZwFYolqnVOJN4YAhjhXmpoTpQXaByr', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '839', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-11 13:00:19,213 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListMultipartUploadsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Bucket>insert_bucket</Bucket><KeyMarker></KeyMarker><UploadIdMarker></UploadIdMarker><MaxUploads>1000</MaxUploads><IsTruncated>false</IsTruncated><Upload><Key>insert/ptjudslrbndrb0521ojp_0_tWZyR_YowEC1wga-lVGVfg0rGX0lziRm.csv</Key><UploadId>QpWYh6g47xjGkHdsMFF2UoemEtUkhYvYILe5bCG1lb3qaSaXxYwuCQ</UploadId><Initiator><ID>arn:aws:iam::123456789012:user/user1-11111a31-17b5-4fb7-9df5-b111111f13de</ID><DisplayName>user1-11111a31-17b5-4fb7-9df5-b111111f13de</DisplayName></Initiator><Owner><ID>75aa57f09aa0c8caeab4f8c24e99d10f8e7faeebf76c078efc7c6caea54ba06a</ID><DisplayName>webfile</DisplayName></Owner><StorageClass>STANDARD</StorageClass><Initiated>2010-11-10T20:48:33.000Z</Initiated></Upload></ListMultipartUploadsResult>'
2025-11-11 13:00:19,217 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListMultipartUploads: calling handler <botocore.retryhandler.RetryHandler object at 0x7b748b96d2b0>
2025-11-11 13:00:19,217 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-11 13:00:19,217 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListMultipartUploads: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7b748b96c130>>
2025-11-11 13:00:19,218 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:MultipartUpload
2025-11-11 13:00:19,263 - ERROR - ya.test - logreport: ydb/tests/fq/restarts/test_insert_restarts.py:118: in test_atomic_upload_commit
    assert len(list(bucket.multipart_uploads.all())) == 0, "Unexpected uncommitted upload in bucket"
E   AssertionError: Unexpected uncommitted upload in bucket
E   assert 1 == 0
E    +  where 1 = len([s3.MultipartUpload(bucket_name='insert_bucket', object_key='insert/ptjudslrbndrb0521ojp_0_tWZyR_YowEC1wga-lVGVfg0rGX0lziRm.csv', id='QpWYh6g47xjGkHdsMFF2UoemEtUkhYvYILe5bCG1lb3qaSaXxYwuCQ')])
E    +    where [s3.MultipartUpload(bucket_name='insert_bucket', object_key='insert/ptjudslrbndrb0521ojp_0_tWZyR_YowEC1wga-lVGVfg0rGX0lziRm.csv', id='QpWYh6g47xjGkHdsMFF2UoemEtUkhYvYILe5bCG1lb3qaSaXxYwuCQ')] = list(s3.Bucket.multipart_uploadsCollection(s3.Bucket(name='insert_bucket'), s3.MultipartUpload))
E    +      where s3.Bucket.multipart_uploadsCollection(s3.Bucket(name='insert_bucket'), s3.MultipartUpload) = <bound method CollectionFactory._load_documented_collection_methods.<locals>.all of s3.Bucket.multipart_uploadsCollectionManager(s3.Bucket(name='insert_bucket'), s3.MultipartUpload)>()
E    +        where <bound method CollectionFactory._load_documented_collection_methods.<locals>.all of s3.Bucket.multipart_uploadsCollectionManager(s3.Bucket(name='insert_bucket'), s3.MultipartUpload)> = s3.Bucket.multipart_uploadsCollectionManager(s3.Bucket(name='insert_bucket'), s3.MultipartUpload).all
E    +          where s3.Bucket.multipart_uploadsCollectionManager(s3.Bucket(name='insert_bucket'), s3.MultipartUpload) = s3.Bucket(name='insert_bucket').multipart_uploads
2025-11-11 13:00:19,268 - INFO - ya.test - pytest_runtest_teardown: Test teardown
2025-11-11 13:00:26,270 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:20209/1
2025-11-11 13:00:26,273 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/6487
2025-11-11 13:00:26,275 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/21945
2025-11-11 13:00:26,277 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/16376
2025-11-11 13:00:26,278 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/20209
2025-11-11 13:00:26,278 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/23192
2025-11-11 13:00:26,279 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/8135
