2025-11-14 10:11:35,252 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:11:35,253 - INFO - ya.test - pytest_runtest_setup: test_checkpoints_on_join_s3_with_yds[v1-mvp_external_ydb_endpoint0-client0]
2025-11-14 10:11:35,253 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-11-14 10:11:35,253 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-11-14 10:11:36,255 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:13513/1
2025-11-14 10:11:36,256 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/63041
2025-11-14 10:11:36,256 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/10781
2025-11-14 10:11:36,257 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/13513
2025-11-14 10:11:36,257 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/18999
2025-11-14 10:11:36,257 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/62298
2025-11-14 10:11:36,257 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/20471
2025-11-14 10:11:43,259 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:15181/1
2025-11-14 10:11:43,259 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/28951
2025-11-14 10:11:43,260 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/62203
2025-11-14 10:11:43,260 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/15181
2025-11-14 10:11:43,260 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/15847
2025-11-14 10:11:43,261 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/8625
2025-11-14 10:11:44,262 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:64195/1
2025-11-14 10:11:44,263 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/12657
2025-11-14 10:11:44,263 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/14230
2025-11-14 10:11:44,263 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/64195
2025-11-14 10:11:44,264 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/22345
2025-11-14 10:11:44,264 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/21390
2025-11-14 10:11:44,264 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/19375
2025-11-14 10:11:44,266 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/10507
2025-11-14 10:11:44,267 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/5888
2025-11-14 10:11:44,324 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:44,325 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1194
2025-11-14 10:11:44,326 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/27214
2025-11-14 10:11:44,326 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/11541
2025-11-14 10:11:44,327 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/11541
2025-11-14 10:11:44,327 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/11542
2025-11-14 10:11:44,327 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')]
2025-11-14 10:11:44,329 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-11-14 10:11:44,330 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')]
2025-11-14 10:11:44,333 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-11-14 10:11:44,334 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 5c718cb9-da5d-45bd-99d9-b40ea280664f, localhost:4203): creating call state
2025-11-14 10:11:44,334 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 5c718cb9-da5d-45bd-99d9-b40ea280664f, localhost:4203): request = { database: "local" }
2025-11-14 10:11:44,337 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 5c718cb9-da5d-45bd-99d9-b40ea280664f, localhost:4203): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-adxazuzm5e.auto.internal" port: 4203 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-11-14 10:11:44,337 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-adxazuzm5e.auto.internal:4203, location 1, ssl: False>]>
2025-11-14 10:11:44,338 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')]
2025-11-14 10:11:44,341 - INFO - ydb.connection - close: Closing channel for endpoint localhost:4203
2025-11-14 10:11:44,343 - DEBUG - ydb.table.SessionPool - subscribe: Active session queue is empty, subscribe waiter for a session
2025-11-14 10:11:44,343 - DEBUG - ydb.table.SessionPool - subscribe: Subscribe waiter <Future at 0x7f2efebc1730 state=pending>
2025-11-14 10:11:44,343 - DEBUG - ydb.table.SessionPool - subscribe: Session pool is not large enough (active_count < size: 0 < 1). will create a new session.
2025-11-14 10:11:44,343 - DEBUG - ydb.table.SessionPool - _create: Created session <ydb.table.Session object at 0x7f2efebc1870>
2025-11-14 10:11:44,344 - DEBUG - ydb.table.SessionPool - _prepare: Preparing session <ydb.table.Session object at 0x7f2efebc1870>
2025-11-14 10:11:44,344 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateSession, 82c81ebf-dba6-4c18-80f5-a05e13231110, ghrun-adxazuzm5e.auto.internal:4203): creating call state
2025-11-14 10:11:44,344 - DEBUG - ydb.connection - _log_request: RpcState(CreateSession, 82c81ebf-dba6-4c18-80f5-a05e13231110, ghrun-adxazuzm5e.auto.internal:4203): request = { operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } }
2025-11-14 10:11:44,346 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 82c81ebf-dba6-4c18-80f5-a05e13231110, ghrun-adxazuzm5e.auto.internal:4203): on response callback started
2025-11-14 10:11:44,347 - DEBUG - ydb.connection - _log_response: RpcState(CreateSession, 82c81ebf-dba6-4c18-80f5-a05e13231110, ghrun-adxazuzm5e.auto.internal:4203): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.CreateSessionResult] { session_id: "ydb://session/3?node_id=1&id=YmRlMGFmYzItYTExMzIwOGMtYWUwNzQxZGItNWI5NzdjMzM=" } } } }
2025-11-14 10:11:44,347 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f2efebc1870>
2025-11-14 10:11:44,348 - DEBUG - ydb.table.SessionPool - put: Replying to waiter with a session <ydb.table.Session object at 0x7f2efebc1870>
2025-11-14 10:11:44,348 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 82c81ebf-dba6-4c18-80f5-a05e13231110, ghrun-adxazuzm5e.auto.internal:4203): on response callback success
2025-11-14 10:11:44,348 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, cf50a5e5-cdc7-4b50-8479-e3398e5526be, ghrun-adxazuzm5e.auto.internal:4203): creating call state
2025-11-14 10:11:44,350 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, cf50a5e5-cdc7-4b50-8479-e3398e5526be, ghrun-adxazuzm5e.auto.internal:4203): request = { session_id: "ydb://session/3?node_id=1&id=YmRlMGFmYzItYTExMzIwOGMtYWUwNzQxZGItNWI5NzdjMzM=" path: "local/DbPoolStorage_ee1e5ab9-2c68-4347-8d2c-f6607ca4cba6/tenants" columns { name: "tenant" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "common" type { optional_type { item { type_id: BOOL } } } } columns { name: "state" type { optional_type { item { type_id: UINT32 } } } } columns { name: "state_time" type { optional_type { item { type_id: TIMESTAMP } } } } primary_key: "tenant" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-14 10:11:44,368 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, cf50a5e5-cdc7-4b50-8479-e3398e5526be, ghrun-adxazuzm5e.auto.internal:4203): response = { operation { ready: true status: SUCCESS } }
2025-11-14 10:11:44,369 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f2efebc1870>
2025-11-14 10:11:44,370 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 0221e657-b5d6-4f3b-a95a-385aab381c00, ghrun-adxazuzm5e.auto.internal:4203): creating call state
2025-11-14 10:11:44,370 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 0221e657-b5d6-4f3b-a95a-385aab381c00, ghrun-adxazuzm5e.auto.internal:4203): request = { session_id: "ydb://session/3?node_id=1&id=YmRlMGFmYzItYTExMzIwOGMtYWUwNzQxZGItNWI5NzdjMzM=" path: "local/DbPoolStorage_ee1e5ab9-2c68-4347-8d2c-f6607ca4cba6/mappings" columns { name: "subject_type" type { optional_type { item { type_id: STRING } } } } columns { name: "subject_id" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } primary_key: "subject_type" primary_key: "subject_id" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-14 10:11:44,385 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 0221e657-b5d6-4f3b-a95a-385aab381c00, ghrun-adxazuzm5e.auto.internal:4203): response = { operation { ready: true status: SUCCESS } }
2025-11-14 10:11:44,386 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f2efebc1870>
2025-11-14 10:11:44,387 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteDataQuery, 5148218d-3f03-4e4d-b9a1-6ff45a2fc9eb, ghrun-adxazuzm5e.auto.internal:4203): creating call state
2025-11-14 10:11:44,387 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteDataQuery, 5148218d-3f03-4e4d-b9a1-6ff45a2fc9eb, ghrun-adxazuzm5e.auto.internal:4203): request = { session_id: "ydb://session/3?node_id=1&id=YmRlMGFmYzItYTExMzIwOGMtYWUwNzQxZGItNWI5NzdjMzM=" tx_control { begin_tx { serializable_read_write { } } commit_tx: true } query { yql_text: "--!syntax_v1\n            PRAGMA TablePathPrefix(\"local/DbPoolStorage_ee1e5ab9-2c68-4347-8d2c-f6607ca4cba6\");\n            UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/default\", \"/default\", true, 0, CurrentUtcTimestamp());\n                " } operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-14 10:11:44,405 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteDataQuery, 5148218d-3f03-4e4d-b9a1-6ff45a2fc9eb, ghrun-adxazuzm5e.auto.internal:4203): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.ExecuteQueryResult] { tx_meta { } } } } }
2025-11-14 10:11:44,406 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f2efebc1870>
2025-11-14 10:11:44,476 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:44,478 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/10151
2025-11-14 10:11:44,479 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/6143
2025-11-14 10:11:44,479 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/default/kikimr_configs"
2025-11-14 10:11:44,480 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/default/node_1/logfile_m5ohfm8e.log --grpc-port=11542 --mon-port=10151 --ic-port=1194
2025-11-14 10:11:44,481 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/default/kikimr_configs/config.yaml', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/default/node_1/logfile_m5ohfm8e.log', '--grpc-port=11542', '--mon-port=10151', '--ic-port=1194')' in '/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/default/node_1' (no wait)
2025-11-14 10:11:44,483 - DEBUG - ya.test - execute: Command pid: 586817
2025-11-14 10:11:44,484 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:11542/1
2025-11-14 10:11:44,485 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-11-14 10:11:44,488 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/6230
2025-11-14 10:11:44,489 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/5817
2025-11-14 10:11:44,573 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:44,574 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/26059
2025-11-14 10:11:44,575 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/31176
2025-11-14 10:11:44,652 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:44,653 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/4994
2025-11-14 10:11:44,654 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/8855
2025-11-14 10:11:44,655 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/10924
2025-11-14 10:11:44,656 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')]
2025-11-14 10:11:44,659 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-11-14 10:11:44,660 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')]
2025-11-14 10:11:44,665 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-11-14 10:11:44,666 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, d9a860aa-dd16-4bd6-8dc4-b26da997ed69, localhost:4203): creating call state
2025-11-14 10:11:44,667 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, d9a860aa-dd16-4bd6-8dc4-b26da997ed69, localhost:4203): request = { database: "local" }
2025-11-14 10:11:44,670 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, d9a860aa-dd16-4bd6-8dc4-b26da997ed69, localhost:4203): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-adxazuzm5e.auto.internal" port: 4203 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-11-14 10:11:44,671 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-adxazuzm5e.auto.internal:4203, location 1, ssl: False>]>
2025-11-14 10:11:44,671 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')]
2025-11-14 10:11:44,674 - INFO - ydb.connection - close: Closing channel for endpoint localhost:4203
2025-11-14 10:11:44,676 - DEBUG - ydb.table.SessionPool - subscribe: Active session queue is empty, subscribe waiter for a session
2025-11-14 10:11:44,677 - DEBUG - ydb.table.SessionPool - subscribe: Subscribe waiter <Future at 0x7f2f06f5bad0 state=pending>
2025-11-14 10:11:44,677 - DEBUG - ydb.table.SessionPool - subscribe: Session pool is not large enough (active_count < size: 0 < 1). will create a new session.
2025-11-14 10:11:44,678 - DEBUG - ydb.table.SessionPool - _create: Created session <ydb.table.Session object at 0x7f2f06f591e0>
2025-11-14 10:11:44,678 - DEBUG - ydb.table.SessionPool - _prepare: Preparing session <ydb.table.Session object at 0x7f2f06f591e0>
2025-11-14 10:11:44,679 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateSession, 85e8b46a-0712-4e12-86b2-50f5b8886454, ghrun-adxazuzm5e.auto.internal:4203): creating call state
2025-11-14 10:11:44,679 - DEBUG - ydb.connection - _log_request: RpcState(CreateSession, 85e8b46a-0712-4e12-86b2-50f5b8886454, ghrun-adxazuzm5e.auto.internal:4203): request = { operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } }
2025-11-14 10:11:44,682 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 85e8b46a-0712-4e12-86b2-50f5b8886454, ghrun-adxazuzm5e.auto.internal:4203): on response callback started
2025-11-14 10:11:44,683 - DEBUG - ydb.connection - _log_response: RpcState(CreateSession, 85e8b46a-0712-4e12-86b2-50f5b8886454, ghrun-adxazuzm5e.auto.internal:4203): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.CreateSessionResult] { session_id: "ydb://session/3?node_id=1&id=ZjY3MWYxZjEtNTM5NjJmZWItOWJkZDAxYjMtNGU4ZTA1MDg=" } } } }
2025-11-14 10:11:44,683 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f2f06f591e0>
2025-11-14 10:11:44,684 - DEBUG - ydb.table.SessionPool - put: Replying to waiter with a session <ydb.table.Session object at 0x7f2f06f591e0>
2025-11-14 10:11:44,685 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 4f52f586-f1b7-46e0-ac3c-4a11ef8dd31e, ghrun-adxazuzm5e.auto.internal:4203): creating call state
2025-11-14 10:11:44,685 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 85e8b46a-0712-4e12-86b2-50f5b8886454, ghrun-adxazuzm5e.auto.internal:4203): on response callback success
2025-11-14 10:11:44,686 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 4f52f586-f1b7-46e0-ac3c-4a11ef8dd31e, ghrun-adxazuzm5e.auto.internal:4203): request = { session_id: "ydb://session/3?node_id=1&id=ZjY3MWYxZjEtNTM5NjJmZWItOWJkZDAxYjMtNGU4ZTA1MDg=" path: "local/DbPoolStorage_721a55fe-6128-44f3-a300-2ec608bfdf8e/tenants" columns { name: "tenant" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "common" type { optional_type { item { type_id: BOOL } } } } columns { name: "state" type { optional_type { item { type_id: UINT32 } } } } columns { name: "state_time" type { optional_type { item { type_id: TIMESTAMP } } } } primary_key: "tenant" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-14 10:11:44,704 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 4f52f586-f1b7-46e0-ac3c-4a11ef8dd31e, ghrun-adxazuzm5e.auto.internal:4203): response = { operation { ready: true status: SUCCESS } }
2025-11-14 10:11:44,704 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f2f06f591e0>
2025-11-14 10:11:44,705 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, a495b855-5af4-4218-bbfd-ea63fa529cb0, ghrun-adxazuzm5e.auto.internal:4203): creating call state
2025-11-14 10:11:44,706 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, a495b855-5af4-4218-bbfd-ea63fa529cb0, ghrun-adxazuzm5e.auto.internal:4203): request = { session_id: "ydb://session/3?node_id=1&id=ZjY3MWYxZjEtNTM5NjJmZWItOWJkZDAxYjMtNGU4ZTA1MDg=" path: "local/DbPoolStorage_721a55fe-6128-44f3-a300-2ec608bfdf8e/mappings" columns { name: "subject_type" type { optional_type { item { type_id: STRING } } } } columns { name: "subject_id" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } primary_key: "subject_type" primary_key: "subject_id" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-14 10:11:44,721 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, a495b855-5af4-4218-bbfd-ea63fa529cb0, ghrun-adxazuzm5e.auto.internal:4203): response = { operation { ready: true status: SUCCESS } }
2025-11-14 10:11:44,721 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f2f06f591e0>
2025-11-14 10:11:44,722 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteDataQuery, 0be70f65-3c3e-48e8-b38d-5745029178b2, ghrun-adxazuzm5e.auto.internal:4203): creating call state
2025-11-14 10:11:44,723 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteDataQuery, 0be70f65-3c3e-48e8-b38d-5745029178b2, ghrun-adxazuzm5e.auto.internal:4203): request = { session_id: "ydb://session/3?node_id=1&id=ZjY3MWYxZjEtNTM5NjJmZWItOWJkZDAxYjMtNGU4ZTA1MDg=" tx_control { begin_tx { serializable_read_write { } } commit_tx: true } query { yql_text: "--!syntax_v1\n            PRAGMA TablePathPrefix(\"local/DbPoolStorage_721a55fe-6128-44f3-a300-2ec608bfdf8e\");\n            UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/cp\", \"/cp\", true, 0, CurrentUtcTimestamp());\n                UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/compute\", \"/compute\", true, 0, CurrentUtcTimestamp());\n                " } operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-11-14 10:11:44,746 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteDataQuery, 0be70f65-3c3e-48e8-b38d-5745029178b2, ghrun-adxazuzm5e.auto.internal:4203): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.ExecuteQueryResult] { tx_meta { } } } } }
2025-11-14 10:11:44,747 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f2f06f591e0>
2025-11-14 10:11:44,747 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/3385
2025-11-14 10:11:44,967 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:44,968 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/17285
2025-11-14 10:11:44,968 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/17286
2025-11-14 10:11:44,969 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/15999
2025-11-14 10:11:44,969 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/cp/kikimr_configs"
2025-11-14 10:11:44,970 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/cp/node_1/logfile_yz7j1na1.log --grpc-port=10924 --mon-port=17286 --ic-port=26059
2025-11-14 10:11:44,971 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/cp/kikimr_configs/config.yaml', '--node=1', '--tenant=/cp', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/cp/node_1/logfile_yz7j1na1.log', '--grpc-port=10924', '--mon-port=17286', '--ic-port=26059')' in '/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/cp/node_1' (no wait)
2025-11-14 10:11:44,972 - DEBUG - ya.test - execute: Command pid: 587064
2025-11-14 10:11:44,973 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:10924/1
2025-11-14 10:11:44,973 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-11-14 10:11:45,020 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:45,021 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16760
2025-11-14 10:11:45,021 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16390
2025-11-14 10:11:45,022 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/compute/kikimr_configs"
2025-11-14 10:11:45,022 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --log-file-name=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/compute/node_1/logfile_g10xopu8.log --grpc-port=3385 --mon-port=16760 --ic-port=4994
2025-11-14 10:11:45,023 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/compute/kikimr_configs/config.yaml', '--node=1', '--log-file-name=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/compute/node_1/logfile_g10xopu8.log', '--grpc-port=3385', '--mon-port=16760', '--ic-port=4994')' in '/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/compute/node_1' (no wait)
2025-11-14 10:11:45,025 - DEBUG - ya.test - execute: Command pid: 587069
2025-11-14 10:11:45,026 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:3385/1
2025-11-14 10:11:46,768 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:46,770 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.8
2025-11-14 10:11:46,770 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.8
2025-11-14 10:11:46,771 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd', '--server=grpc://localhost:3385', 'admin', 'blobstorage', 'config', 'invoke', '--proto=Command {\n  DefineHostConfig {\n    HostConfigId: 1\n    Drive {\n      Path: "SectorMap:1:64"\n    }\n  }\n}\nCommand {\n  DefineBox {\n    BoxId: 1\n    Host {\n      Key {\n        Fqdn: "localhost"\n        IcPort: 4994\n      }\n      HostConfigId: 1\n    }\n  }\n}\n']' in 'None' (waiting)
2025-11-14 10:11:46,772 - DEBUG - ya.test - execute: Command pid: 588303
2025-11-14 10:11:47,195 - DEBUG - ya.test - _save_outputs: Command (pid 588303) rc: 0
2025-11-14 10:11:47,196 - DEBUG - ya.test - _save_outputs: Command (pid 588303) elapsed time (sec): 0.4230177402496338
2025-11-14 10:11:47,196 - DEBUG - ya.test - _save_outputs: Command (pid 588303) idrss: 0
2025-11-14 10:11:47,196 - DEBUG - ya.test - _save_outputs: Command (pid 588303) inblock: 0
2025-11-14 10:11:47,196 - DEBUG - ya.test - _save_outputs: Command (pid 588303) isrss: 0
2025-11-14 10:11:47,197 - DEBUG - ya.test - _save_outputs: Command (pid 588303) ixrss: 0
2025-11-14 10:11:47,197 - DEBUG - ya.test - _save_outputs: Command (pid 588303) majflt: 0
2025-11-14 10:11:47,197 - DEBUG - ya.test - _save_outputs: Command (pid 588303) maxrss: 525756
2025-11-14 10:11:47,197 - DEBUG - ya.test - _save_outputs: Command (pid 588303) minflt: 19687
2025-11-14 10:11:47,197 - DEBUG - ya.test - _save_outputs: Command (pid 588303) msgrcv: 0
2025-11-14 10:11:47,197 - DEBUG - ya.test - _save_outputs: Command (pid 588303) msgsnd: 0
2025-11-14 10:11:47,198 - DEBUG - ya.test - _save_outputs: Command (pid 588303) nivcsw: 12
2025-11-14 10:11:47,198 - DEBUG - ya.test - _save_outputs: Command (pid 588303) nsignals: 0
2025-11-14 10:11:47,198 - DEBUG - ya.test - _save_outputs: Command (pid 588303) nswap: 0
2025-11-14 10:11:47,198 - DEBUG - ya.test - _save_outputs: Command (pid 588303) nvcsw: 136
2025-11-14 10:11:47,198 - DEBUG - ya.test - _save_outputs: Command (pid 588303) oublock: 8
2025-11-14 10:11:47,198 - DEBUG - ya.test - _save_outputs: Command (pid 588303) stime: 0.277727
2025-11-14 10:11:47,199 - DEBUG - ya.test - _save_outputs: Command (pid 588303) utime: 0.099188
2025-11-14 10:11:47,199 - DEBUG - ya.test - _save_outputs: Command (pid 588303) wtime: 0.424
2025-11-14 10:11:47,199 - DEBUG - ya.test - _save_outputs: Command (pid 588303) output:
Status {
  Success: true
}
Status {
  Success: true
}
Success: true
ConfigTxSeqNo: 5

2025-11-14 10:11:47,199 - DEBUG - ya.test - _save_outputs: Command (pid 588303) errors:

2025-11-14 10:11:47,200 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:47,201 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.9
2025-11-14 10:11:47,202 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.9
2025-11-14 10:11:47,202 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd', '--server=grpc://localhost:3385', 'admin', 'blobstorage', 'config', 'invoke', '--proto=Command {\n  DefineStoragePool {\n    BoxId: 1\n    StoragePoolId: 1\n    Name: "dynamic_storage_pool:1"\n    ErasureSpecies: "none"\n    VDiskKind: "Default"\n    Kind: "hdd"\n    NumGroups: 2\n    PDiskFilter {\n      Property {\n        Type: ROT\n      }\n      Property {\n        Kind: 0\n      }\n    }\n  }\n}\n']' in 'None' (waiting)
2025-11-14 10:11:47,203 - DEBUG - ya.test - execute: Command pid: 588557
2025-11-14 10:11:47,623 - DEBUG - ya.test - _save_outputs: Command (pid 588557) rc: 0
2025-11-14 10:11:47,624 - DEBUG - ya.test - _save_outputs: Command (pid 588557) elapsed time (sec): 0.4127178192138672
2025-11-14 10:11:47,624 - DEBUG - ya.test - _save_outputs: Command (pid 588557) idrss: 0
2025-11-14 10:11:47,624 - DEBUG - ya.test - _save_outputs: Command (pid 588557) inblock: 0
2025-11-14 10:11:47,624 - DEBUG - ya.test - _save_outputs: Command (pid 588557) isrss: 0
2025-11-14 10:11:47,624 - DEBUG - ya.test - _save_outputs: Command (pid 588557) ixrss: 0
2025-11-14 10:11:47,624 - DEBUG - ya.test - _save_outputs: Command (pid 588557) majflt: 0
2025-11-14 10:11:47,624 - DEBUG - ya.test - _save_outputs: Command (pid 588557) maxrss: 525756
2025-11-14 10:11:47,625 - DEBUG - ya.test - _save_outputs: Command (pid 588557) minflt: 19686
2025-11-14 10:11:47,625 - DEBUG - ya.test - _save_outputs: Command (pid 588557) msgrcv: 0
2025-11-14 10:11:47,625 - DEBUG - ya.test - _save_outputs: Command (pid 588557) msgsnd: 0
2025-11-14 10:11:47,625 - DEBUG - ya.test - _save_outputs: Command (pid 588557) nivcsw: 10
2025-11-14 10:11:47,625 - DEBUG - ya.test - _save_outputs: Command (pid 588557) nsignals: 0
2025-11-14 10:11:47,625 - DEBUG - ya.test - _save_outputs: Command (pid 588557) nswap: 0
2025-11-14 10:11:47,626 - DEBUG - ya.test - _save_outputs: Command (pid 588557) nvcsw: 126
2025-11-14 10:11:47,626 - DEBUG - ya.test - _save_outputs: Command (pid 588557) oublock: 8
2025-11-14 10:11:47,626 - DEBUG - ya.test - _save_outputs: Command (pid 588557) stime: 0.263569
2025-11-14 10:11:47,626 - DEBUG - ya.test - _save_outputs: Command (pid 588557) utime: 0.099801
2025-11-14 10:11:47,626 - DEBUG - ya.test - _save_outputs: Command (pid 588557) wtime: 0.414
2025-11-14 10:11:47,627 - DEBUG - ya.test - _save_outputs: Command (pid 588557) output:
Status {
  Success: true
}
Success: true
ConfigTxSeqNo: 6

2025-11-14 10:11:47,627 - DEBUG - ya.test - _save_outputs: Command (pid 588557) errors:

2025-11-14 10:11:47,628 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd
2025-11-14 10:11:47,629 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.10
2025-11-14 10:11:47,629 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.10
2025-11-14 10:11:47,630 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd', '--server=grpc://localhost:3385', 'admin', 'blobstorage', 'config', 'invoke', '--proto=Command {\n  DefineStoragePool {\n    BoxId: 1\n    StoragePoolId: 2\n    Name: "dynamic_storage_pool:2"\n    ErasureSpecies: "none"\n    VDiskKind: "Default"\n    Kind: "ssd"\n    NumGroups: 2\n    PDiskFilter {\n      Property {\n        Type: ROT\n      }\n      Property {\n        Kind: 0\n      }\n    }\n  }\n}\n']' in 'None' (waiting)
2025-11-14 10:11:47,631 - DEBUG - ya.test - execute: Command pid: 588844
2025-11-14 10:11:48,062 - DEBUG - ya.test - _save_outputs: Command (pid 588844) rc: 0
2025-11-14 10:11:48,063 - DEBUG - ya.test - _save_outputs: Command (pid 588844) elapsed time (sec): 0.4241771697998047
2025-11-14 10:11:48,063 - DEBUG - ya.test - _save_outputs: Command (pid 588844) idrss: 0
2025-11-14 10:11:48,063 - DEBUG - ya.test - _save_outputs: Command (pid 588844) inblock: 0
2025-11-14 10:11:48,063 - DEBUG - ya.test - _save_outputs: Command (pid 588844) isrss: 0
2025-11-14 10:11:48,064 - DEBUG - ya.test - _save_outputs: Command (pid 588844) ixrss: 0
2025-11-14 10:11:48,064 - DEBUG - ya.test - _save_outputs: Command (pid 588844) majflt: 0
2025-11-14 10:11:48,064 - DEBUG - ya.test - _save_outputs: Command (pid 588844) maxrss: 525780
2025-11-14 10:11:48,064 - DEBUG - ya.test - _save_outputs: Command (pid 588844) minflt: 19685
2025-11-14 10:11:48,064 - DEBUG - ya.test - _save_outputs: Command (pid 588844) msgrcv: 0
2025-11-14 10:11:48,064 - DEBUG - ya.test - _save_outputs: Command (pid 588844) msgsnd: 0
2025-11-14 10:11:48,065 - DEBUG - ya.test - _save_outputs: Command (pid 588844) nivcsw: 2
2025-11-14 10:11:48,065 - DEBUG - ya.test - _save_outputs: Command (pid 588844) nsignals: 0
2025-11-14 10:11:48,065 - DEBUG - ya.test - _save_outputs: Command (pid 588844) nswap: 0
2025-11-14 10:11:48,065 - DEBUG - ya.test - _save_outputs: Command (pid 588844) nvcsw: 127
2025-11-14 10:11:48,065 - DEBUG - ya.test - _save_outputs: Command (pid 588844) oublock: 8
2025-11-14 10:11:48,065 - DEBUG - ya.test - _save_outputs: Command (pid 588844) stime: 0.264602
2025-11-14 10:11:48,065 - DEBUG - ya.test - _save_outputs: Command (pid 588844) utime: 0.11673599999999999
2025-11-14 10:11:48,066 - DEBUG - ya.test - _save_outputs: Command (pid 588844) wtime: 0.425
2025-11-14 10:11:48,066 - DEBUG - ya.test - _save_outputs: Command (pid 588844) output:
Status {
  Success: true
}
Success: true
ConfigTxSeqNo: 7

2025-11-14 10:11:48,066 - DEBUG - ya.test - _save_outputs: Command (pid 588844) errors:

2025-11-14 10:11:48,066 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Binding storage pools to domain local: {'dynamic_storage_pool:1': 'hdd', 'dynamic_storage_pool:2': 'ssd'}
2025-11-14 10:11:48,077 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-11-14 10:11:48,086 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:11:48,124 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:11:48,303 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_s3_0.py::TestS3, test_name: test_checkpoints_on_join_s3_with_yds[v1-mvp_external_ydb_endpoint0-client0])
2025-11-14 10:11:48,305 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f2f1bb28890>
2025-11-14 10:11:48,308 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f2f1bc34590>
2025-11-14 10:11:48,309 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f2f1adea810>
2025-11-14 10:11:48,309 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f2f1bc34290>
2025-11-14 10:11:48,314 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:11:48,320 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:11:48,321 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:11:48,322 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:s3
2025-11-14 10:11:48,325 - DEBUG - botocore.hooks - _emit: Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f2f1bb28890>
2025-11-14 10:11:48,328 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_post at 0x7f2f1bc34590>
2025-11-14 10:11:48,328 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function lazy_call.<locals>._handler at 0x7f2f1adea810>
2025-11-14 10:11:48,329 - DEBUG - botocore.hooks - _emit: Event creating-client-class.s3: calling handler <function add_generate_presigned_url at 0x7f2f1bc34290>
2025-11-14 10:11:48,332 - DEBUG - botocore.endpoint - create_endpoint: Setting s3 timeout as (60, 60)
2025-11-14 10:11:48,336 - DEBUG - botocore.client - _register_legacy_retries: Registering retry handlers for service: s3
2025-11-14 10:11:48,337 - DEBUG - botocore.utils - register: Registering S3 region redirector handler
2025-11-14 10:11:48,339 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:Bucket
2025-11-14 10:11:48,339 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming Bucket attribute name
2025-11-14 10:11:48,341 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.Bucket: calling handler <function lazy_call.<locals>._handler at 0x7f2f1adeb290>
2025-11-14 10:11:48,341 - DEBUG - boto3.resources.action - __call__: Calling s3:create_bucket with {'Bucket': 'join_s3_with_yds', 'ACL': 'public-read'}
2025-11-14 10:11:48,342 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:11:48,343 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:11:48,343 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f358c0>>
2025-11-14 10:11:48,343 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.CreateBucket: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:11:48,344 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:11:48,344 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f358c0>>
2025-11-14 10:11:48,345 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'join_s3_with_yds', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableAccessPoints': True, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:11:48,346 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/join_s3_with_yds
2025-11-14 10:11:48,346 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:11:48,346 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:11:48,347 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:11:48,348 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:11:48,348 - DEBUG - botocore.hooks - _emit: Event before-call.s3.CreateBucket: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:11:48,348 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=CreateBucket) with params: {'url_path': '', 'query_string': {}, 'method': 'PUT', 'headers': {'x-amz-acl': 'public-read', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/join_s3_with_yds/', 'url': 'http://localhost:12406/join_s3_with_yds', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2f1b037760>, 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'join_s3_with_yds', 'params': {'Bucket': 'join_s3_with_yds', 'ACL': 'public-read'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:11:48,349 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2f1b034420>>
2025-11-14 10:11:48,349 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2f1a7d6090>>
2025-11-14 10:11:48,350 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.CreateBucket: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:11:48,350 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.CreateBucket: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:11:48,351 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:11:48,351 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/join_s3_with_yds

host:localhost:12406
x-amz-acl:public-read
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101148Z

host;x-amz-acl;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:11:48,352 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101148Z
20251114/yandex/s3/aws4_request
56528b204cf31b04b984e6403e3607e3181986835f4d298e4021c793abaf47f6
2025-11-14 10:11:48,352 - DEBUG - botocore.auth - add_auth: Signature:
bf6563f4a48116e82330e9c116c12b8df9007412023fc92547d21cd6eba3bbfe
2025-11-14 10:11:48,352 - DEBUG - botocore.hooks - _emit: Event request-created.s3.CreateBucket: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:11:48,353 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:12406/join_s3_with_yds, headers={'x-amz-acl': b'public-read', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101148Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-acl;x-amz-content-sha256;x-amz-date, Signature=bf6563f4a48116e82330e9c116c12b8df9007412023fc92547d21cd6eba3bbfe', 'amz-sdk-invocation-id': b'031672c9-87ef-48bd-844c-90537b6d6865', 'amz-sdk-request': b'attempt=1', 'Content-Length': '0'}>
2025-11-14 10:11:48,360 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:11:48 GMT', 'x-amzn-requestid': 'e0oFX4QYr9n9i5enpYkgLGKjtcFH41bLks0ptN8NUdATYSgWPSQN', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '170', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:11:48,361 - DEBUG - botocore.parsers - parse: Response body:
b'<CreateBucketResponse xmlns="http://s3.amazonaws.com/doc/2006-03-01"><CreateBucketResponse><Bucket>join_s3_with_yds</Bucket></CreateBucketResponse></CreateBucketResponse>'
2025-11-14 10:11:48,362 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2f06f354b0>
2025-11-14 10:11:48,362 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:11:48,362 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.CreateBucket: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f358c0>>
2025-11-14 10:11:48,363 - DEBUG - boto3.resources.action - __call__: Response: {'ResponseMetadata': {'RequestId': 'e0oFX4QYr9n9i5enpYkgLGKjtcFH41bLks0ptN8NUdATYSgWPSQN', 'HTTPStatusCode': 200, 'HTTPHeaders': {'server': 'Werkzeug/2.2.3 Python/3.12.9', 'date': 'Fri, 14 Nov 2025 10:11:48 GMT', 'x-amzn-requestid': 'e0oFX4QYr9n9i5enpYkgLGKjtcFH41bLks0ptN8NUdATYSgWPSQN', 'content-type': 'text/html; charset=utf-8', 'content-length': '170', 'access-control-allow-origin': '*', 'connection': 'close'}, 'RetryAttempts': 0}}
2025-11-14 10:11:48,363 - DEBUG - boto3.resources.collection - pages: Calling paginated s3:list_objects with {'Bucket': 'join_s3_with_yds'}
2025-11-14 10:11:48,365 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function set_list_objects_encoding_type_url at 0x7f2f1bb4c050>
2025-11-14 10:11:48,365 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:11:48,365 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:11:48,365 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f358c0>>
2025-11-14 10:11:48,366 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.ListObjects: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:11:48,366 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:11:48,366 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f358c0>>
2025-11-14 10:11:48,367 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'join_s3_with_yds', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:11:48,368 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/join_s3_with_yds
2025-11-14 10:11:48,368 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:11:48,368 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:11:48,369 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:11:48,369 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:11:48,370 - DEBUG - botocore.hooks - _emit: Event before-call.s3.ListObjects: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:11:48,370 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=ListObjects) with params: {'url_path': '', 'query_string': {'encoding-type': 'url'}, 'method': 'GET', 'headers': {'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource'}, 'body': b'', 'auth_path': '/join_s3_with_yds/', 'url': 'http://localhost:12406/join_s3_with_yds?encoding-type=url', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2f1b037760>, 'has_streaming_input': False, 'auth_type': 'v4', 'encoding_type_auto_set': True, 's3_redirect': {'redirected': False, 'bucket': 'join_s3_with_yds', 'params': {'Bucket': 'join_s3_with_yds', 'EncodingType': 'url'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:11:48,371 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2f1b034420>>
2025-11-14 10:11:48,371 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2f1a7d6090>>
2025-11-14 10:11:48,371 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.ListObjects: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:11:48,372 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.ListObjects: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:11:48,372 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:11:48,373 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
GET
/join_s3_with_yds
encoding-type=url
host:localhost:12406
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:20251114T101148Z

host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2025-11-14 10:11:48,373 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101148Z
20251114/yandex/s3/aws4_request
34157e2baa22803e368e324c3a657cf49091945267c77478b54803093464bc01
2025-11-14 10:11:48,373 - DEBUG - botocore.auth - add_auth: Signature:
c8e7fd7356fd87736fc480b2d4c7e58eb333155514a3d7837ceb12bae4cdc601
2025-11-14 10:11:48,373 - DEBUG - botocore.hooks - _emit: Event request-created.s3.ListObjects: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:11:48,373 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=http://localhost:12406/join_s3_with_yds?encoding-type=url, headers={'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80 Resource', 'X-Amz-Date': b'20251114T101148Z', 'X-Amz-Content-SHA256': b'e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=c8e7fd7356fd87736fc480b2d4c7e58eb333155514a3d7837ceb12bae4cdc601', 'amz-sdk-invocation-id': b'696612aa-aa0b-4188-977e-656ca190a3f7', 'amz-sdk-request': b'attempt=1'}>
2025-11-14 10:11:48,381 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:11:48 GMT', 'x-amzn-requestid': 'VcUwvr6OGFQrQOCYddAxc7v0yz2BYDWv6AC44XkxaQe3s5HqR5Xj', 'Content-Type': 'text/html; charset=utf-8', 'Content-Length': '239', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:11:48,381 - DEBUG - botocore.parsers - parse: Response body:
b'<?xml version="1.0" encoding="UTF-8"?><ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>join_s3_with_yds</Name><MaxKeys>1000</MaxKeys><EncodingType>url</EncodingType><IsTruncated>false</IsTruncated></ListBucketResult>'
2025-11-14 10:11:48,383 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2f06f354b0>
2025-11-14 10:11:48,383 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:11:48,383 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.ListObjects: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f358c0>>
2025-11-14 10:11:48,384 - DEBUG - botocore.hooks - _emit: Event after-call.s3.ListObjects: calling handler <function decode_list_object at 0x7f2f1bb4c110>
2025-11-14 10:11:48,384 - DEBUG - boto3.resources.factory - load_from_definition: Loading s3:ObjectSummary
2025-11-14 10:11:48,384 - DEBUG - boto3.resources.model - _load_name_with_category: Renaming ObjectSummary attribute key
2025-11-14 10:11:48,386 - DEBUG - botocore.hooks - _emit: Event creating-resource-class.s3.ObjectSummary: calling handler <function lazy_call.<locals>._handler at 0x7f2f1adeb410>
2025-11-14 10:11:48,388 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f2f1bb2b7d0>
2025-11-14 10:11:48,388 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f2f1bb2a810>
2025-11-14 10:11:48,388 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f2f1bb4c4d0>
2025-11-14 10:11:48,389 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:11:48,389 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:11:48,389 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,389 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:11:48,390 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:11:48,390 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,391 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'join_s3_with_yds', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:11:48,392 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/join_s3_with_yds
2025-11-14 10:11:48,392 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:11:48,393 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:11:48,394 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_md5 at 0x7f2f1bd3f710>
2025-11-14 10:11:48,394 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:11:48,394 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-14 10:11:48,395 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:11:48,395 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:11:48,395 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/a/b/c/1.json', 'query_string': {}, 'method': 'PUT', 'headers': {'Content-Type': 'text/json', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': 'MA0UhnEkNMWFRi1GVXQHdQ==', 'Expect': '100-continue'}, 'body': <_io.BytesIO object at 0x7f2eff613070>, 'auth_path': '/join_s3_with_yds/a/b/c/1.json', 'url': 'http://localhost:12406/join_s3_with_yds/a/b/c/1.json', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2eee6f1410>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'join_s3_with_yds', 'params': {'Body': <_io.BytesIO object at 0x7f2eff613070>, 'Bucket': 'join_s3_with_yds', 'Key': 'a/b/c/1.json', 'ContentType': 'text/json'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:11:48,396 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2eee6f11e0>>
2025-11-14 10:11:48,397 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2efe960d30>>
2025-11-14 10:11:48,397 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:11:48,398 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:11:48,398 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:11:48,399 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/join_s3_with_yds/a/b/c/1.json

content-md5:MA0UhnEkNMWFRi1GVXQHdQ==
content-type:text/json
host:localhost:12406
x-amz-content-sha256:836e268bcfa32b3d7f155faee7091ed7c19fa6fdd13871dcfc46334954d65b40
x-amz-date:20251114T101148Z

content-md5;content-type;host;x-amz-content-sha256;x-amz-date
836e268bcfa32b3d7f155faee7091ed7c19fa6fdd13871dcfc46334954d65b40
2025-11-14 10:11:48,399 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101148Z
20251114/yandex/s3/aws4_request
e08069234478a4edcba34013e45fc17d82b51352d4f35b2e77d68e44dafcb534
2025-11-14 10:11:48,399 - DEBUG - botocore.auth - add_auth: Signature:
46161da58b329cce7956fc57ae0e40bf1ffeb49b191738b417b0d53ec6b60c2e
2025-11-14 10:11:48,400 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:11:48,400 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:12406/join_s3_with_yds/a/b/c/1.json, headers={'Content-Type': b'text/json', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': b'MA0UhnEkNMWFRi1GVXQHdQ==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251114T101148Z', 'X-Amz-Content-SHA256': b'836e268bcfa32b3d7f155faee7091ed7c19fa6fdd13871dcfc46334954d65b40', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;content-type;host;x-amz-content-sha256;x-amz-date, Signature=46161da58b329cce7956fc57ae0e40bf1ffeb49b191738b417b0d53ec6b60c2e', 'amz-sdk-invocation-id': b'b474899b-7e8e-4458-8c07-b92d271694a3', 'amz-sdk-request': b'attempt=1', 'Content-Length': '26'}>
2025-11-14 10:11:48,403 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-14 10:11:48,404 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-14 10:11:48,409 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:11:48 GMT', 'ETag': '"300d1486712434c585462d4655740775"', 'last-modified': 'Fri, 14 Nov 2025 10:11:48 GMT', 'Content-Length': '0', 'x-amzn-requestid': 'kWevaBOs1tqN78Nq7CTg4SGoawwQmt3TTIElqj9B98qlJhPUQPnE', 'Content-Type': 'text/html; charset=utf-8', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:11:48,409 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:11:48,410 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2f06f59b90>
2025-11-14 10:11:48,411 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:11:48,411 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,411 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f2f1bb2b7d0>
2025-11-14 10:11:48,411 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f2f1bb2a810>
2025-11-14 10:11:48,412 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f2f1bb4c4d0>
2025-11-14 10:11:48,412 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:11:48,412 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:11:48,412 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,412 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:11:48,412 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:11:48,413 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,413 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'join_s3_with_yds', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:11:48,413 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/join_s3_with_yds
2025-11-14 10:11:48,413 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:11:48,413 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:11:48,414 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_md5 at 0x7f2f1bd3f710>
2025-11-14 10:11:48,414 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:11:48,414 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-14 10:11:48,415 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:11:48,415 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:11:48,415 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/a/b/c/2.json', 'query_string': {}, 'method': 'PUT', 'headers': {'Content-Type': 'text/json', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': 'wygYhFm5j3ySJlRmBXeP5Q==', 'Expect': '100-continue'}, 'body': <_io.BytesIO object at 0x7f2eff6114e0>, 'auth_path': '/join_s3_with_yds/a/b/c/2.json', 'url': 'http://localhost:12406/join_s3_with_yds/a/b/c/2.json', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2eee6f1410>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'join_s3_with_yds', 'params': {'Body': <_io.BytesIO object at 0x7f2eff6114e0>, 'Bucket': 'join_s3_with_yds', 'Key': 'a/b/c/2.json', 'ContentType': 'text/json'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:11:48,416 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2eee6f11e0>>
2025-11-14 10:11:48,416 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2efe960d30>>
2025-11-14 10:11:48,416 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:11:48,416 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:11:48,417 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:11:48,417 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/join_s3_with_yds/a/b/c/2.json

content-md5:wygYhFm5j3ySJlRmBXeP5Q==
content-type:text/json
host:localhost:12406
x-amz-content-sha256:944e3b66b93542288d85cfd7186e5c7ff3a8330a0ef1a735671f96455fc6b787
x-amz-date:20251114T101148Z

content-md5;content-type;host;x-amz-content-sha256;x-amz-date
944e3b66b93542288d85cfd7186e5c7ff3a8330a0ef1a735671f96455fc6b787
2025-11-14 10:11:48,417 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101148Z
20251114/yandex/s3/aws4_request
1817bc0e46e27637e974eab10d16a263f3929acbcd797513f22f9488229f1bfd
2025-11-14 10:11:48,418 - DEBUG - botocore.auth - add_auth: Signature:
19ace9d38c8789447325d10345824a778baf8544f20abcde51f28896e0c5ad34
2025-11-14 10:11:48,418 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:11:48,418 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:12406/join_s3_with_yds/a/b/c/2.json, headers={'Content-Type': b'text/json', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': b'wygYhFm5j3ySJlRmBXeP5Q==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251114T101148Z', 'X-Amz-Content-SHA256': b'944e3b66b93542288d85cfd7186e5c7ff3a8330a0ef1a735671f96455fc6b787', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;content-type;host;x-amz-content-sha256;x-amz-date, Signature=19ace9d38c8789447325d10345824a778baf8544f20abcde51f28896e0c5ad34', 'amz-sdk-invocation-id': b'82b16bd4-06f6-433a-8310-65e75f66b4e5', 'amz-sdk-request': b'attempt=1', 'Content-Length': '26'}>
2025-11-14 10:11:48,420 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-14 10:11:48,422 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-14 10:11:48,426 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:11:48 GMT', 'ETag': '"c328188459b98f7c9226546605778fe5"', 'last-modified': 'Fri, 14 Nov 2025 10:11:48 GMT', 'Content-Length': '0', 'x-amzn-requestid': 'fkHZJJSkXHGwRs8WDsNySZgME7ITq4JsJQ8FXt8dq6Wv0BN0INbY', 'Content-Type': 'text/html; charset=utf-8', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:11:48,426 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:11:48,427 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2f06f59b90>
2025-11-14 10:11:48,427 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:11:48,427 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,428 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_ascii_metadata at 0x7f2f1bb2b7d0>
2025-11-14 10:11:48,428 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function sse_md5 at 0x7f2f1bb2a810>
2025-11-14 10:11:48,428 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function convert_body_to_file_like_object at 0x7f2f1bb4c4d0>
2025-11-14 10:11:48,429 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function validate_bucket_name at 0x7f2f1bb2a750>
2025-11-14 10:11:48,429 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function remove_bucket_from_url_paths_from_model at 0x7f2f1bb4d010>
2025-11-14 10:11:48,429 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.annotate_request_context of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,429 - DEBUG - botocore.hooks - _emit: Event before-parameter-build.s3.PutObject: calling handler <function generate_idempotent_uuid at 0x7f2f1bb2a510>
2025-11-14 10:11:48,430 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <function customize_endpoint_resolver_builtins at 0x7f2f1bb4d250>
2025-11-14 10:11:48,430 - DEBUG - botocore.hooks - _emit: Event before-endpoint-resolution.s3: calling handler <bound method S3RegionRedirectorv2.redirect_from_cache of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,430 - DEBUG - botocore.regions - construct_endpoint: Calling endpoint provider with parameters: {'Bucket': 'join_s3_with_yds', 'Region': 'yandex', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://localhost:12406', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True}
2025-11-14 10:11:48,430 - DEBUG - botocore.regions - construct_endpoint: Endpoint provider result: http://localhost:12406/join_s3_with_yds
2025-11-14 10:11:48,431 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None"
2025-11-14 10:11:48,431 - DEBUG - botocore.regions - auth_schemes_to_signing_ctx: Selected auth type "v4" as "v4" with signing context params: {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}
2025-11-14 10:11:48,431 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function conditionally_calculate_md5 at 0x7f2f1bd3f710>
2025-11-14 10:11:48,431 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_expect_header at 0x7f2f1bb2abd0>
2025-11-14 10:11:48,432 - DEBUG - botocore.handlers - add_expect_header: Adding expect 100 continue header to request.
2025-11-14 10:11:48,432 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function add_recursion_detection_header at 0x7f2f1bb28ad0>
2025-11-14 10:11:48,432 - DEBUG - botocore.hooks - _emit: Event before-call.s3.PutObject: calling handler <function inject_api_version_header_if_needed at 0x7f2f1bb4c650>
2025-11-14 10:11:48,432 - DEBUG - botocore.endpoint - make_request: Making request for OperationModel(name=PutObject) with params: {'url_path': '/a/b/c/3.json', 'query_string': {}, 'method': 'PUT', 'headers': {'Content-Type': 'text/json', 'User-Agent': 'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': 'psU4Ho+t3cwMn6B4twVHmg==', 'Expect': '100-continue'}, 'body': <_io.BytesIO object at 0x7f2eff2f9cc0>, 'auth_path': '/join_s3_with_yds/a/b/c/3.json', 'url': 'http://localhost:12406/join_s3_with_yds/a/b/c/3.json', 'context': {'client_region': 'yandex', 'client_config': <botocore.config.Config object at 0x7f2eee6f1410>, 'has_streaming_input': True, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'join_s3_with_yds', 'params': {'Body': <_io.BytesIO object at 0x7f2eff2f9cc0>, 'Bucket': 'join_s3_with_yds', 'Key': 'a/b/c/3.json', 'ContentType': 'text/json'}}, 'signing': {'region': 'yandex', 'signing_name': 's3', 'disableDoubleEncoding': True}}}
2025-11-14 10:11:48,433 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f2eee6f11e0>>
2025-11-14 10:11:48,433 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <bound method ClientCreator._default_s3_presign_to_sigv2 of <botocore.client.ClientCreator object at 0x7f2efe960d30>>
2025-11-14 10:11:48,433 - DEBUG - botocore.hooks - _emit: Event choose-signer.s3.PutObject: calling handler <function set_operation_specific_signer at 0x7f2f1bb2a390>
2025-11-14 10:11:48,434 - DEBUG - botocore.hooks - _emit: Event before-sign.s3.PutObject: calling handler <function remove_arn_from_signing_path at 0x7f2f1bb4d190>
2025-11-14 10:11:48,434 - DEBUG - botocore.auth - add_auth: Calculating signature using v4 auth.
2025-11-14 10:11:48,435 - DEBUG - botocore.auth - add_auth: CanonicalRequest:
PUT
/join_s3_with_yds/a/b/c/3.json

content-md5:psU4Ho+t3cwMn6B4twVHmg==
content-type:text/json
host:localhost:12406
x-amz-content-sha256:8e192126957ef7fbe749e605e4247ab85a5c43f8413bd103bed9fe96ef5abddf
x-amz-date:20251114T101148Z

content-md5;content-type;host;x-amz-content-sha256;x-amz-date
8e192126957ef7fbe749e605e4247ab85a5c43f8413bd103bed9fe96ef5abddf
2025-11-14 10:11:48,435 - DEBUG - botocore.auth - add_auth: StringToSign:
AWS4-HMAC-SHA256
20251114T101148Z
20251114/yandex/s3/aws4_request
8f30f0e329a3a464e01a7e9d934113c3ed2cf9214c18eafa012e3b33284d8175
2025-11-14 10:11:48,435 - DEBUG - botocore.auth - add_auth: Signature:
f9c1d58f3a4db2001c4d166f118accc370ded178f23783487a008fa6ca4725a5
2025-11-14 10:11:48,435 - DEBUG - botocore.hooks - _emit: Event request-created.s3.PutObject: calling handler <function add_retry_headers at 0x7f2f1bb4cf50>
2025-11-14 10:11:48,436 - DEBUG - botocore.endpoint - _do_get_response: Sending http request: <AWSPreparedRequest stream_output=False, method=PUT, url=http://localhost:12406/join_s3_with_yds/a/b/c/3.json, headers={'Content-Type': b'text/json', 'User-Agent': b'Boto3/1.29.6 md/Botocore#1.31.80 ua/2.0 os/linux#5.15.0-157-generic md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.31.80', 'Content-MD5': b'psU4Ho+t3cwMn6B4twVHmg==', 'Expect': b'100-continue', 'X-Amz-Date': b'20251114T101148Z', 'X-Amz-Content-SHA256': b'8e192126957ef7fbe749e605e4247ab85a5c43f8413bd103bed9fe96ef5abddf', 'Authorization': b'AWS4-HMAC-SHA256 Credential=key/20251114/yandex/s3/aws4_request, SignedHeaders=content-md5;content-type;host;x-amz-content-sha256;x-amz-date, Signature=f9c1d58f3a4db2001c4d166f118accc370ded178f23783487a008fa6ca4725a5', 'amz-sdk-invocation-id': b'd6271fbf-7878-418c-a4bb-a4ed79595572', 'amz-sdk-request': b'attempt=1', 'Content-Length': '28'}>
2025-11-14 10:11:48,437 - DEBUG - botocore.awsrequest - _send_output: Waiting for 100 Continue response.
2025-11-14 10:11:48,439 - DEBUG - botocore.awsrequest - _handle_expect_response: 100 Continue response seen, now sending request body.
2025-11-14 10:11:48,444 - DEBUG - botocore.parsers - parse: Response headers: {'Server': 'Werkzeug/2.2.3 Python/3.12.9', 'Date': 'Fri, 14 Nov 2025 10:11:48 GMT', 'ETag': '"a6c5381e8fadddcc0c9fa078b705479a"', 'last-modified': 'Fri, 14 Nov 2025 10:11:48 GMT', 'Content-Length': '0', 'x-amzn-requestid': 'EEtBw7xlLKXmSbWj8p2qmcc5UGbC2l1pO5iPUmBKOy9pyhqL5Qgp', 'Content-Type': 'text/html; charset=utf-8', 'Access-Control-Allow-Origin': '*', 'Connection': 'close'}
2025-11-14 10:11:48,445 - DEBUG - botocore.parsers - parse: Response body:
b''
2025-11-14 10:11:48,445 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <botocore.retryhandler.RetryHandler object at 0x7f2f06f59b90>
2025-11-14 10:11:48,446 - DEBUG - botocore.retryhandler - __call__: No retry needed.
2025-11-14 10:11:48,446 - DEBUG - botocore.hooks - _emit: Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirectorv2.redirect_from_error of <botocore.utils.S3RegionRedirectorv2 object at 0x7f2f06f58650>>
2025-11-14 10:11:48,446 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:11:48,493 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:11:48,835 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/yds_dict_input"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-11-14 10:11:48,906 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-11-14 10:11:48,906 - DEBUG - root - _get_and_check_result: Result: 
2025-11-14 10:11:48,908 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/yds_dict_output"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-11-14 10:11:48,929 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-11-14 10:11:48,929 - DEBUG - root - _get_and_check_result: Result: 
2025-11-14 10:11:48,948 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-11-14 10:11:48,948 - DEBUG - root - _get_and_check_result: Result: 
2025-11-14 10:11:48,981 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA dq.MaxTasksPerStage=\"2\";\n\n            $s3_dict_raw =\n                SELECT cast(Data AS json) AS data\n                FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict`.`*`\n                WITH (format=raw, SCHEMA (\n                    Data String NOT NULL\n                ));\n\n            $s3_dict =\n                SELECT\n                    cast(JSON_VALUE(data, \'$.key\') AS int64) AS key,\n                    cast(JSON_VALUE(data, \'$.value\') AS String) AS value\n                FROM $s3_dict_raw;\n\n            $parsed_yson_topic =\n                SELECT\n                    Yson::LookupInt64(yson_data, \"key\") AS key,\n                    Yson::LookupString(yson_data, \"val\") AS val\n                FROM (\n                    SELECT\n                        Yson::Parse(Data) AS yson_data\n                    FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_input` WITH SCHEMA (Data String NOT NULL));\n\n            $joined_seq =\n                SELECT\n                    s3_dict.value AS num,\n                    yds_seq.val AS word\n                FROM $parsed_yson_topic AS yds_seq\n                    INNER JOIN $s3_dict AS s3_dict\n                        ON yds_seq.key = s3_dict.key;\n\n            INSERT INTO `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_output`\n            SELECT\n                Yson::SerializeText(Yson::From(TableRow()))\n            FROM $joined_seq;\n            "
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "3cf45b3f-a1d9-4a70-ac2b-54ab4c719188"

2025-11-14 10:11:49,171 - DEBUG - root - create_query_impl: Result: query_id: "ptqudsej33m2mslnh1fn"

2025-11-14 10:11:49,240 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej33m2mslnh1fn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115108
        nanos: 988167000
      }
      modified_at {
        seconds: 1763115108
        nanos: 988167000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudsej33m2kla34504-ptqudsej33m2mslnh1fn"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115108
      nanos: 988167000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA dq.MaxTasksPerStage=\"2\";\n\n            $s3_dict_raw =\n                SELECT cast(Data AS json) AS data\n                FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict`.`*`\n                WITH (format=raw, SCHEMA (\n                    Data String NOT NULL\n                ));\n\n            $s3_dict =\n                SELECT\n                    cast(JSON_VALUE(data, \'$.key\') AS int64) AS key,\n                    cast(JSON_VALUE(data, \'$.value\') AS String) AS value\n                FROM $s3_dict_raw;\n\n            $parsed_yson_topic =\n                SELECT\n                    Yson::LookupInt64(yson_data, \"key\") AS key,\n                    Yson::LookupString(yson_data, \"val\") AS val\n                FROM (\n                    SELECT\n                        Yson::Parse(Data) AS yson_data\n                    FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_input` WITH SCHEMA (Data String NOT NULL));\n\n            $joined_seq =\n                SELECT\n                    s3_dict.value AS num,\n                    yds_seq.val AS word\n                FROM $parsed_yson_topic AS yds_seq\n                    INNER JOIN $s3_dict AS s3_dict\n                        ON yds_seq.key = s3_dict.key;\n\n            INSERT INTO `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_output`\n            SELECT\n                Yson::SerializeText(Yson::From(TableRow()))\n            FROM $joined_seq;\n            "
    syntax: YQL_V1
  }
}

2025-11-14 10:11:49,846 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej33m2mslnh1fn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115108
        nanos: 988167000
      }
      modified_at {
        seconds: 1763115108
        nanos: 988167000
      }
      revision: 1
    }
    started_at {
      seconds: 1763115109
      nanos: 303000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudsej33m2kla34504-ptqudsej33m2mslnh1fn"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1763115108
      nanos: 988167000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA dq.MaxTasksPerStage=\"2\";\n\n            $s3_dict_raw =\n                SELECT cast(Data AS json) AS data\n                FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict`.`*`\n                WITH (format=raw, SCHEMA (\n                    Data String NOT NULL\n                ));\n\n            $s3_dict =\n                SELECT\n                    cast(JSON_VALUE(data, \'$.key\') AS int64) AS key,\n                    cast(JSON_VALUE(data, \'$.value\') AS String) AS value\n                FROM $s3_dict_raw;\n\n            $parsed_yson_topic =\n                SELECT\n                    Yson::LookupInt64(yson_data, \"key\") AS key,\n                    Yson::LookupString(yson_data, \"val\") AS val\n                FROM (\n                    SELECT\n                        Yson::Parse(Data) AS yson_data\n                    FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_input` WITH SCHEMA (Data String NOT NULL));\n\n            $joined_seq =\n                SELECT\n                    s3_dict.value AS num,\n                    yds_seq.val AS word\n                FROM $parsed_yson_topic AS yds_seq\n                    INNER JOIN $s3_dict AS s3_dict\n                        ON yds_seq.key = s3_dict.key;\n\n            INSERT INTO `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_output`\n            SELECT\n                Yson::SerializeText(Yson::From(TableRow()))\n            FROM $joined_seq;\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":17,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":15,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[17]},{\"Id\":4,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"SkipNullMembers\"},{\"Name\":\"DqPhyMapJoin\"},{\"Name\":\"ExtractMembers\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[6,15]},{\"Id\":3,\"Name\":\"DqQuery!\",\"DependsOn\":[4]},{\"Id\":2,\"Name\":\"Commit!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":2,\"DqQuery!\":1,\"DqStage\":4}},\"Basic\":{\"nodes\":[{\"id\":6,\"level\":1,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":17,\"level\":1,\"name\":\"DqStage #17\",\"type\":\"op\"},{\"id\":15,\"level\":2,\"name\":\"DqStage #15\",\"type\":\"op\"},{\"id\":4,\"level\":3,\"name\":\"DqStage #4\",\"type\":\"op\"},{\"id\":3,\"level\":4,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":2,\"level\":5,\"name\":\"Commit!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":17,\"target\":15},{\"source\":6,\"target\":4},{\"source\":15,\"target\":4},{\"source\":4,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"dq\" \'\"$all\") \'\"Attr\" \'\"maxtasksperstage\" \'\"2\"))\n(let $3 \'\"h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds\")\n(let $4 (DataSource \'\"pq\" $3))\n(let $5 \'(\'(\'\"PartitionsCount\" \'1)))\n(let $6 (DataType \'String))\n(let $7 (StructType \'(\'\"Data\" $6)))\n(let $8 (PqTopic $3 \'\"local\" \'\"yds_dict_input\" $5 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:4203\"))\n(let $10 \'(\'\"SharedReading\" \'0))\n(let $11 \'(\'\"AddBearerToToken\" \'1))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"raw\") \'(\'\"ReadGroup\" \'\"ptcudsej33n113nnd7t9\") $11))\n(let $13 \'\"cluster:default_h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds\")\n(let $14 (SecureParam $13))\n(let $15 (DqPqTopicSource $2 $8 \'(\'\"Data\") $12 $14 \'\"\" $7))\n(let $16 \'(\'format \'\"raw\"))\n(let $17 (lambda \'($41) (AsStruct \'(\'\"Data\" $41))))\n(let $18 (ResourceType \'\"Yson2.Node\"))\n(let $19 \'(\'(\'\"strict\")))\n(let $20 (Bool \'\"true\"))\n(let $21 (DataType \'Yson))\n(let $22 \'($18 \'\"\" \'1))\n(let $23 (CallableType \'() \'($21) $22))\n(let $24 (OptionalType (DataType \'Int64)))\n(let $25 \'($18))\n(let $26 (OptionalType $6))\n(let $27 (DqStage \'((DqSource $4 $15)) (lambda \'($38) (block \'(\n  (let $39 \'($16 \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'settings \'($10))))\n  (let $40 (DqSourceWideWrap $38 $4 $7 $39))\n  (return (FlatMap (NarrowMap $40 $17) (lambda \'($42) (block \'(\n    (let $43 (ResourceType \'\"Yson2.Options\"))\n    (let $44 (TupleType (TupleType $6 $43) (StructType) (TupleType)))\n    (let $45 \'(\'1))\n    (let $46 \'($6 \'\"\" \'1))\n    (let $47 \'((OptionalType $43)))\n    (let $48 (CallableType $45 \'((OptionalType $18)) $46 $47))\n    (let $49 (Udf \'\"Yson2.Parse\" (Void) $44 \'\"\" $48 (VoidType) \'\"\" \'()))\n    (let $50 (OptionalType (DataType \'Bool)))\n    (let $51 (CallableType \'(\'\"2\") \'($43) \'($50 \'\"AutoConvert\") \'($50 \'\"Strict\")))\n    (let $52 (Udf \'\"Yson2.Options\" (Void) (VoidType) \'\"\" $51 (VoidType) \'\"\" $19))\n    (let $53 (Just (NamedApply $52 \'() (AsStruct \'(\'\"AutoConvert\" (Just (Bool \'\"false\"))) \'(\'\"Strict\" (Just $20))))))\n    (let $54 (Apply $49 (Member $42 \'\"Data\") $53))\n    (let $55 (FlatMap $54 (lambda \'($61) (block \'(\n      (let $62 (Udf \'\"Yson2.Serialize\" (Void) (VoidType) \'\"\" $23 (VoidType) \'\"\" $19))\n      (return (Just (Apply $62 $61)))\n    )))))\n    (let $56 \'($6))\n    (let $57 (TupleType (TupleType $21) (StructType) (TupleType)))\n    (let $58 \'($21 \'\"\" \'1))\n    (let $59 (CallableType $45 $25 $58 $47))\n    (let $60 (Udf \'\"Yson2.Parse\" (Void) $57 \'\"\" $59 (VoidType) \'\"\" $19))\n    (return (Just (AsStruct \'(\'\"key\" (FlatMap $55 (lambda \'($63) (block \'(\n      (let $64 (CallableType $45 \'($24) $22 $56 $47))\n      (let $65 (Udf \'\"Yson2.LookupInt64\" (Void) (VoidType) \'\"\" $64 (VoidType) \'\"\" \'()))\n      (return (Apply $65 (Apply $60 $63) (String \'\"key\") $53))\n    ))))) \'(\'\"val\" (FlatMap $55 (lambda \'($66) (block \'(\n      (let $67 (CallableType $45 \'($26) $22 $56 $47))\n      (let $68 (Udf \'\"Yson2.LookupString\" (Void) (VoidType) \'\"\" $67 (VoidType) \'\"\" \'()))\n      (return (Apply $68 (Apply $60 $66) (String \'\"val\") $53))\n    ))))))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202548))))\n(let $28 \'\"h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict\")\n(let $29 (DataSource \'\"s3\" $28))\n(let $30 \'\"Paths {\\n  Name: \\\"a\\\"\\n  Children {\\n    Name: \\\"b\\\"\\n    Children {\\n      Name: \\\"c\\\"\\n      Children {\\n        Name: \\\"1.json\\\"\\n        Size: 26\\n        Read: true\\n      }\\n      Children {\\n        Name: \\\"2.json\\\"\\n        Size: 26\\n        Read: true\\n      }\\n      Children {\\n        Name: \\\"3.json\\\"\\n        Size: 28\\n        Read: true\\n      }\\n      IsDirectory: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $31 \'\"cluster:default_h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict\")\n(let $32 (S3SourceSettings $2 \'(\'((String $30) $20 (AsStruct))) (SecureParam $31) \'\"\" \'\"* \" (Void) (Void) (Void)))\n(let $33 (DqStage \'((DqSource $29 $32)) (lambda \'($69) (block \'(\n  (let $70 (DqSourceWideWrap $69 $29 $7 \'($16 \'(\'settings \'()))))\n  (return (FlatMap (NarrowMap $70 $17) (lambda \'($71) (block \'(\n    (let $72 (SafeCast (Member $71 \'\"Data\") (OptionalType (DataType \'Json))))\n    (let $73 (JsonValue $72 (Utf8 \'\"$.key\") (EmptyDict) \'DefaultValue (Null) \'DefaultValue (Null)))\n    (let $74 (JsonValue $72 (Utf8 \'\"$.value\") (EmptyDict) \'DefaultValue (Null) \'DefaultValue (Null)))\n    (return (Just (AsStruct \'(\'\"key\" (SafeCast $73 $24)) \'(\'\"value\" (SafeCast $74 $26)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202590))))\n(let $34 (DqStage \'((DqCnUnionAll (TDqOutput $33 \'0))) (lambda \'($75) $75) \'(\'(\'\"_logical_id\" \'202646))))\n(let $35 (DataSink \'\"pq\" $3))\n(let $36 (PqTopic $3 \'\"local\" \'\"yds_dict_output\" $5 \'() $7))\n(let $37 (DqPqTopicSink $36 \'($9 $11) $14))\n(return (Commit! (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $27 \'0)) (DqCnBroadcast (TDqOutput $34 \'0))) (lambda \'($76 $77) (block \'(\n  (let $78 \'(\'\"key\"))\n  (let $79 (DqPhyMapJoin (SkipNullMembers $76 $78) (SkipNullMembers $77 $78) \'\"yds_seq\" \'\"s3_dict\" \'Inner \'(\'(\'\"yds_seq\" \'\"key\" \'\"s3_dict\" \'\"key\")) \'(\'\"yds_seq.key\") \'(\'\"s3_dict.key\")))\n  (return (FlatMap (ExtractMembers $79 \'(\'\"s3_dict.value\" \'\"yds_seq.val\")) (lambda \'($80) (block \'(\n    (let $81 (Udf \'\"Yson2.SerializeText\" (Void) (VoidType) \'\"\" $23 (VoidType) \'\"\" $19))\n    (let $82 (StructType \'(\'\"num\" $26) \'(\'\"word\" $26)))\n    (let $83 (TupleType (TupleType $82) (StructType) (TupleType)))\n    (let $84 (CallableType \'() $25 \'($82)))\n    (let $85 (Udf \'\"Yson2.From\" (Void) $83 \'\"\" $84 (VoidType) \'\"\" $19))\n    (return (Just (AsStruct \'(\'\"column0\" (Apply $81 (Apply $85 (AsStruct \'(\'\"num\" (Member $80 \'\"s3_dict.value\")) \'(\'\"word\" (Member $80 \'\"yds_seq.val\")))))))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202791)) \'((DqSink \'0 $35 $37))))) $35) (DataSink \'\"s3\" $28)))\n)\n"
  }
}

2025-11-14 10:11:50,396 - DEBUG - root - write_stream: Write topic yds_dict_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0010*\014shard-000000\032\021\"\0011*\014shard-000000\032\021\"\0012*\014shard-000000\032\021\"\0013*\014shard-000000\032\021\"\0014*\014shard-000000\032\021\"\0015*\014shard-000000\032\021\"\0016*\014shard-000000\032\021\"\0017*\014shard-000000\032\021\"\0018*\014shard-000000"
  }
}

2025-11-14 10:11:50,397 - INFO - root - write_stream: Data was written to yds_dict_input: ['{"key" = 1; "val" = "January";}', '{"key" = 2; "val" = "February";}', '{"key" = 3; "val" = "March";}', '{"key" = 1; "val" = "Monday";}', '{"key" = 2; "val" = "Tuesday";}', '{"key" = 3; "val" = "Wednesday";}', '{"key" = 1; "val" = "Gold";}', '{"key" = 2; "val" = "Silver";}', '{"key" = 3; "val" = "Bronze";}']
2025-11-14 10:11:50,398 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/tools/pq_read/pq_read
2025-11-14 10:11:50,399 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err
2025-11-14 10:11:50,399 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:4203', '--database', 'local', '--topic-path', 'yds_dict_output', '--consumer-name', 'yds_dict_consumer', '--disable-cluster-discovery', '--messages-count', '9', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-11-14 10:11:50,400 - DEBUG - ya.test - execute: Command pid: 590898
2025-11-14 10:11:50,702 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-11-14 10:11:50,703 - DEBUG - ya.test - _save_outputs: Command (pid 590898) rc: 0
2025-11-14 10:11:50,703 - DEBUG - ya.test - _save_outputs: Command (pid 590898) elapsed time (sec): 0.3022346496582031
2025-11-14 10:11:50,704 - DEBUG - ya.test - _save_outputs: Command (pid 590898) wtime: 0.303
2025-11-14 10:11:50,704 - DEBUG - ya.test - _save_outputs: Command (pid 590898) output:
None
2025-11-14 10:11:50,704 - DEBUG - ya.test - _save_outputs: Command (pid 590898) errors:
2025-11-14T10:11:50.419042Z :INFO: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] Starting read session
2025-11-14T10:11:50.419091Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] Starting session to cluster null (localhost:4203)
2025-11-14T10:11:50.419737Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-14T10:11:50.419750Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-14T10:11:50.419757Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] Reconnecting session to cluster null in 0.000000s
2025-11-14T10:11:50.421579Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] Successfully connected. Initializing session
2025-11-14T10:11:50.422856Z :INFO: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] Server session id: yds_dict_consumer_1_2_3418361563577963343_v1
2025-11-14T10:11:50.422980Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-14T10:11:50.424389Z :INFO: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "yds_dict_output". Partition: 0. Read offset: (NULL)
2025-11-14T10:11:50.615603Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-14T10:11:50.616691Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-14T10:11:50.616788Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-14T10:11:50.616825Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-14T10:11:50.616879Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (1-8)
2025-11-14T10:11:50.616888Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-11-14T10:11:50.616897Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 1} (2-2)
2025-11-14T10:11:50.616903Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 2} (3-3)
2025-11-14T10:11:50.616909Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 3} (4-4)
2025-11-14T10:11:50.616917Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 4} (5-5)
2025-11-14T10:11:50.616922Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 5} (6-6)
2025-11-14T10:11:50.616928Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 6} (7-7)
2025-11-14T10:11:50.616933Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 7} (8-8)
2025-11-14T10:11:50.617016Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] Commit offsets [0, 1). Partition stream id: 1
2025-11-14T10:11:50.617205Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] The application data is transferred to the client. Number of messages 1, size 35 bytes
2025-11-14T10:11:50.617272Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] Commit offsets [1, 9). Partition stream id: 1
2025-11-14T10:11:50.617356Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] The application data is transferred to the client. Number of messages 8, size 281 bytes
2025-11-14T10:11:50.621610Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] Committed response: { cookies { assign_id: 1 partition_cookie: 1 } }
2025-11-14T10:11:50.622091Z :DEBUG: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] [null] Committed response: { cookies { assign_id: 1 partition_cookie: 2 } }
Closing session. Got 9 messages
2025-11-14T10:11:50.622233Z :INFO: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] Closing read session. Close timeout: 5.000000s
2025-11-14T10:11:50.622260Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:yds_dict_output:0:1:8:9
2025-11-14T10:11:50.622272Z :INFO: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] Counters: { Errors: 0 CurrentSessionLifetimeMs: 203 BytesRead: 316 MessagesRead: 9 BytesReadCompressed: 316 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-11-14T10:11:50.622539Z :NOTICE: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-11-14T10:11:50.622671Z :INFO: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] Closing read session. Close timeout: 0.000000s
2025-11-14T10:11:50.622681Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:yds_dict_output:0:1:8:9
2025-11-14T10:11:50.622691Z :INFO: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] Counters: { Errors: 0 CurrentSessionLifetimeMs: 203 BytesRead: 316 MessagesRead: 9 BytesReadCompressed: 316 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-14T10:11:50.622701Z :NOTICE: [local] [local] [4593d54e-2a3f81b-55294bd9-46e94587] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-11-14 10:11:50,705 - INFO - root - read_stream: Data was read from yds_dict_output: ['{"num" = "one"; "word" = "January"}', '{"num" = "two"; "word" = "February"}', '{"num" = "three"; "word" = "March"}', '{"num" = "one"; "word" = "Monday"}', '{"num" = "two"; "word" = "Tuesday"}', '{"num" = "three"; "word" = "Wednesday"}', '{"num" = "one"; "word" = "Gold"}', '{"num" = "two"; "word" = "Silver"}', '{"num" = "three"; "word" = "Bronze"}']
2025-11-14 10:11:50,705 - DEBUG - root - test_checkpoints_on_join_s3_with_yds: Wait checkpoints
2025-11-14 10:11:52,300 - DEBUG - root - test_checkpoints_on_join_s3_with_yds: Wait checkpoints success
2025-11-14 10:11:59,301 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:11542/1
2025-11-14 10:11:59,302 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/wp2g/00310a/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/default/kikimr_configs/config.yaml', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/default/node_1/logfile_m5ohfm8e.log', '--grpc-port=11542', '--mon-port=10151', '--ic-port=1194')' in '/home/runner/.ya/build/build_root/wp2g/00310a/ydb/tests/fq/s3/test-results/py3test/testing_out_stuff/test_s3_0/testing_out_stuff/test_s3_0.py.TestS3.test_checkpoints_on_join_s3_with_yds.v1-mvp_external_ydb_endpoint0-client0/default/node_1' (no wait)
2025-11-14 10:11:59,304 - DEBUG - ya.test - execute: Command pid: 598425
2025-11-14 10:11:59,304 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:11542/1
2025-11-14 10:11:59,304 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap
2025-11-14 10:12:01,025 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped
2025-11-14 10:12:01,026 - DEBUG - root - test_checkpoints_on_join_s3_with_yds: Wait checkpoints after restore
2025-11-14 10:12:05,769 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-11-14 10:12:05,770 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')]
2025-11-14 10:12:05,775 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-11-14 10:12:05,775 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, d3f860ad-a04e-412e-8ca2-41b7fe5c9c8e, localhost:4203): creating call state
2025-11-14 10:12:05,776 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, d3f860ad-a04e-412e-8ca2-41b7fe5c9c8e, localhost:4203): request = { database: "local" }
2025-11-14 10:12:05,779 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, d3f860ad-a04e-412e-8ca2-41b7fe5c9c8e, localhost:4203): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-adxazuzm5e.auto.internal" port: 4203 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-11-14 10:12:05,779 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-adxazuzm5e.auto.internal:4203, location 1, ssl: False>]>
2025-11-14 10:12:05,780 - INFO - ydb.connection - close: Closing channel for endpoint localhost:4203
2025-11-14 10:12:11,338 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-11-14 10:12:11,339 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')]
2025-11-14 10:12:11,343 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-11-14 10:12:11,344 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 92a7cfed-a164-47f3-808d-74b3a6ca9235, localhost:4203): creating call state
2025-11-14 10:12:11,344 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 92a7cfed-a164-47f3-808d-74b3a6ca9235, localhost:4203): request = { database: "local" }
2025-11-14 10:12:11,347 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 92a7cfed-a164-47f3-808d-74b3a6ca9235, localhost:4203): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-adxazuzm5e.auto.internal" port: 4203 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-11-14 10:12:11,348 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-adxazuzm5e.auto.internal:4203, location 1, ssl: False>]>
2025-11-14 10:12:11,348 - INFO - ydb.connection - close: Closing channel for endpoint localhost:4203
2025-11-14 10:12:15,989 - DEBUG - root - test_checkpoints_on_join_s3_with_yds: Wait checkpoints after restore success
2025-11-14 10:12:16,176 - DEBUG - root - control_query: Result: 
2025-11-14 10:12:16,188 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej33m2mslnh1fn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115108
        nanos: 988167000
      }
      modified_at {
        seconds: 1763115136
        nanos: 167484000
      }
      revision: 2
    }
    started_at {
      seconds: 1763115109
      nanos: 303000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudsej33m2kla34504-ptqudsej33m2mslnh1fn"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1763115108
      nanos: 988167000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA dq.MaxTasksPerStage=\"2\";\n\n            $s3_dict_raw =\n                SELECT cast(Data AS json) AS data\n                FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict`.`*`\n                WITH (format=raw, SCHEMA (\n                    Data String NOT NULL\n                ));\n\n            $s3_dict =\n                SELECT\n                    cast(JSON_VALUE(data, \'$.key\') AS int64) AS key,\n                    cast(JSON_VALUE(data, \'$.value\') AS String) AS value\n                FROM $s3_dict_raw;\n\n            $parsed_yson_topic =\n                SELECT\n                    Yson::LookupInt64(yson_data, \"key\") AS key,\n                    Yson::LookupString(yson_data, \"val\") AS val\n                FROM (\n                    SELECT\n                        Yson::Parse(Data) AS yson_data\n                    FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_input` WITH SCHEMA (Data String NOT NULL));\n\n            $joined_seq =\n                SELECT\n                    s3_dict.value AS num,\n                    yds_seq.val AS word\n                FROM $parsed_yson_topic AS yds_seq\n                    INNER JOIN $s3_dict AS s3_dict\n                        ON yds_seq.key = s3_dict.key;\n\n            INSERT INTO `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_output`\n            SELECT\n                Yson::SerializeText(Yson::From(TableRow()))\n            FROM $joined_seq;\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":17,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":15,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[17]},{\"Id\":4,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"SkipNullMembers\"},{\"Name\":\"DqPhyMapJoin\"},{\"Name\":\"ExtractMembers\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[6,15]},{\"Id\":3,\"Name\":\"DqQuery!\",\"DependsOn\":[4]},{\"Id\":2,\"Name\":\"Commit!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":2,\"DqQuery!\":1,\"DqStage\":4}},\"Basic\":{\"nodes\":[{\"id\":6,\"level\":1,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":17,\"level\":1,\"name\":\"DqStage #17\",\"type\":\"op\"},{\"id\":15,\"level\":2,\"name\":\"DqStage #15\",\"type\":\"op\"},{\"id\":4,\"level\":3,\"name\":\"DqStage #4\",\"type\":\"op\"},{\"id\":3,\"level\":4,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":2,\"level\":5,\"name\":\"Commit!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":17,\"target\":15},{\"source\":6,\"target\":4},{\"source\":15,\"target\":4},{\"source\":4,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":5,\"count\":4,\"avg\":1,\"max\":2,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.59s\",\"count\":5,\"avg\":\"0.11s\",\"max\":\"0.17s\",\"min\":\"3ms\"},\"IngressBytes\":{\"sum\":354,\"count\":3,\"avg\":118,\"max\":274,\"min\":26},\"IngressRows\":{\"sum\":3,\"count\":2,\"avg\":1,\"max\":2,\"min\":1},\"InputBytes\":{\"sum\":49,\"count\":2,\"avg\":24,\"max\":26,\"min\":23},\"InputRows\":{\"sum\":6,\"count\":2,\"avg\":3,\"max\":3,\"min\":3},\"OutputBytes\":{\"sum\":49,\"count\":3,\"avg\":16,\"max\":23,\"min\":8},\"OutputRows\":{\"sum\":6,\"count\":3,\"avg\":2,\"max\":3,\"min\":1},\"EgressBytes\":{\"sum\":316,\"count\":1,\"avg\":316,\"max\":316,\"min\":316},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":10158080,\"count\":5,\"avg\":2031616,\"max\":2031616,\"min\":2031616},\"IngressQueuedBytes\":{\"sum\":0,\"count\":5,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":5,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"dq\" \'\"$all\") \'\"Attr\" \'\"maxtasksperstage\" \'\"2\"))\n(let $3 \'\"h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds\")\n(let $4 (DataSource \'\"pq\" $3))\n(let $5 \'(\'(\'\"PartitionsCount\" \'1)))\n(let $6 (DataType \'String))\n(let $7 (StructType \'(\'\"Data\" $6)))\n(let $8 (PqTopic $3 \'\"local\" \'\"yds_dict_input\" $5 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:4203\"))\n(let $10 \'(\'\"SharedReading\" \'0))\n(let $11 \'(\'\"AddBearerToToken\" \'1))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"raw\") \'(\'\"ReadGroup\" \'\"ptcudsej33n113nnd7t9\") $11))\n(let $13 \'\"cluster:default_h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds\")\n(let $14 (SecureParam $13))\n(let $15 (DqPqTopicSource $2 $8 \'(\'\"Data\") $12 $14 \'\"\" $7))\n(let $16 \'(\'format \'\"raw\"))\n(let $17 (lambda \'($41) (AsStruct \'(\'\"Data\" $41))))\n(let $18 (ResourceType \'\"Yson2.Node\"))\n(let $19 \'(\'(\'\"strict\")))\n(let $20 (Bool \'\"true\"))\n(let $21 (DataType \'Yson))\n(let $22 \'($18 \'\"\" \'1))\n(let $23 (CallableType \'() \'($21) $22))\n(let $24 (OptionalType (DataType \'Int64)))\n(let $25 \'($18))\n(let $26 (OptionalType $6))\n(let $27 (DqStage \'((DqSource $4 $15)) (lambda \'($38) (block \'(\n  (let $39 \'($16 \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'settings \'($10))))\n  (let $40 (DqSourceWideWrap $38 $4 $7 $39))\n  (return (FlatMap (NarrowMap $40 $17) (lambda \'($42) (block \'(\n    (let $43 (ResourceType \'\"Yson2.Options\"))\n    (let $44 (TupleType (TupleType $6 $43) (StructType) (TupleType)))\n    (let $45 \'(\'1))\n    (let $46 \'($6 \'\"\" \'1))\n    (let $47 \'((OptionalType $43)))\n    (let $48 (CallableType $45 \'((OptionalType $18)) $46 $47))\n    (let $49 (Udf \'\"Yson2.Parse\" (Void) $44 \'\"\" $48 (VoidType) \'\"\" \'()))\n    (let $50 (OptionalType (DataType \'Bool)))\n    (let $51 (CallableType \'(\'\"2\") \'($43) \'($50 \'\"AutoConvert\") \'($50 \'\"Strict\")))\n    (let $52 (Udf \'\"Yson2.Options\" (Void) (VoidType) \'\"\" $51 (VoidType) \'\"\" $19))\n    (let $53 (Just (NamedApply $52 \'() (AsStruct \'(\'\"AutoConvert\" (Just (Bool \'\"false\"))) \'(\'\"Strict\" (Just $20))))))\n    (let $54 (Apply $49 (Member $42 \'\"Data\") $53))\n    (let $55 (FlatMap $54 (lambda \'($61) (block \'(\n      (let $62 (Udf \'\"Yson2.Serialize\" (Void) (VoidType) \'\"\" $23 (VoidType) \'\"\" $19))\n      (return (Just (Apply $62 $61)))\n    )))))\n    (let $56 \'($6))\n    (let $57 (TupleType (TupleType $21) (StructType) (TupleType)))\n    (let $58 \'($21 \'\"\" \'1))\n    (let $59 (CallableType $45 $25 $58 $47))\n    (let $60 (Udf \'\"Yson2.Parse\" (Void) $57 \'\"\" $59 (VoidType) \'\"\" $19))\n    (return (Just (AsStruct \'(\'\"key\" (FlatMap $55 (lambda \'($63) (block \'(\n      (let $64 (CallableType $45 \'($24) $22 $56 $47))\n      (let $65 (Udf \'\"Yson2.LookupInt64\" (Void) (VoidType) \'\"\" $64 (VoidType) \'\"\" \'()))\n      (return (Apply $65 (Apply $60 $63) (String \'\"key\") $53))\n    ))))) \'(\'\"val\" (FlatMap $55 (lambda \'($66) (block \'(\n      (let $67 (CallableType $45 \'($26) $22 $56 $47))\n      (let $68 (Udf \'\"Yson2.LookupString\" (Void) (VoidType) \'\"\" $67 (VoidType) \'\"\" \'()))\n      (return (Apply $68 (Apply $60 $66) (String \'\"val\") $53))\n    ))))))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202548))))\n(let $28 \'\"h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict\")\n(let $29 (DataSource \'\"s3\" $28))\n(let $30 \'\"Paths {\\n  Name: \\\"a\\\"\\n  Children {\\n    Name: \\\"b\\\"\\n    Children {\\n      Name: \\\"c\\\"\\n      Children {\\n        Name: \\\"1.json\\\"\\n        Size: 26\\n        Read: true\\n      }\\n      Children {\\n        Name: \\\"2.json\\\"\\n        Size: 26\\n        Read: true\\n      }\\n      Children {\\n        Name: \\\"3.json\\\"\\n        Size: 28\\n        Read: true\\n      }\\n      IsDirectory: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $31 \'\"cluster:default_h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict\")\n(let $32 (S3SourceSettings $2 \'(\'((String $30) $20 (AsStruct))) (SecureParam $31) \'\"\" \'\"* \" (Void) (Void) (Void)))\n(let $33 (DqStage \'((DqSource $29 $32)) (lambda \'($69) (block \'(\n  (let $70 (DqSourceWideWrap $69 $29 $7 \'($16 \'(\'settings \'()))))\n  (return (FlatMap (NarrowMap $70 $17) (lambda \'($71) (block \'(\n    (let $72 (SafeCast (Member $71 \'\"Data\") (OptionalType (DataType \'Json))))\n    (let $73 (JsonValue $72 (Utf8 \'\"$.key\") (EmptyDict) \'DefaultValue (Null) \'DefaultValue (Null)))\n    (let $74 (JsonValue $72 (Utf8 \'\"$.value\") (EmptyDict) \'DefaultValue (Null) \'DefaultValue (Null)))\n    (return (Just (AsStruct \'(\'\"key\" (SafeCast $73 $24)) \'(\'\"value\" (SafeCast $74 $26)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202590))))\n(let $34 (DqStage \'((DqCnUnionAll (TDqOutput $33 \'0))) (lambda \'($75) $75) \'(\'(\'\"_logical_id\" \'202646))))\n(let $35 (DataSink \'\"pq\" $3))\n(let $36 (PqTopic $3 \'\"local\" \'\"yds_dict_output\" $5 \'() $7))\n(let $37 (DqPqTopicSink $36 \'($9 $11) $14))\n(return (Commit! (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $27 \'0)) (DqCnBroadcast (TDqOutput $34 \'0))) (lambda \'($76 $77) (block \'(\n  (let $78 \'(\'\"key\"))\n  (let $79 (DqPhyMapJoin (SkipNullMembers $76 $78) (SkipNullMembers $77 $78) \'\"yds_seq\" \'\"s3_dict\" \'Inner \'(\'(\'\"yds_seq\" \'\"key\" \'\"s3_dict\" \'\"key\")) \'(\'\"yds_seq.key\") \'(\'\"s3_dict.key\")))\n  (return (FlatMap (ExtractMembers $79 \'(\'\"s3_dict.value\" \'\"yds_seq.val\")) (lambda \'($80) (block \'(\n    (let $81 (Udf \'\"Yson2.SerializeText\" (Void) (VoidType) \'\"\" $23 (VoidType) \'\"\" $19))\n    (let $82 (StructType \'(\'\"num\" $26) \'(\'\"word\" $26)))\n    (let $83 (TupleType (TupleType $82) (StructType) (TupleType)))\n    (let $84 (CallableType \'() $25 \'($82)))\n    (let $85 (Udf \'\"Yson2.From\" (Void) $83 \'\"\" $84 (VoidType) \'\"\" $19))\n    (return (Just (AsStruct \'(\'\"column0\" (Apply $81 (Apply $85 (AsStruct \'(\'\"num\" (Member $80 \'\"s3_dict.value\")) \'(\'\"word\" (Member $80 \'\"yds_seq.val\")))))))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202791)) \'((DqSink \'0 $35 $37))))) $35) (DataSink \'\"s3\" $28)))\n)\n"
  }
}

2025-11-14 10:12:16,701 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-11-14 10:12:17,211 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudsej33m2mslnh1fn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1763115108
        nanos: 988167000
      }
      modified_at {
        seconds: 1763115136
        nanos: 167484000
      }
      revision: 2
    }
    started_at {
      seconds: 1763115109
      nanos: 303000000
    }
    finished_at {
      seconds: 1763115137
      nanos: 74000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudsej33m2kla34504-ptqudsej33m2mslnh1fn"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1763115108
      nanos: 988167000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA dq.MaxTasksPerStage=\"2\";\n\n            $s3_dict_raw =\n                SELECT cast(Data AS json) AS data\n                FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict`.`*`\n                WITH (format=raw, SCHEMA (\n                    Data String NOT NULL\n                ));\n\n            $s3_dict =\n                SELECT\n                    cast(JSON_VALUE(data, \'$.key\') AS int64) AS key,\n                    cast(JSON_VALUE(data, \'$.value\') AS String) AS value\n                FROM $s3_dict_raw;\n\n            $parsed_yson_topic =\n                SELECT\n                    Yson::LookupInt64(yson_data, \"key\") AS key,\n                    Yson::LookupString(yson_data, \"val\") AS val\n                FROM (\n                    SELECT\n                        Yson::Parse(Data) AS yson_data\n                    FROM `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_input` WITH SCHEMA (Data String NOT NULL));\n\n            $joined_seq =\n                SELECT\n                    s3_dict.value AS num,\n                    yds_seq.val AS word\n                FROM $parsed_yson_topic AS yds_seq\n                    INNER JOIN $s3_dict AS s3_dict\n                        ON yds_seq.key = s3_dict.key;\n\n            INSERT INTO `h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds`.`yds_dict_output`\n            SELECT\n                Yson::SerializeText(Yson::From(TableRow()))\n            FROM $joined_seq;\n            "
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":17,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":15,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[17]},{\"Id\":4,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"SkipNullMembers\"},{\"Name\":\"DqPhyMapJoin\"},{\"Name\":\"ExtractMembers\"},{\"Name\":\"FlatMap\"}]},\"DependsOn\":[6,15]},{\"Id\":3,\"Name\":\"DqQuery!\",\"DependsOn\":[4]},{\"Id\":2,\"Name\":\"Commit!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":2,\"DqQuery!\":1,\"DqStage\":4}},\"Basic\":{\"nodes\":[{\"id\":6,\"level\":1,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":17,\"level\":1,\"name\":\"DqStage #17\",\"type\":\"op\"},{\"id\":15,\"level\":2,\"name\":\"DqStage #15\",\"type\":\"op\"},{\"id\":4,\"level\":3,\"name\":\"DqStage #4\",\"type\":\"op\"},{\"id\":3,\"level\":4,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":2,\"level\":5,\"name\":\"Commit!\",\"type\":\"op\"},{\"id\":1,\"level\":6,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":17,\"target\":15},{\"source\":6,\"target\":4},{\"source\":15,\"target\":4},{\"source\":4,\"target\":3},{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":5,\"count\":4,\"avg\":1,\"max\":2,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.59s\",\"count\":5,\"avg\":\"0.11s\",\"max\":\"0.17s\",\"min\":\"3ms\"},\"IngressBytes\":{\"sum\":354,\"count\":3,\"avg\":118,\"max\":274,\"min\":26},\"IngressRows\":{\"sum\":3,\"count\":2,\"avg\":1,\"max\":2,\"min\":1},\"InputBytes\":{\"sum\":49,\"count\":2,\"avg\":24,\"max\":26,\"min\":23},\"InputRows\":{\"sum\":6,\"count\":2,\"avg\":3,\"max\":3,\"min\":3},\"OutputBytes\":{\"sum\":49,\"count\":3,\"avg\":16,\"max\":23,\"min\":8},\"OutputRows\":{\"sum\":6,\"count\":3,\"avg\":2,\"max\":3,\"min\":1},\"EgressBytes\":{\"sum\":316,\"count\":1,\"avg\":316,\"max\":316,\"min\":316},\"EgressRows\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2},\"MaxMemoryUsage\":{\"sum\":10158080,\"count\":5,\"avg\":2031616,\"max\":2031616,\"min\":2031616},\"IngressQueuedBytes\":{\"sum\":0,\"count\":5,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":5,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (Configure! $1 (DataSource \'\"dq\" \'\"$all\") \'\"Attr\" \'\"maxtasksperstage\" \'\"2\"))\n(let $3 \'\"h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds\")\n(let $4 (DataSource \'\"pq\" $3))\n(let $5 \'(\'(\'\"PartitionsCount\" \'1)))\n(let $6 (DataType \'String))\n(let $7 (StructType \'(\'\"Data\" $6)))\n(let $8 (PqTopic $3 \'\"local\" \'\"yds_dict_input\" $5 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:4203\"))\n(let $10 \'(\'\"SharedReading\" \'0))\n(let $11 \'(\'\"AddBearerToToken\" \'1))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"raw\") \'(\'\"ReadGroup\" \'\"ptcudsej33n113nnd7t9\") $11))\n(let $13 \'\"cluster:default_h894734785379669734_test_checkpoints_on_join_s3_with_ydsyds\")\n(let $14 (SecureParam $13))\n(let $15 (DqPqTopicSource $2 $8 \'(\'\"Data\") $12 $14 \'\"\" $7))\n(let $16 \'(\'format \'\"raw\"))\n(let $17 (lambda \'($41) (AsStruct \'(\'\"Data\" $41))))\n(let $18 (ResourceType \'\"Yson2.Node\"))\n(let $19 \'(\'(\'\"strict\")))\n(let $20 (Bool \'\"true\"))\n(let $21 (DataType \'Yson))\n(let $22 \'($18 \'\"\" \'1))\n(let $23 (CallableType \'() \'($21) $22))\n(let $24 (OptionalType (DataType \'Int64)))\n(let $25 \'($18))\n(let $26 (OptionalType $6))\n(let $27 (DqStage \'((DqSource $4 $15)) (lambda \'($38) (block \'(\n  (let $39 \'($16 \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'settings \'($10))))\n  (let $40 (DqSourceWideWrap $38 $4 $7 $39))\n  (return (FlatMap (NarrowMap $40 $17) (lambda \'($42) (block \'(\n    (let $43 (ResourceType \'\"Yson2.Options\"))\n    (let $44 (TupleType (TupleType $6 $43) (StructType) (TupleType)))\n    (let $45 \'(\'1))\n    (let $46 \'($6 \'\"\" \'1))\n    (let $47 \'((OptionalType $43)))\n    (let $48 (CallableType $45 \'((OptionalType $18)) $46 $47))\n    (let $49 (Udf \'\"Yson2.Parse\" (Void) $44 \'\"\" $48 (VoidType) \'\"\" \'()))\n    (let $50 (OptionalType (DataType \'Bool)))\n    (let $51 (CallableType \'(\'\"2\") \'($43) \'($50 \'\"AutoConvert\") \'($50 \'\"Strict\")))\n    (let $52 (Udf \'\"Yson2.Options\" (Void) (VoidType) \'\"\" $51 (VoidType) \'\"\" $19))\n    (let $53 (Just (NamedApply $52 \'() (AsStruct \'(\'\"AutoConvert\" (Just (Bool \'\"false\"))) \'(\'\"Strict\" (Just $20))))))\n    (let $54 (Apply $49 (Member $42 \'\"Data\") $53))\n    (let $55 (FlatMap $54 (lambda \'($61) (block \'(\n      (let $62 (Udf \'\"Yson2.Serialize\" (Void) (VoidType) \'\"\" $23 (VoidType) \'\"\" $19))\n      (return (Just (Apply $62 $61)))\n    )))))\n    (let $56 \'($6))\n    (let $57 (TupleType (TupleType $21) (StructType) (TupleType)))\n    (let $58 \'($21 \'\"\" \'1))\n    (let $59 (CallableType $45 $25 $58 $47))\n    (let $60 (Udf \'\"Yson2.Parse\" (Void) $57 \'\"\" $59 (VoidType) \'\"\" $19))\n    (return (Just (AsStruct \'(\'\"key\" (FlatMap $55 (lambda \'($63) (block \'(\n      (let $64 (CallableType $45 \'($24) $22 $56 $47))\n      (let $65 (Udf \'\"Yson2.LookupInt64\" (Void) (VoidType) \'\"\" $64 (VoidType) \'\"\" \'()))\n      (return (Apply $65 (Apply $60 $63) (String \'\"key\") $53))\n    ))))) \'(\'\"val\" (FlatMap $55 (lambda \'($66) (block \'(\n      (let $67 (CallableType $45 \'($26) $22 $56 $47))\n      (let $68 (Udf \'\"Yson2.LookupString\" (Void) (VoidType) \'\"\" $67 (VoidType) \'\"\" \'()))\n      (return (Apply $68 (Apply $60 $66) (String \'\"val\") $53))\n    ))))))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202548))))\n(let $28 \'\"h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict\")\n(let $29 (DataSource \'\"s3\" $28))\n(let $30 \'\"Paths {\\n  Name: \\\"a\\\"\\n  Children {\\n    Name: \\\"b\\\"\\n    Children {\\n      Name: \\\"c\\\"\\n      Children {\\n        Name: \\\"1.json\\\"\\n        Size: 26\\n        Read: true\\n      }\\n      Children {\\n        Name: \\\"2.json\\\"\\n        Size: 26\\n        Read: true\\n      }\\n      Children {\\n        Name: \\\"3.json\\\"\\n        Size: 28\\n        Read: true\\n      }\\n      IsDirectory: true\\n    }\\n    IsDirectory: true\\n  }\\n  IsDirectory: true\\n}\\n\")\n(let $31 \'\"cluster:default_h894734785379669734_test_checkpoints_on_join_s3_with_ydss3_dict\")\n(let $32 (S3SourceSettings $2 \'(\'((String $30) $20 (AsStruct))) (SecureParam $31) \'\"\" \'\"* \" (Void) (Void) (Void)))\n(let $33 (DqStage \'((DqSource $29 $32)) (lambda \'($69) (block \'(\n  (let $70 (DqSourceWideWrap $69 $29 $7 \'($16 \'(\'settings \'()))))\n  (return (FlatMap (NarrowMap $70 $17) (lambda \'($71) (block \'(\n    (let $72 (SafeCast (Member $71 \'\"Data\") (OptionalType (DataType \'Json))))\n    (let $73 (JsonValue $72 (Utf8 \'\"$.key\") (EmptyDict) \'DefaultValue (Null) \'DefaultValue (Null)))\n    (let $74 (JsonValue $72 (Utf8 \'\"$.value\") (EmptyDict) \'DefaultValue (Null) \'DefaultValue (Null)))\n    (return (Just (AsStruct \'(\'\"key\" (SafeCast $73 $24)) \'(\'\"value\" (SafeCast $74 $26)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202590))))\n(let $34 (DqStage \'((DqCnUnionAll (TDqOutput $33 \'0))) (lambda \'($75) $75) \'(\'(\'\"_logical_id\" \'202646))))\n(let $35 (DataSink \'\"pq\" $3))\n(let $36 (PqTopic $3 \'\"local\" \'\"yds_dict_output\" $5 \'() $7))\n(let $37 (DqPqTopicSink $36 \'($9 $11) $14))\n(return (Commit! (Commit! (DqQuery! $2 \'((DqStage \'((DqCnMap (TDqOutput $27 \'0)) (DqCnBroadcast (TDqOutput $34 \'0))) (lambda \'($76 $77) (block \'(\n  (let $78 \'(\'\"key\"))\n  (let $79 (DqPhyMapJoin (SkipNullMembers $76 $78) (SkipNullMembers $77 $78) \'\"yds_seq\" \'\"s3_dict\" \'Inner \'(\'(\'\"yds_seq\" \'\"key\" \'\"s3_dict\" \'\"key\")) \'(\'\"yds_seq.key\") \'(\'\"s3_dict.key\")))\n  (return (FlatMap (ExtractMembers $79 \'(\'\"s3_dict.value\" \'\"yds_seq.val\")) (lambda \'($80) (block \'(\n    (let $81 (Udf \'\"Yson2.SerializeText\" (Void) (VoidType) \'\"\" $23 (VoidType) \'\"\" $19))\n    (let $82 (StructType \'(\'\"num\" $26) \'(\'\"word\" $26)))\n    (let $83 (TupleType (TupleType $82) (StructType) (TupleType)))\n    (let $84 (CallableType \'() $25 \'($82)))\n    (let $85 (Udf \'\"Yson2.From\" (Void) $83 \'\"\" $84 (VoidType) \'\"\" $19))\n    (return (Just (AsStruct \'(\'\"column0\" (Apply $81 (Apply $85 (AsStruct \'(\'\"num\" (Member $80 \'\"s3_dict.value\")) \'(\'\"word\" (Member $80 \'\"yds_seq.val\")))))))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'202791)) \'((DqSink \'0 $35 $37))))) $35) (DataSink \'\"s3\" $28)))\n)\n"
  }
}

2025-11-14 10:12:17,214 - INFO - ya.test - pytest_runtest_teardown: Test teardown
