2024-06-28 14:03:18,597 - INFO - ya.test - pytest_runtest_setup: #################################################################################################### 2024-06-28 14:03:18,597 - INFO - ya.test - pytest_runtest_setup: test_high_rate[kikimr0] 2024-06-28 14:03:18,598 - INFO - ya.test - pytest_runtest_setup: #################################################################################################### 2024-06-28 14:03:18,598 - INFO - ya.test - pytest_runtest_setup: Test setup 2024-06-28 14:03:18,631 - DEBUG - library.python.filelock - acquire: Acquiring filelock (blocking=False): /home/runner/.ya/build/port_sync_dir/2890 2024-06-28 14:03:18,633 - DEBUG - library.python.filelock - acquire: Acquiring filelock (blocking=False): /home/runner/.ya/build/port_sync_dir/16315 2024-06-28 14:03:18,714 - DEBUG - library.python.filelock - acquire: Acquiring filelock (blocking=False): /home/runner/.ya/build/port_sync_dir/12260 2024-06-28 14:03:18,726 - DEBUG - library.python.filelock - acquire: Acquiring filelock (blocking=False): /home/runner/.ya/build/port_sync_dir/12623 2024-06-28 14:03:18,727 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:03:18,729 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:03:18,729 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:03:18,737 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:03:18,737 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, acfc2e9c-cab0-4261-9334-eff71d90915c, localhost:6048): creating call state 2024-06-28 14:03:18,738 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, acfc2e9c-cab0-4261-9334-eff71d90915c, localhost:6048): request = { database: "local" } 2024-06-28 14:03:18,741 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, acfc2e9c-cab0-4261-9334-eff71d90915c, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:03:18,763 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:03:18,764 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:03:18,779 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:03:18,780 - DEBUG - ydb.table.SessionPool - subscribe: Active session queue is empty, subscribe waiter for a session 2024-06-28 14:03:18,781 - DEBUG - ydb.table.SessionPool - subscribe: Subscribe waiter 2024-06-28 14:03:18,781 - DEBUG - ydb.table.SessionPool - subscribe: Session pool is not large enough (active_count < size: 0 < 1). will create a new session. 2024-06-28 14:03:18,781 - DEBUG - ydb.table.SessionPool - _create: Created session 2024-06-28 14:03:18,781 - DEBUG - ydb.table.SessionPool - _prepare: Preparing session 2024-06-28 14:03:18,784 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateSession, 7ac64253-87bc-493b-828c-5d6e820b0e94, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): creating call state 2024-06-28 14:03:18,784 - DEBUG - ydb.connection - _log_request: RpcState(CreateSession, 7ac64253-87bc-493b-828c-5d6e820b0e94, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): request = { operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } } 2024-06-28 14:03:18,788 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 7ac64253-87bc-493b-828c-5d6e820b0e94, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): on response callback started 2024-06-28 14:03:18,791 - DEBUG - ydb.connection - _log_response: RpcState(CreateSession, 7ac64253-87bc-493b-828c-5d6e820b0e94, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.CreateSessionResult] { session_id: "ydb://session/3?node_id=1&id=OWY2YTVkMDctOTY5MjMxNi1jMWM1MGJiYy1iMTBiMzkyMQ==" } } } } 2024-06-28 14:03:18,792 - DEBUG - ydb.table.SessionPool - put: Put on session 2024-06-28 14:03:18,792 - DEBUG - ydb.table.SessionPool - put: Replying to waiter with a session 2024-06-28 14:03:18,792 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 7ac64253-87bc-493b-828c-5d6e820b0e94, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): on response callback success 2024-06-28 14:03:18,796 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, e858552c-537d-494c-a41b-d04f269cb1f4, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): creating call state 2024-06-28 14:03:18,798 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, e858552c-537d-494c-a41b-d04f269cb1f4, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): request = { session_id: "ydb://session/3?node_id=1&id=OWY2YTVkMDctOTY5MjMxNi1jMWM1MGJiYy1iMTBiMzkyMQ==" path: "local/DbPoolStorage_d880716a-e9c5-498c-8d0c-2effa42fcc9a/tenants" columns { name: "tenant" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "common" type { optional_type { item { type_id: BOOL } } } } columns { name: "state" type { optional_type { item { type_id: UINT32 } } } } columns { name: "state_time" type { optional_type { item { type_id: TIMESTAMP } } } } primary_key: "tenant" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } } 2024-06-28 14:03:18,843 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, e858552c-537d-494c-a41b-d04f269cb1f4, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): response = { operation { ready: true status: SUCCESS } } 2024-06-28 14:03:18,847 - DEBUG - ydb.table.SessionPool - put: Put on session 2024-06-28 14:03:18,851 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, ba5f2316-30cb-481f-8527-bcf0e061db58, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): creating call state 2024-06-28 14:03:18,852 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, ba5f2316-30cb-481f-8527-bcf0e061db58, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): request = { session_id: "ydb://session/3?node_id=1&id=OWY2YTVkMDctOTY5MjMxNi1jMWM1MGJiYy1iMTBiMzkyMQ==" path: "local/DbPoolStorage_d880716a-e9c5-498c-8d0c-2effa42fcc9a/mappings" columns { name: "subject_type" type { optional_type { item { type_id: STRING } } } } columns { name: "subject_id" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } primary_key: "subject_type" primary_key: "subject_id" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } } 2024-06-28 14:03:18,888 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, ba5f2316-30cb-481f-8527-bcf0e061db58, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): response = { operation { ready: true status: SUCCESS } } 2024-06-28 14:03:18,889 - DEBUG - ydb.table.SessionPool - put: Put on session 2024-06-28 14:03:18,894 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteDataQuery, d94c9de5-859e-45e4-9a24-967d4cb2f283, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): creating call state 2024-06-28 14:03:18,895 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteDataQuery, d94c9de5-859e-45e4-9a24-967d4cb2f283, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): request = { session_id: "ydb://session/3?node_id=1&id=OWY2YTVkMDctOTY5MjMxNi1jMWM1MGJiYy1iMTBiMzkyMQ==" tx_control { begin_tx { serializable_read_write { } } commit_tx: true } query { yql_text: "--!syntax_v1\n PRAGMA TablePathPrefix(\"local/DbPoolStorage_d880716a-e9c5-498c-8d0c-2effa42fcc9a\");\n UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/default\", \"/default\", true, 0, CurrentUtcTimestamp());\n " } operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } } 2024-06-28 14:03:18,920 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteDataQuery, d94c9de5-859e-45e4-9a24-967d4cb2f283, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.ExecuteQueryResult] { tx_meta { } } } } } 2024-06-28 14:03:18,921 - DEBUG - ydb.table.SessionPool - put: Put on session 2024-06-28 14:03:19,028 - DEBUG - library.python.filelock - acquire: Acquiring filelock (blocking=False): /home/runner/.ya/build/port_sync_dir/11314 2024-06-28 14:03:19,029 - DEBUG - library.python.filelock - acquire: Acquiring filelock (blocking=False): /home/runner/.ya/build/port_sync_dir/11315 2024-06-28 14:03:19,030 - DEBUG - library.python.filelock - acquire: Acquiring filelock (blocking=False): /home/runner/.ya/build/port_sync_dir/8930 2024-06-28 14:03:19,031 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd 2024-06-28 14:03:19,045 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs" 2024-06-28 14:03:19,046 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd server --suppress-version-check --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_zmaqsmrr.log --yaml-config=$CFG_DIR_PATH/config.yaml --grpc-port=12623 --mon-port=11315 --ic-port=12260 2024-06-28 14:03:19,047 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_zmaqsmrr.log', '--yaml-config=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs/config.yaml', '--grpc-port=12623', '--mon-port=11315', '--ic-port=12260')' with input '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/stdin' in '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1' (no wait) 2024-06-28 14:03:19,049 - DEBUG - ya.test - execute: Command pid: 2942566 2024-06-28 14:03:19,050 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:12623/1 2024-06-28 14:03:19,050 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized 2024-06-28 14:03:19,053 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_retry.py::TestRetry, test_name: test_high_rate[kikimr0]) 2024-06-28 14:03:19,057 - DEBUG - root - create_stream: Requesting CreateStream. Database: "local". Request: stream_name: "/local/high_rate_input" shard_count: 1 write_quota_kb_per_sec: 1024 retention_period_hours: 1 2024-06-28 14:03:19,119 - DEBUG - root - _get_and_check_result: Response: operation { ready: true status: SUCCESS } 2024-06-28 14:03:19,120 - DEBUG - root - _get_and_check_result: Result: 2024-06-28 14:03:19,121 - DEBUG - root - create_stream: Requesting CreateStream. Database: "local". Request: stream_name: "/local/high_rate_output" shard_count: 1 write_quota_kb_per_sec: 1024 retention_period_hours: 1 2024-06-28 14:03:19,187 - DEBUG - root - _get_and_check_result: Response: operation { ready: true status: SUCCESS } 2024-06-28 14:03:19,190 - DEBUG - root - _get_and_check_result: Result: 2024-06-28 14:03:19,224 - DEBUG - root - _get_and_check_result: Response: operation { ready: true status: SUCCESS } 2024-06-28 14:03:19,224 - DEBUG - root - _get_and_check_result: Result: 2024-06-28 14:03:33,806 - DEBUG - root - create_query_impl: Request: content { type: STREAMING name: "a" acl { visibility: PRIVATE } limits { execution_timeout { } } text: "SELECT * FROM high_rate.`high_rate_input`;" syntax: YQL_V1 } execute_mode: RUN idempotency_key: "92b8fe09-bcf3-4c06-96ae-55cf2c1ebe7c" 2024-06-28 14:03:34,201 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:03:34,202 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:03:34,208 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:03:34,209 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 716032f5-2a33-4b51-8dc9-83383e5a74a1, localhost:6048): creating call state 2024-06-28 14:03:34,210 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 716032f5-2a33-4b51-8dc9-83383e5a74a1, localhost:6048): request = { database: "local" } 2024-06-28 14:03:34,213 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 716032f5-2a33-4b51-8dc9-83383e5a74a1, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:03:34,214 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:03:34,214 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:03:34,451 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:03:34,452 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:03:34,455 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:03:34,456 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, dc13483e-5f6b-431f-a9e6-0b79d2bbfb7a, localhost:6048): creating call state 2024-06-28 14:03:34,457 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, dc13483e-5f6b-431f-a9e6-0b79d2bbfb7a, localhost:6048): request = { database: "local" } 2024-06-28 14:03:34,463 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, dc13483e-5f6b-431f-a9e6-0b79d2bbfb7a, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:03:34,464 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:03:34,464 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:03:34,480 - DEBUG - root - create_query_impl: Result: query_id: "ptquf41h4na6e89jl0l6" 2024-06-28 14:03:34,567 - DEBUG - root - describe_query: Result: query { meta { common { id: "ptquf41h4na6e89jl0l6" created_by: "root@builtin" modified_by: "root@builtin" created_at { seconds: 1719583413 nanos: 823011000 } modified_at { seconds: 1719583413 nanos: 823011000 } revision: 1 } execute_mode: RUN status: STARTING last_job_query_revision: 1 last_job_id: "ptjuf41h4na6c38br661-ptquf41h4na6e89jl0l6" started_by: "root@builtin" submitted_at { seconds: 1719583413 nanos: 823011000 } } content { type: STREAMING name: "a" acl { visibility: PRIVATE } limits { execution_timeout { } } text: "SELECT * FROM high_rate.`high_rate_input`;" syntax: YQL_V1 } } 2024-06-28 14:03:35,091 - DEBUG - root - describe_query: Result: ... (repeated, see above) ... 2024-06-28 14:03:35,623 - DEBUG - root - describe_query: Result: ... (repeated, see above) ... 2024-06-28 14:03:36,145 - DEBUG - root - describe_query: Result: query { meta { common { id: "ptquf41h4na6e89jl0l6" created_by: "root@builtin" modified_by: "root@builtin" created_at { seconds: 1719583413 nanos: 823011000 } modified_at { seconds: 1719583413 nanos: 823011000 } revision: 1 } started_at { seconds: 1719583415 nanos: 516000000 } execute_mode: RUN status: RUNNING last_job_query_revision: 1 last_job_id: "ptjuf41h4na6c38br661-ptquf41h4na6e89jl0l6" started_by: "root@builtin" submitted_at { seconds: 1719583413 nanos: 823011000 } } content { type: STREAMING name: "a" acl { visibility: PRIVATE } limits { execution_timeout { } } text: "SELECT * FROM high_rate.`high_rate_input`;" syntax: YQL_V1 } plan { json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}" } result_set_meta { column { name: "Data" type { type_id: STRING } } } ast { data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 (DataSource \'\"pq\" \'\"high_rate\"))\n(let $4 (StructType \'(\'\"Data\" (DataType \'String))))\n(let $5 (PqTopic \'\"high_rate\" \'\"local\" \'\"high_rate_input\" \'(\'(\'\"PartitionsCount\" \'\"1\")) \'() $4))\n(let $6 (DqPqTopicSource $5 \'(\'\"Data\") \'(\'(\'\"Endpoint\" \'\"localhost:6048\") \'(\'\"AddBearerToToken\" \'\"1\")) (SecureParam \'\"cluster:default_high_rate\")))\n(let $7 (DqStage \'((DqSource $3 $6)) (lambda \'($10) (block \'(\n (let $11 (DqSourceWideWrap $10 $3 $4 \'(\'(\'\"format\" \'\"raw\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))))))\n (return (NarrowMap $11 (lambda \'($12) (AsStruct \'(\'\"Data\" $12)))))\n))) \'(\'(\'\"_logical_id\" \'199397))))\n(let $8 (DqStage \'((DqCnUnionAll (TDqOutput $7 \'\"0\"))) (lambda \'($13) $13) \'(\'(\'\"_logical_id\" \'199424))))\n(let $9 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $8 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $9 $2) (DataSink \'\"pq\" \'\"high_rate\")))\n)\n" } } 2024-06-28 14:03:47,705 - DEBUG - ydb.connection - _prepare_call: RpcState(KeepAlive, d9c8dc45-772d-48e1-8d27-1e067dece212, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): creating call state 2024-06-28 14:03:47,706 - DEBUG - ydb.connection - _log_request: RpcState(KeepAlive, d9c8dc45-772d-48e1-8d27-1e067dece212, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): request = { session_id: "ydb://session/3?node_id=1&id=OTFlOTA5OWQtYzdhNDdmMzMtYThlN2VhMDAtMzRmNDUyNDk=" operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } } 2024-06-28 14:03:47,712 - DEBUG - ydb.connection - _on_response_callback: RpcState(KeepAlive, d9c8dc45-772d-48e1-8d27-1e067dece212, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): on response callback started 2024-06-28 14:03:47,713 - DEBUG - ydb.connection - _log_response: RpcState(KeepAlive, d9c8dc45-772d-48e1-8d27-1e067dece212, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.KeepAliveResult] { session_status: SESSION_STATUS_READY } } } } 2024-06-28 14:03:47,713 - DEBUG - ydb.table.SessionPool - put: Put on session 2024-06-28 14:03:47,714 - DEBUG - ydb.connection - _on_response_callback: RpcState(KeepAlive, d9c8dc45-772d-48e1-8d27-1e067dece212, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): on response callback success 2024-06-28 14:04:08,151 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:12623/1 2024-06-28 14:04:08,154 - DEBUG - library.python.filelock - release: Ensuring filelock released: /home/runner/.ya/build/port_sync_dir/8930 2024-06-28 14:04:08,154 - DEBUG - library.python.filelock - release: Ensuring filelock released: /home/runner/.ya/build/port_sync_dir/11315 2024-06-28 14:04:08,168 - DEBUG - library.python.filelock - release: Ensuring filelock released: /home/runner/.ya/build/port_sync_dir/12623 2024-06-28 14:04:08,168 - DEBUG - library.python.filelock - release: Ensuring filelock released: /home/runner/.ya/build/port_sync_dir/12260 2024-06-28 14:04:08,168 - DEBUG - library.python.filelock - release: Ensuring filelock released: /home/runner/.ya/build/port_sync_dir/16315 2024-06-28 14:04:08,236 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd 2024-06-28 14:04:08,237 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs" 2024-06-28 14:04:08,237 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd server --suppress-version-check --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_ypd_09bu.log --yaml-config=$CFG_DIR_PATH/config.yaml --grpc-port=12623 --mon-port=11315 --ic-port=12260 2024-06-28 14:04:08,238 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_ypd_09bu.log', '--yaml-config=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs/config.yaml', '--grpc-port=12623', '--mon-port=11315', '--ic-port=12260')' with input '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/stdin' in '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1' (no wait) 2024-06-28 14:04:08,239 - DEBUG - ya.test - execute: Command pid: 2976090 2024-06-28 14:04:08,240 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:12623/1 2024-06-28 14:04:08,240 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized 2024-06-28 14:04:08,240 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap 2024-06-28 14:04:10,029 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped 2024-06-28 14:04:10,047 - DEBUG - root - describe_query: Result: query { meta { common { id: "ptquf41h4na6e89jl0l6" created_by: "root@builtin" modified_by: "root@builtin" created_at { seconds: 1719583413 nanos: 823011000 } modified_at { seconds: 1719583413 nanos: 823011000 } revision: 1 } started_at { seconds: 1719583415 nanos: 516000000 } execute_mode: RUN status: RUNNING last_job_query_revision: 1 last_job_id: "ptjuf41h4na6c38br661-ptquf41h4na6e89jl0l6" started_by: "root@builtin" has_saved_checkpoints: true submitted_at { seconds: 1719583413 nanos: 823011000 } } content { type: STREAMING name: "a" acl { visibility: PRIVATE } limits { execution_timeout { } } text: "SELECT * FROM high_rate.`high_rate_input`;" syntax: YQL_V1 } plan { json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}" } statistics { json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.15s\",\"count\":2,\"avg\":\"77ms\",\"max\":\"0.13s\",\"min\":\"17ms\"},\"MaxMemoryUsage\":{\"sum\":262144,\"count\":2,\"avg\":131072,\"max\":131072,\"min\":131072}}}" } result_set_meta { column { name: "Data" type { type_id: STRING } } } ast { data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 (DataSource \'\"pq\" \'\"high_rate\"))\n(let $4 (StructType \'(\'\"Data\" (DataType \'String))))\n(let $5 (PqTopic \'\"high_rate\" \'\"local\" \'\"high_rate_input\" \'(\'(\'\"PartitionsCount\" \'\"1\")) \'() $4))\n(let $6 (DqPqTopicSource $5 \'(\'\"Data\") \'(\'(\'\"Endpoint\" \'\"localhost:6048\") \'(\'\"AddBearerToToken\" \'\"1\")) (SecureParam \'\"cluster:default_high_rate\")))\n(let $7 (DqStage \'((DqSource $3 $6)) (lambda \'($10) (block \'(\n (let $11 (DqSourceWideWrap $10 $3 $4 \'(\'(\'\"format\" \'\"raw\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))))))\n (return (NarrowMap $11 (lambda \'($12) (AsStruct \'(\'\"Data\" $12)))))\n))) \'(\'(\'\"_logical_id\" \'199397))))\n(let $8 (DqStage \'((DqCnUnionAll (TDqOutput $7 \'\"0\"))) (lambda \'($13) $13) \'(\'(\'\"_logical_id\" \'199424))))\n(let $9 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $8 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $9 $2) (DataSink \'\"pq\" \'\"high_rate\")))\n)\n" } } 2024-06-28 14:04:20,848 - DEBUG - ydb.connection - _prepare_call: RpcState(KeepAlive, 09a84694-265f-4f9d-ba95-663a486819c3, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): creating call state 2024-06-28 14:04:20,849 - DEBUG - ydb.connection - _log_request: RpcState(KeepAlive, 09a84694-265f-4f9d-ba95-663a486819c3, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): request = { session_id: "ydb://session/3?node_id=1&id=N2U4MjczNjItMzQ3MzAzZjAtNzA1Yzk1ZDItNzE1YTkzNGY=" operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } } 2024-06-28 14:04:20,855 - DEBUG - ydb.connection - _on_response_callback: RpcState(KeepAlive, 09a84694-265f-4f9d-ba95-663a486819c3, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): on response callback started 2024-06-28 14:04:20,856 - DEBUG - ydb.connection - _log_response: RpcState(KeepAlive, 09a84694-265f-4f9d-ba95-663a486819c3, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.KeepAliveResult] { session_status: SESSION_STATUS_READY } } } } 2024-06-28 14:04:20,856 - DEBUG - ydb.connection - _on_response_callback: RpcState(KeepAlive, 09a84694-265f-4f9d-ba95-663a486819c3, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): on response callback success 2024-06-28 14:04:20,856 - DEBUG - ydb.table.SessionPool - put: Put on session 2024-06-28 14:04:21,501 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:04:21,520 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:04:21,524 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:04:21,524 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 4b5b7a91-3a35-4e98-b6cd-7d12dafcf406, localhost:6048): creating call state 2024-06-28 14:04:21,525 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 4b5b7a91-3a35-4e98-b6cd-7d12dafcf406, localhost:6048): request = { database: "local" } 2024-06-28 14:04:21,539 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 4b5b7a91-3a35-4e98-b6cd-7d12dafcf406, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:04:21,553 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:04:21,553 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:04:47,059 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:12623/1 2024-06-28 14:04:47,118 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd 2024-06-28 14:04:47,118 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs" 2024-06-28 14:04:47,119 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd server --suppress-version-check --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_vr67enh_.log --yaml-config=$CFG_DIR_PATH/config.yaml --grpc-port=12623 --mon-port=11315 --ic-port=12260 2024-06-28 14:04:47,120 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_vr67enh_.log', '--yaml-config=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs/config.yaml', '--grpc-port=12623', '--mon-port=11315', '--ic-port=12260')' with input '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/stdin' in '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1' (no wait) 2024-06-28 14:04:47,143 - DEBUG - ya.test - execute: Command pid: 3091356 2024-06-28 14:04:47,144 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:12623/1 2024-06-28 14:04:47,144 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized 2024-06-28 14:04:47,144 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap 2024-06-28 14:04:48,768 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped 2024-06-28 14:04:48,780 - DEBUG - root - describe_query: Result: query { meta { common { id: "ptquf41h4na6e89jl0l6" created_by: "root@builtin" modified_by: "root@builtin" created_at { seconds: 1719583413 nanos: 823011000 } modified_at { seconds: 1719583413 nanos: 823011000 } revision: 1 } started_at { seconds: 1719583415 nanos: 516000000 } execute_mode: RUN status: RUNNING last_job_query_revision: 1 last_job_id: "ptjuf41h4na6c38br661-ptquf41h4na6e89jl0l6" started_by: "root@builtin" has_saved_checkpoints: true submitted_at { seconds: 1719583413 nanos: 823011000 } } content { type: STREAMING name: "a" acl { visibility: PRIVATE } limits { execution_timeout { } } text: "SELECT * FROM high_rate.`high_rate_input`;" syntax: YQL_V1 } plan { json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}" } statistics { json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.10s\",\"count\":2,\"avg\":\"53ms\",\"max\":\"96ms\",\"min\":\"9ms\"},\"MaxMemoryUsage\":{\"sum\":4194304,\"count\":2,\"avg\":2097152,\"max\":2097152,\"min\":2097152}}}" } result_set_meta { column { name: "Data" type { type_id: STRING } } } ast { data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 (DataSource \'\"pq\" \'\"high_rate\"))\n(let $4 (StructType \'(\'\"Data\" (DataType \'String))))\n(let $5 (PqTopic \'\"high_rate\" \'\"local\" \'\"high_rate_input\" \'(\'(\'\"PartitionsCount\" \'\"1\")) \'() $4))\n(let $6 (DqPqTopicSource $5 \'(\'\"Data\") \'(\'(\'\"Endpoint\" \'\"localhost:6048\") \'(\'\"AddBearerToToken\" \'\"1\")) (SecureParam \'\"cluster:default_high_rate\")))\n(let $7 (DqStage \'((DqSource $3 $6)) (lambda \'($10) (block \'(\n (let $11 (DqSourceWideWrap $10 $3 $4 \'(\'(\'\"format\" \'\"raw\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))))))\n (return (NarrowMap $11 (lambda \'($12) (AsStruct \'(\'\"Data\" $12)))))\n))) \'(\'(\'\"_logical_id\" \'199397))))\n(let $8 (DqStage \'((DqCnUnionAll (TDqOutput $7 \'\"0\"))) (lambda \'($13) $13) \'(\'(\'\"_logical_id\" \'199424))))\n(let $9 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $8 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $9 $2) (DataSink \'\"pq\" \'\"high_rate\")))\n)\n" } } 2024-06-28 14:04:52,140 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:04:52,141 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:04:52,145 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:04:52,145 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, a91cfe7b-a4bb-4f4b-942b-5193772b1a13, localhost:6048): creating call state 2024-06-28 14:04:52,146 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, a91cfe7b-a4bb-4f4b-942b-5193772b1a13, localhost:6048): request = { database: "local" } 2024-06-28 14:04:52,148 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, a91cfe7b-a4bb-4f4b-942b-5193772b1a13, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:04:52,148 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:04:52,149 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:04:54,852 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:04:54,852 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:04:54,855 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:04:54,856 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 4a089460-6ae6-4c44-a05f-5aeb1b8a8efa, localhost:6048): creating call state 2024-06-28 14:04:54,856 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 4a089460-6ae6-4c44-a05f-5aeb1b8a8efa, localhost:6048): request = { database: "local" } 2024-06-28 14:04:54,858 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 4a089460-6ae6-4c44-a05f-5aeb1b8a8efa, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:04:54,858 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:04:54,859 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:05:15,726 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:05:15,726 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:05:15,729 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:05:15,729 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, f2d2f5ac-9737-4369-9383-cb1aaa9c276e, localhost:6048): creating call state 2024-06-28 14:05:15,729 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, f2d2f5ac-9737-4369-9383-cb1aaa9c276e, localhost:6048): request = { database: "local" } 2024-06-28 14:05:15,731 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, f2d2f5ac-9737-4369-9383-cb1aaa9c276e, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:05:15,731 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:05:15,732 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:05:25,782 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:12623/1 2024-06-28 14:05:26,172 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd 2024-06-28 14:05:26,172 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs" 2024-06-28 14:05:26,173 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd server --suppress-version-check --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_ykb7623h.log --yaml-config=$CFG_DIR_PATH/config.yaml --grpc-port=12623 --mon-port=11315 --ic-port=12260 2024-06-28 14:05:26,174 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_ykb7623h.log', '--yaml-config=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs/config.yaml', '--grpc-port=12623', '--mon-port=11315', '--ic-port=12260')' with input '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/stdin' in '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1' (no wait) 2024-06-28 14:05:26,175 - DEBUG - ya.test - execute: Command pid: 3189502 2024-06-28 14:05:26,175 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:12623/1 2024-06-28 14:05:26,176 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized 2024-06-28 14:05:26,176 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap 2024-06-28 14:05:27,739 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped 2024-06-28 14:05:27,749 - DEBUG - root - describe_query: Result: query { meta { common { id: "ptquf41h4na6e89jl0l6" created_by: "root@builtin" modified_by: "root@builtin" created_at { seconds: 1719583413 nanos: 823011000 } modified_at { seconds: 1719583413 nanos: 823011000 } revision: 1 } started_at { seconds: 1719583415 nanos: 516000000 } execute_mode: RUN status: RUNNING last_job_query_revision: 1 last_job_id: "ptjuf41h4na6c38br661-ptquf41h4na6e89jl0l6" started_by: "root@builtin" has_saved_checkpoints: true submitted_at { seconds: 1719583413 nanos: 823011000 } } content { type: STREAMING name: "a" acl { visibility: PRIVATE } limits { execution_timeout { } } text: "SELECT * FROM high_rate.`high_rate_input`;" syntax: YQL_V1 } plan { json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}" } statistics { json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.11s\",\"count\":2,\"avg\":\"58ms\",\"max\":\"99ms\",\"min\":\"18ms\"},\"MaxMemoryUsage\":{\"sum\":4194304,\"count\":2,\"avg\":2097152,\"max\":2097152,\"min\":2097152}}}" } result_set_meta { column { name: "Data" type { type_id: STRING } } } ast { data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 (DataSource \'\"pq\" \'\"high_rate\"))\n(let $4 (StructType \'(\'\"Data\" (DataType \'String))))\n(let $5 (PqTopic \'\"high_rate\" \'\"local\" \'\"high_rate_input\" \'(\'(\'\"PartitionsCount\" \'\"1\")) \'() $4))\n(let $6 (DqPqTopicSource $5 \'(\'\"Data\") \'(\'(\'\"Endpoint\" \'\"localhost:6048\") \'(\'\"AddBearerToToken\" \'\"1\")) (SecureParam \'\"cluster:default_high_rate\")))\n(let $7 (DqStage \'((DqSource $3 $6)) (lambda \'($10) (block \'(\n (let $11 (DqSourceWideWrap $10 $3 $4 \'(\'(\'\"format\" \'\"raw\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))))))\n (return (NarrowMap $11 (lambda \'($12) (AsStruct \'(\'\"Data\" $12)))))\n))) \'(\'(\'\"_logical_id\" \'199397))))\n(let $8 (DqStage \'((DqCnUnionAll (TDqOutput $7 \'\"0\"))) (lambda \'($13) $13) \'(\'(\'\"_logical_id\" \'199424))))\n(let $9 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $8 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $9 $2) (DataSink \'\"pq\" \'\"high_rate\")))\n)\n" } } 2024-06-28 14:05:45,416 - DEBUG - ydb.connection - _prepare_call: RpcState(KeepAlive, 276dba46-8775-457c-a50e-58e728bd36d5, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): creating call state 2024-06-28 14:05:45,417 - DEBUG - ydb.connection - _log_request: RpcState(KeepAlive, 276dba46-8775-457c-a50e-58e728bd36d5, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): request = { session_id: "ydb://session/3?node_id=1&id=YjZlMWRiOGYtODEwMGMwYzEtNjA3YmNmYWItZmM3ZTk4MTY=" operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } } 2024-06-28 14:05:45,419 - DEBUG - ydb.connection - _on_response_callback: RpcState(KeepAlive, 276dba46-8775-457c-a50e-58e728bd36d5, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): on response callback started 2024-06-28 14:05:45,420 - DEBUG - ydb.connection - _log_response: RpcState(KeepAlive, 276dba46-8775-457c-a50e-58e728bd36d5, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.KeepAliveResult] { session_status: SESSION_STATUS_READY } } } } 2024-06-28 14:05:45,420 - DEBUG - ydb.table.SessionPool - put: Put on session 2024-06-28 14:05:45,421 - DEBUG - ydb.connection - _on_response_callback: RpcState(KeepAlive, 276dba46-8775-457c-a50e-58e728bd36d5, fhm3i67hvrs4qi0qtc7h.auto.internal:6048): on response callback success 2024-06-28 14:05:48,311 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:05:48,330 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:05:48,367 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:05:48,368 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 0b2c3b0a-bf60-4579-a126-1e53122185f4, localhost:6048): creating call state 2024-06-28 14:05:48,368 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 0b2c3b0a-bf60-4579-a126-1e53122185f4, localhost:6048): request = { database: "local" } 2024-06-28 14:05:48,373 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 0b2c3b0a-bf60-4579-a126-1e53122185f4, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:05:48,374 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:05:48,374 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:06:04,755 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:12623/1 2024-06-28 14:06:04,884 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd 2024-06-28 14:06:04,884 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs" 2024-06-28 14:06:04,884 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd server --suppress-version-check --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_xqi_fft8.log --yaml-config=$CFG_DIR_PATH/config.yaml --grpc-port=12623 --mon-port=11315 --ic-port=12260 2024-06-28 14:06:04,885 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_xqi_fft8.log', '--yaml-config=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs/config.yaml', '--grpc-port=12623', '--mon-port=11315', '--ic-port=12260')' with input '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/stdin' in '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1' (no wait) 2024-06-28 14:06:04,899 - DEBUG - ya.test - execute: Command pid: 3225934 2024-06-28 14:06:04,900 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:12623/1 2024-06-28 14:06:04,900 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized 2024-06-28 14:06:04,901 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap 2024-06-28 14:06:06,873 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped 2024-06-28 14:06:06,912 - DEBUG - root - describe_query: Result: query { meta { common { id: "ptquf41h4na6e89jl0l6" created_by: "root@builtin" modified_by: "root@builtin" created_at { seconds: 1719583413 nanos: 823011000 } modified_at { seconds: 1719583413 nanos: 823011000 } revision: 1 } started_at { seconds: 1719583415 nanos: 516000000 } execute_mode: RUN status: RUNNING last_job_query_revision: 1 last_job_id: "ptjuf41h4na6c38br661-ptquf41h4na6e89jl0l6" started_by: "root@builtin" has_saved_checkpoints: true submitted_at { seconds: 1719583413 nanos: 823011000 } } content { type: STREAMING name: "a" acl { visibility: PRIVATE } limits { execution_timeout { } } text: "SELECT * FROM high_rate.`high_rate_input`;" syntax: YQL_V1 } plan { json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}" } statistics { json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"92ms\",\"count\":2,\"avg\":\"46ms\",\"max\":\"83ms\",\"min\":\"9ms\"},\"MaxMemoryUsage\":{\"sum\":4194304,\"count\":2,\"avg\":2097152,\"max\":2097152,\"min\":2097152}}}" } result_set_meta { column { name: "Data" type { type_id: STRING } } } ast { data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 (DataSource \'\"pq\" \'\"high_rate\"))\n(let $4 (StructType \'(\'\"Data\" (DataType \'String))))\n(let $5 (PqTopic \'\"high_rate\" \'\"local\" \'\"high_rate_input\" \'(\'(\'\"PartitionsCount\" \'\"1\")) \'() $4))\n(let $6 (DqPqTopicSource $5 \'(\'\"Data\") \'(\'(\'\"Endpoint\" \'\"localhost:6048\") \'(\'\"AddBearerToToken\" \'\"1\")) (SecureParam \'\"cluster:default_high_rate\")))\n(let $7 (DqStage \'((DqSource $3 $6)) (lambda \'($10) (block \'(\n (let $11 (DqSourceWideWrap $10 $3 $4 \'(\'(\'\"format\" \'\"raw\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))))))\n (return (NarrowMap $11 (lambda \'($12) (AsStruct \'(\'\"Data\" $12)))))\n))) \'(\'(\'\"_logical_id\" \'199397))))\n(let $8 (DqStage \'((DqCnUnionAll (TDqOutput $7 \'\"0\"))) (lambda \'($13) $13) \'(\'(\'\"_logical_id\" \'199424))))\n(let $9 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $8 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $9 $2) (DataSink \'\"pq\" \'\"high_rate\")))\n)\n" } } 2024-06-28 14:06:14,511 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:06:14,512 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:06:14,519 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:06:14,519 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, b2c891ad-26f4-40c7-a5aa-0f677f89a29e, localhost:6048): creating call state 2024-06-28 14:06:14,520 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, b2c891ad-26f4-40c7-a5aa-0f677f89a29e, localhost:6048): request = { database: "local" } 2024-06-28 14:06:14,525 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, b2c891ad-26f4-40c7-a5aa-0f677f89a29e, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:06:14,525 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:06:14,525 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:06:16,525 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:06:16,525 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:06:16,529 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:06:16,529 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 286c09ed-1ef7-4b18-a641-a99fc899567c, localhost:6048): creating call state 2024-06-28 14:06:16,530 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 286c09ed-1ef7-4b18-a641-a99fc899567c, localhost:6048): request = { database: "local" } 2024-06-28 14:06:16,534 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 286c09ed-1ef7-4b18-a641-a99fc899567c, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:06:16,534 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:06:16,534 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:06:32,749 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:06:32,749 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:06:32,756 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:06:32,757 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, b6f2ab6d-9b6e-4691-9ba5-a0ef2e46d558, localhost:6048): creating call state 2024-06-28 14:06:32,757 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, b6f2ab6d-9b6e-4691-9ba5-a0ef2e46d558, localhost:6048): request = { database: "local" } 2024-06-28 14:06:32,759 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, b6f2ab6d-9b6e-4691-9ba5-a0ef2e46d558, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:06:32,760 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:06:32,760 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:06:38,920 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:12623/1 2024-06-28 14:06:38,995 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd 2024-06-28 14:06:38,996 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs" 2024-06-28 14:06:38,996 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd server --suppress-version-check --node=1 --tenant=/default --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_6g4ed5if.log --yaml-config=$CFG_DIR_PATH/config.yaml --grpc-port=12623 --mon-port=11315 --ic-port=12260 2024-06-28 14:06:38,997 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/e64c/0043fa/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--node=1', '--tenant=/default', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1/logfile_6g4ed5if.log', '--yaml-config=/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/kikimr_configs/config.yaml', '--grpc-port=12623', '--mon-port=11315', '--ic-port=12260')' with input '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/stdin' in '/home/runner/.ya/build/build_root/e64c/0043fa/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py__TestRetry__test_high_rate[kikimr0]/default/node_1' (no wait) 2024-06-28 14:06:38,998 - DEBUG - ya.test - execute: Command pid: 3250754 2024-06-28 14:06:38,999 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:12623/1 2024-06-28 14:06:38,999 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized 2024-06-28 14:06:38,999 - DEBUG - root - wait_bootstrap: Wait for node 1 to bootstrap 2024-06-28 14:06:40,662 - DEBUG - root - wait_bootstrap: Node 1 has been bootstrapped 2024-06-28 14:06:40,676 - DEBUG - root - describe_query: Result: query { meta { common { id: "ptquf41h4na6e89jl0l6" created_by: "root@builtin" modified_by: "root@builtin" created_at { seconds: 1719583413 nanos: 823011000 } modified_at { seconds: 1719583413 nanos: 823011000 } revision: 1 } started_at { seconds: 1719583415 nanos: 516000000 } execute_mode: RUN status: RUNNING last_job_query_revision: 1 last_job_id: "ptjuf41h4na6c38br661-ptquf41h4na6e89jl0l6" started_by: "root@builtin" has_saved_checkpoints: true submitted_at { seconds: 1719583413 nanos: 823011000 } } content { type: STREAMING name: "a" acl { visibility: PRIVATE } limits { execution_timeout { } } text: "SELECT * FROM high_rate.`high_rate_input`;" syntax: YQL_V1 } plan { json: "{\"Detailed\":{\"Operations\":[{\"Id\":8,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"}]}},{\"Id\":6,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[]},\"DependsOn\":[8]},{\"Id\":3,\"Name\":\"ResPull!\",\"DependsOn\":[6]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[3]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqStage\":2,\"ResPull!\":1}},\"Basic\":{\"nodes\":[{\"id\":8,\"level\":1,\"name\":\"DqStage #8\",\"type\":\"op\"},{\"id\":6,\"level\":2,\"name\":\"DqStage #6\",\"type\":\"op\"},{\"id\":3,\"level\":3,\"name\":\"ResPull!\",\"type\":\"op\"},{\"id\":1,\"level\":4,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":8,\"target\":6},{\"source\":6,\"target\":3},{\"source\":3,\"target\":1}]}}" } statistics { json: "{\"Graph=0\":{\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.13s\",\"count\":2,\"avg\":\"68ms\",\"max\":\"0.11s\",\"min\":\"20ms\"},\"MaxMemoryUsage\":{\"sum\":4194304,\"count\":2,\"avg\":2097152,\"max\":2097152,\"min\":2097152}}}" } result_set_meta { column { name: "Data" type { type_id: STRING } } } ast { data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSink \'result))\n(let $3 (DataSource \'\"pq\" \'\"high_rate\"))\n(let $4 (StructType \'(\'\"Data\" (DataType \'String))))\n(let $5 (PqTopic \'\"high_rate\" \'\"local\" \'\"high_rate_input\" \'(\'(\'\"PartitionsCount\" \'\"1\")) \'() $4))\n(let $6 (DqPqTopicSource $5 \'(\'\"Data\") \'(\'(\'\"Endpoint\" \'\"localhost:6048\") \'(\'\"AddBearerToToken\" \'\"1\")) (SecureParam \'\"cluster:default_high_rate\")))\n(let $7 (DqStage \'((DqSource $3 $6)) (lambda \'($10) (block \'(\n (let $11 (DqSourceWideWrap $10 $3 $4 \'(\'(\'\"format\" \'\"raw\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))))))\n (return (NarrowMap $11 (lambda \'($12) (AsStruct \'(\'\"Data\" $12)))))\n))) \'(\'(\'\"_logical_id\" \'199397))))\n(let $8 (DqStage \'((DqCnUnionAll (TDqOutput $7 \'\"0\"))) (lambda \'($13) $13) \'(\'(\'\"_logical_id\" \'199424))))\n(let $9 (ResPull! $1 $2 (Key) (DqCnResult (TDqOutput $8 \'\"0\") \'()) \'(\'(\'type) \'(\'autoref)) \'\"dq\"))\n(return (Commit! (Commit! $9 $2) (DataSink \'\"pq\" \'\"high_rate\")))\n)\n" } } 2024-06-28 14:07:07,055 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:07:07,055 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:07:07,060 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:07:07,060 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, da58eb50-cff0-4ecb-a30b-c3842905c80e, localhost:6048): creating call state 2024-06-28 14:07:07,061 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, da58eb50-cff0-4ecb-a30b-c3842905c80e, localhost:6048): request = { database: "local" } 2024-06-28 14:07:07,064 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, da58eb50-cff0-4ecb-a30b-c3842905c80e, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:07:07,065 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:07:07,065 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:07:17,537 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:12623/1 2024-06-28 14:07:19,102 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:12623/1 2024-06-28 14:07:33,559 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:07:33,560 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:07:33,610 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:07:33,610 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, ef642da5-9293-4eac-9461-85c40d2b9017, localhost:6048): creating call state 2024-06-28 14:07:33,610 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, ef642da5-9293-4eac-9461-85c40d2b9017, localhost:6048): request = { database: "local" } 2024-06-28 14:07:33,616 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, ef642da5-9293-4eac-9461-85c40d2b9017, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:07:33,617 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:07:33,617 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048 2024-06-28 14:07:38,103 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints 2024-06-28 14:07:38,104 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin')] 2024-06-28 14:07:38,109 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local 2024-06-28 14:07:38,110 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 4cb150b3-7537-4f59-89dc-7427d04ae53b, localhost:6048): creating call state 2024-06-28 14:07:38,110 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 4cb150b3-7537-4f59-89dc-7427d04ae53b, localhost:6048): request = { database: "local" } 2024-06-28 14:07:38,116 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 4cb150b3-7537-4f59-89dc-7427d04ae53b, localhost:6048): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "fhm3i67hvrs4qi0qtc7h.auto.internal" port: 6048 service: "legacy" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" location: "1" node_id: 1 } self_location: "1" } } } } 2024-06-28 14:07:38,117 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult ]> 2024-06-28 14:07:38,117 - INFO - ydb.connection - close: Closing channel for endpoint localhost:6048