ydb/tests/functional/restarts/test_restarts.py:106: in test_when_create_many_tablets_and_restart_cluster_then_every_thing_is_ok
node.stop()
ydb/tests/library/harness/kikimr_runner.py:279: in stop
super(KiKiMRNode, self).stop()
ydb/tests/library/harness/daemon.py:194: in stop
if not self.__check_can_launch_stop("stop"):
ydb/tests/library/harness/daemon.py:171: in __check_can_launch_stop
raise DaemonError(
E ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop.
E Process exit_code = -6.
E Stdout file name:
E /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/restarts/test-results/py3test/testing_out_stuff/test_restarts.py.TestRestartClusterMirror34.test_when_create_many_tablets_and_restart_cluster_then_every_thing_is_ok/cluster/node_2/stdout
E Stderr file name:
E /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/restarts/test-results/py3test/testing_out_stuff/test_restarts.py.TestRestartClusterMirror34.test_when_create_many_tablets_and_restart_cluster_then_every_thing_is_ok/cluster/node_2/stderr
E Stderr content:
E
E GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E VERIFY failed (2025-11-24T15:19:41.087183Z): RdmaMemPool is not initialized
E ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:653
E AllocateRcBuf(): requirement Common->RdmaMemPool failed
E 0. /-S/util/system/yassert.cpp:86: InternalPanicImpl @ 0xA916F95
E 1. /-S/util/system/yassert.cpp:55: Panic @ 0xA90F4D6
E 2. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:653: AllocateRcBuf @ 0x1A4AD841
E 3. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:694: ProcessXdcCommand @ 0x1A4AB836
E 4. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:551: ProcessPayload @ 0x1A4A76AA
E 5. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:374: ReceiveData @ 0x1A4A3233
E 6. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:308: Handle @ 0x1A4A3CFB
E 7. /-S/ydb/library/actors/interconnect/interconnect_tcp_session.h:257: WorkingStateImpl @ 0x1A4A2BED
E 8. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:266: WorkingState @ 0x1A4A270D
E 9. /tmp//-S/ydb/library/actors/core/actor.cpp:350: Receive @ 0xB749437
E 10. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:267: Execute @ 0xB796F74
E 11. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:455: operator() @ 0xB79B034
E 12. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:507: ProcessExecutorPool @ 0xB79AC40
E 13. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:533: ThreadProc @ 0xB79B82E
E 14. /-S/util/system/thread.cpp:245: ThreadProxy @ 0xA918BEC
E 15. ??:0: ?? @ 0x7FF25B099AC2
E 16. ??:0: ?? @ 0x7FF25B12B8BFteardown failed:
ydb/tests/functional/restarts/test_restarts.py:29: in teardown_class
cls.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:707: in stop
raise daemon.SeveralDaemonErrors(saved_exceptions)
E ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Unexpectedly finished before stop.
E Process exit_code = -6.
E Stdout file name:
E /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/restarts/test-results/py3test/testing_out_stuff/test_restarts.py.TestRestartClusterMirror34.test_when_create_many_tablets_and_restart_cluster_then_every_thing_is_ok/cluster/node_6/stdout
E Stderr file name:
E /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/restarts/test-results/py3test/testing_out_stuff/test_restarts.py.TestRestartClusterMirror34.test_when_create_many_tablets_and_restart_cluster_then_every_thing_is_ok/cluster/node_6/stderr
E Stderr content:
E
E GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E VERIFY failed (2025-11-24T15:19:41.088317Z): RdmaMemPool is not initialized
E ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:653
E AllocateRcBuf(): requirement Common->RdmaMemPool failed
E 0. /-S/util/system/yassert.cpp:86: InternalPanicImpl @ 0xA916F95
E 1. /-S/util/system/yassert.cpp:55: Panic @ 0xA90F4D6
E 2. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:653: AllocateRcBuf @ 0x1A4AD841
E 3. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:694: ProcessXdcCommand @ 0x1A4AB836
E 4. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:551: ProcessPayload @ 0x1A4A76AA
E 5. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:374: ReceiveData @ 0x1A4A3233
E 6. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:308: Handle @ 0x1A4A3CFB
E 7. /-S/ydb/library/actors/interconnect/interconnect_tcp_session.h:257: WorkingStateImpl @ 0x1A4A2BED
E 8. /tmp//-S/ydb/library/actors/interconnect/interconnect_tcp_input_session.cpp:266: WorkingState @ 0x1A4A270D
E 9. /tmp//-S/ydb/library/actors/core/actor.cpp:350: Receive @ 0xB749437
E 10. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:267: Execute @ 0xB796F74
E 11. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:455: operator() @ 0xB79B034
E 12. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:507: ProcessExecutorPool @ 0xB79AC40
E 13. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:533: ThreadProc @ 0xB79B82E
E 14. /-S/util/system/thread.cpp:245: ThreadProxy @ 0xA918BEC
E 15. ??:0: ?? @ 0x7F904E516AC2
E 16. ??:0: ?? @ 0x7F904E5A88BF
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/restarts/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/restarts/test-results/py3test/testing_out_stuff/test_restarts.py.TestRestartClusterMirror34.test_when_create_many_tablets_and_restart_cluster_then_every_thing_is_ok.log
Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
HugeBlobOnlineSizeChange::Compaction (timeout) duration: 601.74s
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/blobstorage/ut_blobstorage/ut_huge/test-results/unittest/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/blobstorage/ut_blobstorage/ut_huge/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/blobstorage/ut_blobstorage/ut_huge/test-results/unittest/testing_out_stuff/stderr
assertion failed at ydb/core/kqp/ut/query/kqp_analyze_ut.cpp:103, virtual void NKikimr::NKqp::NTestSuiteKqpAnalyze::TTestCaseAnalyzeTable<true>::Execute_(NUnitTest::TTestContext &) [ColumnStore = true]: (stat >= 1500) 0
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:14
Get at /-S/util/generic/ptr.h:592:16
UnRef at /-S/util/generic/ptr.h:637:13
NKikimr::NKqp::NTestSuiteKqpAnalyze::TCurrentTest::Execute()::'lambda'()::operator()() const at /-S/ydb/core/kqp/ut/query/kqp_analyze_ut.cpp:0:1
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:637:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:0
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/query/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/query/test-results/unittest/testing_out_stuff/KqpAnalyze.AnalyzeTable.ColumnStore.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/query/test-results/unittest/testing_out_stuff/KqpAnalyze.AnalyzeTable.ColumnStore.out
Test crashed (return code: -6)
See logs for more info
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/scheme/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/scheme/test-results/unittest/testing_out_stuff/KqpOlapScheme.AddPgColumnWithStore.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/scheme/test-results/unittest/testing_out_stuff/KqpOlapScheme.AddPgColumnWithStore.out
Test crashed (return code: -6)
See logs for more info
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/tx/schemeshard/ut_vector_index_build_reboots/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/tx/schemeshard/ut_vector_index_build_reboots/test-results/unittest/testing_out_stuff/VectorIndexBuildTestReboots.BaseCase.Prefixed.TabletReboots.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/tx/schemeshard/ut_vector_index_build_reboots/test-results/unittest/testing_out_stuff/VectorIndexBuildTestReboots.BaseCase.Prefixed.TabletReboots.out
Test crashed (return code: -6)
See logs for more info
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/rdma/ut/test-results/gtest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/rdma/ut/test-results/gtest/testing_out_stuff/TAllocatorSuite.WithAllPools.AllocMemoryWithMemPoolAsync.DummyMemPool.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/rdma/ut/test-results/gtest/testing_out_stuff/TAllocatorSuite.WithAllPools.AllocMemoryWithMemPoolAsync.DummyMemPool.out
Test crashed (return code: -6)
See logs for more info
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/rdma/ut/test-results/gtest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/rdma/ut/test-results/gtest/testing_out_stuff/TAllocatorSuite.WithAllPools.ThreadsDestroy.DummyMemPool.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/rdma/ut/test-results/gtest/testing_out_stuff/TAllocatorSuite.WithAllPools.ThreadsDestroy.DummyMemPool.out
Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
HugeCluster::AllToAll (timeout) duration: 666.02s
HugeCluster::AllToOne test was not launched inside chunk.
Info: Test run has exceeded 8.0G (8388608K) memory limit with 9.0G (9467188K) used. This may lead to test failure on the Autocheck/CI
You can increase test's ram requirement using REQUIREMENTS(ram:X) in the ya.make
pid rss ref pdirt
828466 54.7M 54.7M 7.5M test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
828594 73.6M 56.5M 43.7M └─ test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
828621 58.5M 58.5M 32.6M └─ test_tool run_ut @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/test-results/unittest/testing_out_stuff/test_tool.args
829133 8.6G 8.9G 4.8G └─ ydb-library-actors-interconnect-ut_huge_cluster --trace-path-append /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/t
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/test-results/unittest/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/test-results/unittest/testing_out_stuff/stderr
assertion failed at ydb/services/persqueue_v1/persqueue_ut.cpp:3269, virtual void NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCache::Execute_(NUnitTest::TTestContext &): (info0.BlobsFromCache == 1) failed: (2 != 1)
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:14
Get at /-S/util/generic/ptr.h:592:16
~TStringBuilder at /-S/util/string/builder.h:8:11
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()::'lambda'()::operator()() const at /-S/ydb/services/persqueue_v1/persqueue_ut.cpp:0:1
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:637:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:0
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff/TPersQueueTest.Cache.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff/TPersQueueTest.Cache.out
assertion failed at ydb/services/persqueue_v1/persqueue_ut.cpp:3344, virtual void NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCacheHead::Execute_(NUnitTest::TTestContext &): (info_half1.BlobsFromDisk == 1) failed: (0 != 1)
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:14
Get at /-S/util/generic/ptr.h:592:16
~TStringBuilder at /-S/util/string/builder.h:8:11
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()::'lambda'()::operator()() const at /-S/ydb/services/persqueue_v1/persqueue_ut.cpp:0:1
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:637:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:0
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff/TPersQueueTest.CacheHead.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff/TPersQueueTest.CacheHead.out
assertion failed at ydb/services/ydb/ydb_logstore_ut.cpp:437, virtual void NTestSuiteYdbLogStore::TTestCaseAlterLogTable::Execute_(NUnitTest::TTestContext &): (res.GetStatus() == EStatus::SUCCESS) failed: (PRECONDITION_FAILED != SUCCESS) <main>: Error: Column stores are not supported
, with diff:
(PRE|SUC)C(ONDITION_FAIL|)E(D|SS)
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:14
Get at /-S/util/generic/ptr.h:592:16
~TStringBuilder at /-S/util/string/builder.h:8:11
NTestSuiteYdbLogStore::TCurrentTest::Execute()::'lambda'()::operator()() const at /-S/ydb/services/ydb/ydb_logstore_ut.cpp:0:1
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:637:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:0
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/ydb/ut/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/ydb/ut/test-results/unittest/testing_out_stuff/YdbLogStore.AlterLogTable.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/ydb/ut/test-results/unittest/testing_out_stuff/YdbLogStore.AlterLogTable.out
ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
raise self._exception
contrib/python/ydb/py3/ydb/connection.py:121: in _on_response_callback
response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:237: in _process_response
raise exc_obj(_format_response(response_proto), response_proto.issues)
E ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)
During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E AssertionError: Regex pattern did not match.
E Regex: '.*DISK_SPACE_EXHAUSTED.*'
E Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--false.log
ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
raise self._exception
contrib/python/ydb/py3/ydb/connection.py:121: in _on_response_callback
response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:237: in _process_response
raise exc_obj(_format_response(response_proto), response_proto.issues)
E ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--true_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)
During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E AssertionError: Regex pattern did not match.
E Regex: '.*DISK_SPACE_EXHAUSTED.*'
E Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--true_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--true.log
ydb/tests/functional/tenants/test_tenants.py:433: in test_list_database_above
assert result.children[0].name == ".sys"
E AssertionError: assert '.metadata' == '.sys'
E
E - .sys
E + .metadata
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_tenants.py.TestTenants.test_list_database_above.enable_alter_database_create_hive_first--false.log
ydb/tests/functional/tenants/test_tenants.py:442: in test_list_database_above
assert result.children[0].name == ".sys"
E AssertionError: assert '.metadata' == '.sys'
E
E - .sys
E + .metadata
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_tenants.py.TestTenants.test_list_database_above.enable_alter_database_create_hive_first--true.log
Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_duplicates.py::TestTpchDuplicatesZeroLevel::test_tpch[21] (timeout) duration: 602.97s
test_duplicates.py::TestTpchDuplicatesZeroLevel::test_tpch[22] test was not launched inside chunk.
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff/stderr
ydb/tests/olap/scenario/conftest.py:126: in test
raise errors[0]
ydb/tests/olap/scenario/conftest.py:85: in worker
self._test_suffix(local_ctx, suffix, codes, idx)
ydb/tests/olap/scenario/conftest.py:136: in _test_suffix
ctx.executable(self, ctx)
ydb/tests/olap/scenario/test_alter_tiering.py:361: in scenario_many_tables
threads.start_and_wait_all()
ydb/tests/olap/common/thread_helper.py:49: in start_and_wait_all
self.join_all()
ydb/tests/olap/common/thread_helper.py:45: in join_all
thread.join(timeout=timeout)
ydb/tests/olap/common/thread_helper.py:18: in join
raise self.exc
ydb/tests/olap/common/thread_helper.py:11: in run
self.ret = self._target(*self._args, **self._kwargs)
ydb/tests/olap/scenario/test_alter_tiering.py:218: in _loop_bulk_upsert
sth.bulk_upsert(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:647: in bulk_upsert
self._bulk_upsert_impl(tablename, data_generator, expected_status)
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:390: in _bulk_upsert_impl
self._run_with_expected_status(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:366: in _run_with_expected_status
pytest.fail(f'Unexpected status: must be in {repr(expected_status)}, but get {repr(error or status)}')
E Failed: Unexpected status: must be in {<StatusCode.SUCCESS: 400000>}, but get BadRequest('message: "Bulk upsert to table \\\'/Root/olap_yatests/TestAlterTiering/many_tables/store/table0\\\' " severity: 1 (server_code: 400010)')
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_alter_tiering.py.TestAlterTiering.test.many_tables.log
ydb/tests/olap/test_log_scenario.py:235: in test_log_uniform
thread.join()
ydb/tests/olap/common/thread_helper.py:18: in join
raise self.exc
ydb/tests/olap/common/thread_helper.py:11: in run
self.ret = self._target(*self._args, **self._kwargs)
ydb/tests/olap/test_log_scenario.py:147: in aggregation_query
self.ydb_client.query(f"SELECT COUNT(*) FROM `{self.table_name}` ")
ydb/tests/olap/common/ydb_client.py:24: in query
return self.session_pool.execute_with_retries(query=statement, settings=request_settings)
contrib/python/ydb/py3/ydb/query/pool.py:252: in execute_with_retries
return retry_operation_sync(wrapped_callee, retry_settings)
contrib/python/ydb/py3/ydb/retries.py:135: in retry_operation_sync
for next_opt in opt_generator:
contrib/python/ydb/py3/ydb/retries.py:130: in retry_operation_impl
raise status
contrib/python/ydb/py3/ydb/retries.py:96: in retry_operation_impl
result = YdbRetryOperationFinalResult(callee(*args, **kwargs))
contrib/python/ydb/py3/ydb/query/pool.py:248: in wrapped_callee
with self.checkout(timeout=retry_settings.max_session_acquire_timeout) as session:
contrib/python/ydb/py3/ydb/query/pool.py:331: in __enter__
self._session = self._pool.acquire(self._timeout)
contrib/python/ydb/py3/ydb/query/pool.py:111: in acquire
session = self._create_new_session(time_left)
contrib/python/ydb/py3/ydb/query/pool.py:63: in _create_new_session
session.create(settings=BaseRequestSettings().with_timeout(timeout))
contrib/python/ydb/py3/ydb/query/session.py:301: in create
self._create_call(settings=settings)
contrib/python/ydb/py3/ydb/query/session.py:171: in _create_call
return self._driver(
contrib/python/ydb/py3/ydb/tracing.py:70: in wrapper
return f(self, *args, **kwargs)
contrib/python/ydb/py3/ydb/pool.py:459: in __call__
connection = self._store.get(preferred_endpoint)
contrib/python/ydb/py3/ydb/tracing.py:70: in wrapper
return f(self, *args, **kwargs)
contrib/python/ydb/py3/ydb/pool.py:144: in get
raise issues.ConnectionLost("Couldn't find valid connection")
E ydb.issues.ConnectionLost: Couldn't find valid connectionteardown failed:
ydb/tests/olap/test_log_scenario.py:123: in teardown_class
cls.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:707: in stop
raise daemon.SeveralDaemonErrors(saved_exceptions)
E ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Unexpectedly finished before stop.
E Process exit_code = -6.
E Stdout file name:
E /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff/test_log_scenario.py.TestLogScenario.test_log_uniform/cluster/node_1/stdout
E Stderr file name:
E /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff/test_log_scenario.py.TestLogScenario.test_log_uniform/cluster/node_1/stderr
E Stderr content:
E
E GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E VERIFY failed (2025-11-24T15:20:11.094125Z): source_id=268;tablet_id=72075186224037926;verification=lhs.type_id() == rhs.type_id();fline=compare.h:82;
E ydb/library/actors/core/log.cpp:857
E ~TVerifyFormattedRecordWriter(): requirement false failed
E 0. /-S/util/system/yassert.cpp:86: InternalPanicImpl @ 0xA916F95
E 1. /-S/util/system/yassert.cpp:55: Panic @ 0xA90F4D6
E 2. /tmp//-S/ydb/library/actors/core/log.cpp:857: ~TVerifyFormattedRecordWriter @ 0xB7A64C8
E 3. /-S/ydb/library/formats/arrow/switch/compare.h:82: TypedCompare<false> @ 0xD71AADB
E 4. /-S/ydb/core/formats/arrow/reader/position.h:85: CompareImpl @ 0x9F6F748
E 5. /-S/ydb/core/formats/arrow/reader/position.h:482: Compare @ 0x9F6F49F
E 6. /tmp//-S/ydb/core/formats/arrow/reader/position.cpp:36: FindBound @ 0xD6F512D
E 7. /tmp//-S/ydb/core/tx/columnshard/engines/predicate/filter.cpp:22: BuildFilter @ 0x14373E1B
E 8. /tmp//-S/ydb/core/tx/columnshard/engines/reader/simple_reader/iterator/fetching.cpp:16: DoExecuteInplace @ 0x14FBAE17
E 9. /-S/ydb/core/tx/columnshard/engines/reader/common_reader/common/script.h:47: ExecuteInplace @ 0x14F0FBD3
E 10. /tmp//-S/ydb/core/tx/columnshard/engines/reader/common_reader/common/script_cursor.cpp:36: Execute @ 0x14F0FBD3
E 11. /tmp//-S/ydb/core/tx/columnshard/engines/reader/common_reader/iterator/fetching.cpp:30: DoExecuteImpl @ 0x14F0D583
E 12. /tmp//-S/ydb/core/tx/columnshard/engines/reader/common/conveyor_task.cpp:8: DoExecute @ 0x14F10F47
E 13. /tmp//-S/ydb/core/tx/conveyor/usage/abstract.cpp:16: Execute @ 0x14391C08
E 14. /tmp//-S/ydb/core/tx/conveyor_composite/service/worker.cpp:17: ExecuteTask @ 0x1CF3D565
E 15. /tmp//-S/ydb/library/actors/core/actor.cpp:350: Receive @ 0xB749437
E 16. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:267: Execute @ 0xB796F74
E 17. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:455: operator() @ 0xB79B034
E 18. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:507: ProcessExecutorPool @ 0xB79AC40
E 19. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:533: ThreadProc @ 0xB79B82E
E 20. /-S/util/system/thread.cpp:245: ThreadProxy @ 0xA918BEC
E 21. ??:0: ?? @ 0x7F257D2BCAC2
E 22. ??:0: ?? @ 0x7F257D34E8BF
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff/test_log_scenario.py.TestLogScenario.test_log_uniform.log