forced failure at ydb/core/kqp/ut/federated_query/datastreams/datastreams_ut.cpp:754, static void NKikimr::NKqp::(anonymous namespace)::TStreamingTestFixture::WaitFor(TDuration, const TString &, std::function<bool (TString &)>): Waiting checkpoint update timeout. Spent time 10.414927s exceeds limit 10.000000s, last error: seq_no is not changed from: 12
0. /-S/util/system/backtrace.cpp:284: ?? @ 0x1D17738B
1. /tmp//-S/library/cpp/testing/unittest/registar.cpp:46: RaiseError @ 0x1D66885B
2. /tmp//-S/ydb/core/kqp/ut/federated_query/datastreams/datastreams_ut.cpp:754: WaitFor @ 0x1CCF62ED
3. /tmp//-S/ydb/core/kqp/ut/federated_query/datastreams/datastreams_ut.cpp:575: WaitCheckpointUpdate @ 0x1CD1B7C5
4. /tmp//-S/ydb/core/kqp/ut/federated_query/datastreams/datastreams_ut.cpp:1253: Execute_ @ 0x1CD195EA
5. /tmp//-S/ydb/core/kqp/ut/federated_query/datastreams/datastreams_ut.cpp:802: operator() @ 0x1CD67187
6. /-S/contrib/libs/cxxsupp/libcxx/include/__type_traits/invoke.h:149: __invoke<(lambda at /-S/ydb/core/kqp/ut/federated_query/datastreams/datastreams_ut.cpp:802:1) &> @ 0x1CD67187
7. /-S/contrib/libs/cxxsupp/libcxx/include/__type_traits/invoke.h:224: __call<(lambda at /-S/ydb/core/kqp/ut/federated_query/datastreams/datastreams_ut.cpp:802:1) &> @ 0x1CD67187
8. /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:169: operator() @ 0x1CD67187
9. /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:314: operator() @ 0x1CD67187
10. /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:431: operator() @ 0x1D697C99
11. /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:990: operator() @ 0x1D697C99
12. /tmp//-S/library/cpp/testing/unittest/utmain.cpp:526: Run @ 0x1D697C99
13. /tmp//-S/library/cpp/testing/unittest/registar.cpp:373: Run @ 0x1D66F537
14. /tmp//-S/ydb/core/kqp/ut/federated_query/datastreams/datastreams_ut.cpp:802: Execute @ 0x1CD66273
15. /tmp//-S/library/cpp/testing/unittest/registar.cpp:494: Execute @ 0x1D670CEF
16. /tmp//-S/library/cpp/testing/unittest/utmain.cpp:875: RunMain @ 0x1D691AFC
17. ??:0: ?? @ 0x7F96F0F9ED8F
18. ??:0: ?? @ 0x7F96F0F9EE3F
19. ??:0: ?? @ 0x1A475028


logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/federated_query/datastreams/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/federated_query/datastreams/test-results/unittest/testing_out_stuff/KqpFederatedQueryDatastreams.RestoreScriptPhysicalGraphOnRetryWithCheckpoints.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/federated_query/datastreams/test-results/unittest/testing_out_stuff/KqpFederatedQueryDatastreams.RestoreScriptPhysicalGraphOnRetryWithCheckpoints.out

assertion failed at ydb/core/transfer/ut/common/utils.h:666, void NReplicationTest::MainTestCase::CheckCommittedOffset(size_t, size_t, TDuration): (expectedOffset == s->GetCommittedOffset()) failed: (2 != 1) 
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:9
GetCurrentTest at /-S/library/cpp/testing/unittest/registar.cpp:70:12
NReplicationTest::MainTestCase::CheckCommittedOffset(unsigned long, unsigned long, TDuration) at /-S/ydb/core/transfer/ut/common/utils.h:666:17
NTestSuiteTransfer_ColumnTable::BigBatchSize(bool) at /-S/ydb/core/transfer/ut/column_table/transfer_columntable_ut.cpp:0:18
operator() at /-S/ydb/core/transfer/ut/column_table/transfer_columntable_ut.cpp:0:1
TColoredProcessor::Run(std::__y1::function<void ()>, TBasicString<char, std::__y1::char_traits<char>> const&, char const*, bool) at /-S/library/cpp/testing/unittest/utmain.cpp:526:13
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:640:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:44
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0


logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/column_table/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/column_table/test-results/unittest/testing_out_stuff/Transfer_ColumnTable.BigBatchSize_Remote.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/column_table/test-results/unittest/testing_out_stuff/Transfer_ColumnTable.BigBatchSize_Remote.out

assertion failed at ydb/core/transfer/ut/common/utils.h:80, virtual void NReplicationTest::Timestamp64Checker::Assert(const std::string &, const ::Ydb::Value &): (v == Expected) failed: (2025-10-08T20:46:01.119000Z != 2025-10-08T20:45:50.916097Z) Row 0 column 'WriteTimestamp': , with diff:
2025-10-08T20:4(6|5):(|5)0(1|).(|9)1(1|60)9(000|7)Z
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:9
GetCurrentTest at /-S/library/cpp/testing/unittest/registar.cpp:70:12
NReplicationTest::Timestamp64Checker::Assert(std::__y1::basic_string<char, std::__y1::char_traits<char>, std::__y1::allocator<char>> const&, Ydb::Value const&) at /-S/ydb/core/transfer/ut/common/utils.h:80:13
UnRef at /-S/util/generic/ptr.h:640:13
NReplicationTest::MainTestCase::Run(NReplicationTest::TConfig const&, NReplicationTest::MainTestCase::CreateTransferSettings) at /-S/ydb/core/transfer/ut/common/utils.h:0:9
MessageField_WriteTimestamp(std::__y1::basic_string<char, std::__y1::char_traits<char>, std::__y1::allocator<char>> const&, bool) at /-S/ydb/core/transfer/ut/common/transfer_common.cpp:671:5
operator() at /-S/ydb/core/transfer/ut/column_table/transfer_columntable_ut.cpp:0:1
TColoredProcessor::Run(std::__y1::function<void ()>, TBasicString<char, std::__y1::char_traits<char>> const&, char const*, bool) at /-S/library/cpp/testing/unittest/utmain.cpp:526:13
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:640:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:44
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0


logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/column_table/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/column_table/test-results/unittest/testing_out_stuff/Transfer_ColumnTable.MessageField_WriteTimestamp.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/column_table/test-results/unittest/testing_out_stuff/Transfer_ColumnTable.MessageField_WriteTimestamp.out

assertion failed at ydb/core/transfer/ut/common/utils.h:836, void NReplicationTest::MainTestCase::CheckResult(const std::string &, const TExpectations &): (false) Unable to wait transfer result
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:9
GetCurrentTest at /-S/library/cpp/testing/unittest/registar.cpp:70:12
NReplicationTest::MainTestCase::CheckResult(std::__y1::basic_string<char, std::__y1::char_traits<char>, std::__y1::allocator<char>> const&, TVector<TVector<std::__y1::pair<TBasicString<char, std::__y1::char_traits<char>>, std::__y1::shared_ptr<NReplicationTest::IChecker>>, std::__y1::allocator<std::__y1::pair<TBasicString<char, std::__y1::char_traits<char>>, std::__y1::shared_ptr<NReplicationTest::IChecker>>>>, std::__y1::allocator<TVector<std::__y1::pair<TBasicString<char, std::__y1::char_traits<char>>, std::__y1::shared_ptr<NReplicationTest::IChecker>>, std::__y1::allocator<std::__y1::pair<TBasicString<char, std::__y1::char_traits<char>>, std::__y1::shared_ptr<NReplicationTest::IChecker>>>>>> const&) at /-S/ydb/core/transfer/ut/common/utils.h:0:9
operator() at /-S/contrib/libs/cxxsupp/libcxx/include/vector:546:18
operator() at /-S/ydb/core/transfer/ut/functional/transfer_ut.cpp:0:1
TColoredProcessor::Run(std::__y1::function<void ()>, TBasicString<char, std::__y1::char_traits<char>> const&, char const*, bool) at /-S/library/cpp/testing/unittest/utmain.cpp:526:13
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:640:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:44
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0


logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/functional/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/functional/test-results/unittest/testing_out_stuff/Transfer.LocalTopic_BigMessage.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/transfer/ut/functional/test-results/unittest/testing_out_stuff/Transfer.LocalTopic_BigMessage.out

teardown failed:
ydb/tests/datashard/lib/multicluster_test_base.py:63: in teardown_class
    cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_all_types-pk_types7-all_types7-index7---/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_all_types-pk_types7-all_types7-index7---/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.032479 seconds, 2 sessions to shutdown
E   Current KQP shutdown state: spent 6.08975 seconds, 2 sessions to shutdown
E   Current KQP shutdown state: spent 9.145689 seconds, 2 sessions to shutdown
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.055883 seconds, 1 sessions to shutdown
E   Current KQP shutdown state: spent 6.088326 seconds, 1 sessions to shutdown
E   Current KQP shutdown state: spent 9.11707 seconds, 1 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 4.937046 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 8.265472 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 11.673273 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 14.999351 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 18.259489 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 21.5894 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 24.893737 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 28.277136 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.002149 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==138912==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_all_types-pk_types7-all_types7-index7---.log

teardown failed:
ydb/tests/datashard/lib/multicluster_test_base.py:63: in teardown_class
    cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_0__SYNC-pk_types4-all_types4-index4---SYNC/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_0__SYNC-pk_types4-all_types4-index4---SYNC/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 1e-06 seconds, not started yet
E   Current KQP shutdown state: spent 3.039894 seconds, 3 sessions to shutdown
E   Current KQP shutdown state: spent 6.058365 seconds, 3 sessions to shutdown
E   Current KQP shutdown state: spent 9.123789 seconds, 3 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 3.342326 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 6.696424 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 10.224457 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 13.636569 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 17.063652 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 20.464494 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 23.702493 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 26.979248 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.002095 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==156308==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in 214...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_0__SYNC-pk_types4-all_types4-index4---SYNC.log

teardown failed:
ydb/tests/datashard/lib/multicluster_test_base.py:63: in teardown_class
    cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_1__SYNC-pk_types3-all_types3-index3---SYNC/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_1__SYNC-pk_types3-all_types3-index3---SYNC/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.062682 seconds, 3 sessions to shutdown
E   Current KQP shutdown state: spent 6.106508 seconds, 3 sessions to shutdown
E   Current KQP shutdown state: spent 9.150291 seconds, 3 sessions to shutdown
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.04516 seconds, 1 sessions to shutdown
E   Current KQP shutdown state: spent 6.085166 seconds, 1 sessions to shutdown
E   Current KQP shutdown state: spent 9.111892 seconds, 1 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 5.096577 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 8.567358 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 12.018582 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 15.504719 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 18.832757 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 22.283433 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 25.600196 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 28.964012 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.008645 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==139983==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_1__SYNC-pk_types3-all_types3-index3---SYNC.log

teardown failed:
ydb/tests/datashard/lib/multicluster_test_base.py:63: in teardown_class
    cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_2__SYNC-pk_types2-all_types2-index2---SYNC/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_2__SYNC-pk_types2-all_types2-index2---SYNC/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 1e-06 seconds, not started yet
E   Current KQP shutdown state: spent 3.039834 seconds, 3 sessions to shutdown
E   Current KQP shutdown state: spent 6.068098 seconds, 3 sessions to shutdown
E   Current KQP shutdown state: spent 9.119751 seconds, 3 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 3.257581 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 6.479794 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 9.755605 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 13.051231 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 16.348678 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 19.677213 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 22.860525 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 26.112451 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 29.530665 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.009805 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==141092==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_index_2__SYNC-pk_types2-all_types2-index2---SYNC.log

teardown failed:
ydb/tests/datashard/lib/multicluster_test_base.py:63: in teardown_class
    cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_ttl_Datetime-pk_types11-all_types11-index11-Datetime--/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_ttl_Datetime-pk_types11-all_types11-index11-Datetime--/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.023113 seconds, 2 sessions to shutdown
E   Current KQP shutdown state: spent 6.064347 seconds, 2 sessions to shutdown
E   Current KQP shutdown state: spent 9.11917 seconds, 2 sessions to shutdown
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.027331 seconds, 1 sessions to shutdown
E   Current KQP shutdown state: spent 6.059057 seconds, 1 sessions to shutdown
E   Current KQP shutdown state: spent 9.099014 seconds, 1 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 3.329529 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 6.690369 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 9.982369 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 13.378426 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 16.655569 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 20.113312 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 23.558359 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 27.111586 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.006348 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==145967==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/co...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_ttl_Datetime-pk_types11-all_types11-index11-Datetime--.log

teardown failed:
ydb/tests/datashard/lib/multicluster_test_base.py:63: in teardown_class
    cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_ttl_DyNumber-pk_types8-all_types8-index8-DyNumber--/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_ttl_DyNumber-pk_types8-all_types8-index8-DyNumber--/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.025978 seconds, 2 sessions to shutdown
E   Current KQP shutdown state: spent 6.057221 seconds, 2 sessions to shutdown
E   Current KQP shutdown state: spent 9.088807 seconds, 2 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 3.420642 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 6.798508 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 10.130488 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 13.358769 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 16.626486 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 20.004208 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 23.310981 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 26.642484 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.006982 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==151854==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/async_replication/test-results/py3test/testing_out_stuff/test_async_replication.py.TestAsyncReplication.test_async_replication.table_ttl_DyNumber-pk_types8-all_types8-index8-DyNumber--.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_copy_table.py::TestCopyTable::test_copy_table[table_all_types-pk_types12-all_types12-index12---] (good) duration: 343.48s
test_copy_table.py::TestCopyTable::test_copy_table[table_index_0_UNIQUE_SYNC-pk_types4-all_types4-index4--UNIQUE-SYNC] (good) duration: 251.90s
Killed by timeout (600 s)

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/copy_table/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/copy_table/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/copy_table/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_secondary_index.py::TestSecondaryIndex::test_secondary_index_cover[table_index_1__ASYNC-pk_types10-all_types10-index10---ASYNC] (fail) duration: 595.87s
Killed by timeout (600 s)

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_secondary_index.py::TestSecondaryIndex::test_secondary_index_cover[table_index_2_UNIQUE_SYNC-pk_types2-all_types2-index2--UNIQUE-SYNC] (good) duration: 592.95s
Killed by timeout (600 s)

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_secondary_index.py::TestSecondaryIndex::test_secondary_index_cover[table_index_4_UNIQUE_SYNC-pk_types0-all_types0-index0--UNIQUE-SYNC] (fail) duration: 595.56s
Killed by timeout (600 s)

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff/stderr

ydb/tests/sql/lib/test_query.py:52: in query
    for result_set in result_sets:
contrib/python/ydb/py3/ydb/_utilities.py:173: in __next__
    return self._next()
contrib/python/ydb/py3/ydb/_utilities.py:164: in _next
    res = self.wrapper(next(self.it))
contrib/python/ydb/py3/ydb/connection.py:359: in __next__
    return self.it.__next__()
contrib/python/grpcio/py3/grpc/_channel.py:543: in __next__
    return self._next()
contrib/python/grpcio/py3/grpc/_channel.py:960: in _next
    _common.wait(self._state.condition.wait, _response_ready)
contrib/python/grpcio/py3/grpc/_common.py:156: in wait
    _wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb)
contrib/python/grpcio/py3/grpc/_common.py:116: in _wait_once
    wait_fn(timeout=timeout)
contrib/tools/python3/Lib/threading.py:359: in wait
    gotit = waiter.acquire(True, timeout)
library/python/pytest/plugins/ya.py:349: in _graceful_shutdown
    _graceful_shutdown_on_log(not capman.is_globally_capturing())
library/python/pytest/plugins/ya.py:321: in _graceful_shutdown_on_log
    pytest.exit("Graceful shutdown requested")
E   _pytest.outcomes.Exit: Graceful shutdown requested

During handling of the above exception, another exception occurred:
ydb/tests/datashard/secondary_index/test_secondary_index.py:162: in test_secondary_index_cover
    self.select_all_types(table_name, index, all_types, dml)
ydb/tests/datashard/secondary_index/test_secondary_index.py:188: in select_all_types
    dml.transactional(process)
ydb/tests/datashard/lib/dml_operations.py:17: in transactional
    return self.query_object.transactional(process)
ydb/tests/sql/lib/test_query.py:58: in transactional
    return self.pool.retry_operation_sync(lambda session: fn(session))
contrib/python/ydb/py3/ydb/query/pool.py:151: in retry_operation_sync
    return retry_operation_sync(wrapped_callee, retry_settings)
contrib/python/ydb/py3/ydb/retries.py:135: in retry_operation_sync
    for next_opt in opt_generator:
contrib/python/ydb/py3/ydb/retries.py:96: in retry_operation_impl
    result = YdbRetryOperationFinalResult(callee(*args, **kwargs))
contrib/python/ydb/py3/ydb/query/pool.py:149: in wrapped_callee
    return callee(session, *args, **kwargs)
ydb/tests/sql/lib/test_query.py:58: in <lambda>
    return self.pool.retry_operation_sync(lambda session: fn(session))
ydb/tests/datashard/secondary_index/test_secondary_index.py:182: in process
    rows = self.query(select_sql, tx=session.transaction(tx_mode=ydb.QueryStaleReadOnly()))
ydb/tests/sql/lib/test_query.py:51: in query
    with tx.execute(text) as result_sets:
contrib/python/ydb/py3/ydb/query/base.py:64: in __exit__
    for _ in self:
contrib/python/ydb/py3/ydb/_utilities.py:173: in __next__
    return self._next()
contrib/python/ydb/py3/ydb/_utilities.py:164: in _next
    res = self.wrapper(next(self.it))
contrib/python/ydb/py3/ydb/connection.py:359: in __next__
    return self.it.__next__()
contrib/python/grpcio/py3/grpc/_channel.py:543: in __next__
    return self._next()
contrib/python/grpcio/py3/grpc/_channel.py:943: in _next
    operating = self._call.operate(
contrib/python/grpcio/py3/grpc/_cython/_cygrpc/channel.pyx.pxi:329: in grpc._cython.cygrpc.IntegratedCall.operate
    ???
contrib/python/grpcio/py3/grpc/_cython/_cygrpc/channel.pyx.pxi:140: in grpc._cython.cygrpc._operate_from_integrated_call
    ???
contrib/python/grpcio/py3/grpc/_cython/_cygrpc/channel.pyx.pxi:148: in grpc._cython.cygrpc._operate_from_integrated_call
    ???
contrib/python/grpcio/py3/grpc/_cython/_cygrpc/channel.pyx.pxi:58: in grpc._cython.cygrpc._raise_call_error_no_metadata
    ???
E   ValueError: Internal gRPC call error 8. Please report to https://github.com/grpc/grpc/issues

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff/test_secondary_index.py.TestSecondaryIndex.test_secondary_index_cover.table_index_1__ASYNC-pk_types10-all_types10-index10---ASYNC.log

ydb/tests/sql/lib/test_query.py:52: in query
    for result_set in result_sets:
contrib/python/ydb/py3/ydb/_utilities.py:173: in __next__
    return self._next()
contrib/python/ydb/py3/ydb/_utilities.py:164: in _next
    res = self.wrapper(next(self.it))
contrib/python/ydb/py3/ydb/connection.py:359: in __next__
    return self.it.__next__()
contrib/python/grpcio/py3/grpc/_channel.py:543: in __next__
    return self._next()
contrib/python/grpcio/py3/grpc/_channel.py:960: in _next
    _common.wait(self._state.condition.wait, _response_ready)
contrib/python/grpcio/py3/grpc/_common.py:156: in wait
    _wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb)
contrib/python/grpcio/py3/grpc/_common.py:116: in _wait_once
    wait_fn(timeout=timeout)
contrib/tools/python3/Lib/threading.py:359: in wait
    gotit = waiter.acquire(True, timeout)
library/python/pytest/plugins/ya.py:349: in _graceful_shutdown
    _graceful_shutdown_on_log(not capman.is_globally_capturing())
library/python/pytest/plugins/ya.py:321: in _graceful_shutdown_on_log
    pytest.exit("Graceful shutdown requested")
E   _pytest.outcomes.Exit: Graceful shutdown requested

During handling of the above exception, another exception occurred:
ydb/tests/datashard/secondary_index/test_secondary_index.py:162: in test_secondary_index_cover
    self.select_all_types(table_name, index, all_types, dml)
ydb/tests/datashard/secondary_index/test_secondary_index.py:188: in select_all_types
    dml.transactional(process)
ydb/tests/datashard/lib/dml_operations.py:17: in transactional
    return self.query_object.transactional(process)
ydb/tests/sql/lib/test_query.py:58: in transactional
    return self.pool.retry_operation_sync(lambda session: fn(session))
contrib/python/ydb/py3/ydb/query/pool.py:151: in retry_operation_sync
    return retry_operation_sync(wrapped_callee, retry_settings)
contrib/python/ydb/py3/ydb/retries.py:135: in retry_operation_sync
    for next_opt in opt_generator:
contrib/python/ydb/py3/ydb/retries.py:96: in retry_operation_impl
    result = YdbRetryOperationFinalResult(callee(*args, **kwargs))
contrib/python/ydb/py3/ydb/query/pool.py:149: in wrapped_callee
    return callee(session, *args, **kwargs)
ydb/tests/sql/lib/test_query.py:58: in <lambda>
    return self.pool.retry_operation_sync(lambda session: fn(session))
ydb/tests/datashard/secondary_index/test_secondary_index.py:182: in process
    rows = self.query(select_sql, tx=session.transaction(tx_mode=ydb.QueryStaleReadOnly()))
ydb/tests/sql/lib/test_query.py:51: in query
    with tx.execute(text) as result_sets:
contrib/python/ydb/py3/ydb/query/base.py:64: in __exit__
    for _ in self:
contrib/python/ydb/py3/ydb/_utilities.py:173: in __next__
    return self._next()
contrib/python/ydb/py3/ydb/_utilities.py:164: in _next
    res = self.wrapper(next(self.it))
contrib/python/ydb/py3/ydb/connection.py:359: in __next__
    return self.it.__next__()
contrib/python/grpcio/py3/grpc/_channel.py:543: in __next__
    return self._next()
contrib/python/grpcio/py3/grpc/_channel.py:943: in _next
    operating = self._call.operate(
contrib/python/grpcio/py3/grpc/_cython/_cygrpc/channel.pyx.pxi:329: in grpc._cython.cygrpc.IntegratedCall.operate
    ???
contrib/python/grpcio/py3/grpc/_cython/_cygrpc/channel.pyx.pxi:140: in grpc._cython.cygrpc._operate_from_integrated_call
    ???
contrib/python/grpcio/py3/grpc/_cython/_cygrpc/channel.pyx.pxi:148: in grpc._cython.cygrpc._operate_from_integrated_call
    ???
contrib/python/grpcio/py3/grpc/_cython/_cygrpc/channel.pyx.pxi:58: in grpc._cython.cygrpc._raise_call_error_no_metadata
    ???
E   ValueError: Internal gRPC call error 8. Please report to https://github.com/grpc/grpc/issues

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/secondary_index/test-results/py3test/testing_out_stuff/test_secondary_index.py.TestSecondaryIndex.test_secondary_index_cover.table_index_4_UNIQUE_SYNC-pk_types0-all_types0-index0--UNIQUE-SYNC.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_split_merge.py::TestSplitMerge::test_merge_split[table_all_types-pk_types12-all_types12-index12---] (timeout) duration: 605.54s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_split_merge.py::TestSplitMerge::test_merge_split[table_index_2_UNIQUE_SYNC-pk_types2-all_types2-index2--UNIQUE-SYNC] (timeout) duration: 614.59s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/testing_out_stuff/test_split_merge.py.TestSplitMerge.test_merge_split.table_all_types-pk_types12-all_types12-index12---.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/datashard/split_merge/test-results/py3test/testing_out_stuff/test_split_merge.py.TestSplitMerge.test_merge_split.table_index_2_UNIQUE_SYNC-pk_types2-all_types2-index2--UNIQUE-SYNC.log

teardown failed:
ydb/tests/fq/common/conftest.py:29: in kikimr
    with start_kikimr(request, kikimr_extensions) as kikimr:
contrib/tools/python3/Lib/contextlib.py:144: in __exit__
    next(self.gen)
ydb/tests/tools/fq_runner/kikimr_utils.py:426: in start_kikimr
    kikimr.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:748: in stop
    tenant.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/common/test-results/py3test/testing_out_stuff/test_unknown_data_source.py.TestUnknownDataSource.test_should_fail_unknown_data_source.v1-client0/default/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/common/test-results/py3test/testing_out_stuff/test_unknown_data_source.py.TestUnknownDataSource.test_should_fail_unknown_data_source.v1-client0/default/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 1, spent: 6.393741 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 9.969924 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 13.498569 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 16.976535 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 20.432178 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 23.970268 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 27.391567 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.006732 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==54544==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 11616 byte(s) in 66 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 10560 byte(s) in 1 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandshakeDone(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc:479:52
E   #11 0x000033e0093e in exec_ctx_run /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:45:3
E   #12 0x000033e0093e in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:72:9
E   #13 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #14 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #15 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #16 0x000033...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/common/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/common/test-results/py3test/testing_out_stuff/test_unknown_data_source.py.TestUnknownDataSource.test_should_fail_unknown_data_source.v1-client0.log

teardown failed:
ydb/tests/fq/http_api/test_base.py:24: in teardown_class
    cls.streaming_over_kikimr.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:748: in stop
    tenant.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/http_api/test-results/py3test/testing_out_stuff/test_http_api.py.TestHttpApi.test_simple_analytics_query/cp/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/http_api/test-results/py3test/testing_out_stuff/test_http_api.py.TestHttpApi.test_simple_analytics_query/cp/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 2, spent: 3.255155 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 6.628108 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 10.047991 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 13.176985 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 16.298478 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 19.516109 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 22.813523 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 26.07921 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 29.315697 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 2, spent: 30.001252 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==412100==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 11616 byte(s) in 66 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 10560 byte(s) in 1 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandshakeDone(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc:479:52
E   #11 0x000033e0093e in exec_ctx_run /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:45:3
E   #12 0x000033e0093e in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:72:9
E   #13 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #14 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #15 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #16 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/polls...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/http_api/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/http_api/test-results/py3test/testing_out_stuff/test_http_api.py.TestHttpApi.test_openapi_spec.log

ydb/tests/fq/http_api/test_http_api.py:106: in test_simple_analytics_query
    response = client.stop_query(query_id)
ydb/core/fq/libs/http_api_client/http_client.py:202: in stop_query
    self._validate_http_error(response, expected_code=expected_code)
ydb/core/fq/libs/http_api_client/http_client.py:111: in _validate_http_error
    raise YQHttpClientException(
E   ydb.core.fq.libs.http_api_client.http_client.YQHttpClientException: Error occurred. http code=400, status=400010, msg=BAD_REQUEST, details=[{'message': 'Conversion from status COMPLETING to ABORTING_BY_USER is not possible. Please wait for the previous operation to be completed', 'issue_code': 1001, 'severity': 'ERROR', 'issues': []}]

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/http_api/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/http_api/test-results/py3test/testing_out_stuff/test_http_api.py.TestHttpApi.test_simple_analytics_query.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_result_limits.py::TestResultLimits::test_many_rows (good) duration: 239.20s
test_alloc_default.py::TestAlloc::test_node_limit[kikimr0] (good) duration: 87.35s
test_result_limits.py::TestResultLimits::test_large_row (good) duration: 76.01s
test_alloc_default.py::TestAlloc::test_up_down[kikimr0] (good) duration: 34.06s
test_alloc_default.py::TestAlloc::test_mkql_not_increased[kikimr0] (good) duration: 30.73s
test_alloc_default.py::TestAlloc::test_hard_limit[kikimr0] (timeout) duration: 29.65s
test_alloc_default.py::TestAlloc::test_alloc_and_free[kikimr0] (good) duration: 28.87s
test_alloc_default.py::TestAlloc::test_default_limits[kikimr0] (good) duration: 27.52s
test_alloc_default.py::TestAlloc::test_default_delta[kikimr0] (good) duration: 27.04s
test_result_limits.py::TestResultLimits::test_quotas[kikimr0] (good) duration: 26.36s
2 tests were not launched inside chunk.
Info: Test run has exceeded 8.0G (8388608K) memory limit with 8.6G (9009272K) used. This may lead to test failure on the Autocheck/CI
You can increase test's ram requirement using REQUIREMENTS(ram:X) in the ya.make
   pid   rss   ref pdirt 
399918 44.8M 44.8M  6.5M test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
400057 32.9M 21.4M  8.8M    ├─ test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
405727  711M  713M  374M    │  └─ ydb-tests-fq-mem_alloc --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --doctest
505805  559M 14.5M  288M    │     ├─ ydb-tests-fq-mem_alloc --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --doct
505807  5.6G  5.1G  4.6G    │     └─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/test
401314  2.0G  2.0G  1.4G    └─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/ydb_data_f

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/test_alloc_default.py.TestAlloc.test_hard_limit.kikimr0.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_dispatch.py::TestMapping::test_mapping_with_row_dispatcher (fail) duration: 113.80s
test_dispatch.py::TestMapping::test_mapping (fail) duration: 108.61s
test_dispatch.py::TestMapping::test_idle (fail) duration: 106.84s
test_dispatch.py::TestMapping::test_mapping_with_nodes (fail) duration: 105.68s
test_dispatch.py::TestMapping::test_mapping_with_nodes_with_scheduler (fail) duration: 96.92s
Killed by timeout (600 s)
Info: Test run has exceeded 8.0G (8388608K) memory limit with 27.7G (29050908K) used. This may lead to test failure on the Autocheck/CI
You can increase test's ram requirement using REQUIREMENTS(ram:X) in the ya.make
   pid   rss   ref pdirt 
150929 44.8M 44.8M  6.6M test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
150937 33.8M 22.4M  9.8M    ├─ test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
153433  725M  726M  450M    │  └─ ydb-tests-fq-multi_plane --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --docte
155257  434M 22.1M  197M    │     ├─ ydb-tests-fq-multi_plane --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --do
155768  1.6G  1.6G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
156041  1.4G  1.4G  1.0G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
164681  1.5G  1.5G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
169780  560M 22.4M 78.9M    │     ├─ ydb-tests-fq-multi_plane --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --do
169911  1.5G  1.6G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
169980  1.4G  1.5G  1.0G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
182125  613M 22.5M 88.3M    │     ├─ ydb-tests-fq-multi_plane --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --do
182411  1.6G  1.6G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
182912  1.6G  1.6G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
183022  1.6G  1.6G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
199722  649M 22.8M  229M    │     ├─ ydb-tests-fq-multi_plane --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --do
199778  1.6G  1.6G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
200048  1.5G  1.6G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
200184  1.5G  1.6G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
213382  676M 23.4M  342M    │     ├─ ydb-tests-fq-multi_plane --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --do
213386  1.3G    0b    0b    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
250290  1.4G    0b    0b    │     │  └─ llvm-symbolizer --demangle --inlines --default-arch=x86_64
213505  1.3G  1.3G  983M    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
213802  1.6G  1.7G  1.2G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
214044  1.4G  1.4G  992M    │     └─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/te
151330  2.2G  2.2G  1.6G    └─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dis

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/stderr

teardown failed:
ydb/tests/fq/multi_plane/test_dispatch.py:29: in kikimr
    kikimr.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:748: in stop
    tenant.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_idle/cp/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_idle/cp/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 2, spent: 3.299423 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 6.629593 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 9.857704 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 13.039118 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 16.249482 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 19.511357 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 22.82847 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 26.108409 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 29.468518 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 2, spent: 30.005682 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==169782==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 21120 byte(s) in 2 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandshakeDone(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc:479:52
E   #11 0x000033e0093e in exec_ctx_run /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:45:3
E   #12 0x000033e0093e in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:72:9
E   #13 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #14 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #15 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #16 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/pollset.cc:48:10
E   #17 0x000033fada38 in cq_next(grpc_completion_queue*, gpr_timespec, void*) /-S/contrib/libs/grpc/src/core/lib/surface/completion_queue.cc:1036:29
E   #18 0x00003469365e in grpc::CompletionQueue::AsyncNextInternal(void**, bool*, gpr_timespec) /-S/contrib/libs/grpc/src/cpp/common/completion_queue_cc.cc:166:15
E   #19 0x000033db57cf in Next /-S/contrib/libs/grpc/include/grpcpp/completion_queue.h:182:13
E   #20 0x000033db57cf in NYdbGrpc::Dev::PullEvents(grpc::CompletionQueue*) /-S/ydb/public/sdk/cpp/src/library/grpc/client/grpc_client_low.cpp:190:18
E   #21 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:431:12
E   #22 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:990:10
E   #23 0x0000219ee24e in (anonymous namespace)::TThreadFactoryFuncObj::DoExecute() /-S/util/thread/factory.cpp:61:13
E   #24 0x0000219ee7ac in Execute /-S/util/thread/factory.h:15:13
E   #25 0x0000219ee7ac in (anonymous namespace)::TSystemThreadFactory::TPoolThread::ThreadProc(void*) /-S/util/thread/factory.cpp:36:41
E   #26 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #27 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 20270 byte(s) in 2 object(s) allocated from:
E   #0 0x00001f28aa54 in malloc /-S/contrib/libs/clang20-rt/lib/asan/asan_malloc_linux.cpp:67:3
E   #1 0x000033ddfb90 in gpr_malloc /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:32:7
E   #2 0x000033ddfb90 in gpr_malloc_aligned /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:63:13
E   #3 0x000033edb2e7 in ArenaStorage /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:42:10
E   #4 0x000033edb2e7 in grpc_core::Arena::CreateWithAlloc(unsigned long, unsigned long, grpc_event_engine::experimental::MemoryAllocator*) /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:71:26
E   #5 0x000033ee74da in grpc_core::FilterStackCall::Create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:819:46
E   #6 0x000033f06616 in grpc_call_create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:3456:10
E   #7 0x000034669dac in grpc_core::Server::ChannelData::AcceptStream(void*, grpc_transport*, void const*) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1243:29
E   #8 0x000034228207 in grpc_chttp2_parsing_accept_stream(grpc_chttp2_transport*, unsigned int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:852:3
E   #9 0x0000342a29dd in init_header_frame_parser(grpc_chttp2_transport*, int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:640:9
E   #10 0x00003429d86c in init_frame_parser /-S/contrib/libs/cxxsupp/libcxx/include/string_view
E   #11 0x00003429d86c in grpc_chttp2_perform_read(grpc_chttp2_transport*, grpc_slice const&) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:323:13
E   #12 ...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_idle.log

teardown failed:
ydb/tests/fq/multi_plane/test_dispatch.py:29: in kikimr
    kikimr.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:748: in stop
    tenant.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping/cp/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping/cp/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 3, spent: 3.469149 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 6.755772 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 10.175433 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 13.529226 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 16.945547 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 20.377219 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 23.873839 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 27.331775 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 3, spent: 30.001239 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==155300==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 20270 byte(s) in 2 object(s) allocated from:
E   #0 0x00001f28aa54 in malloc /-S/contrib/libs/clang20-rt/lib/asan/asan_malloc_linux.cpp:67:3
E   #1 0x000033ddfb90 in gpr_malloc /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:32:7
E   #2 0x000033ddfb90 in gpr_malloc_aligned /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:63:13
E   #3 0x000033edb2e7 in ArenaStorage /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:42:10
E   #4 0x000033edb2e7 in grpc_core::Arena::CreateWithAlloc(unsigned long, unsigned long, grpc_event_engine::experimental::MemoryAllocator*) /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:71:26
E   #5 0x000033ee74da in grpc_core::FilterStackCall::Create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:819:46
E   #6 0x000033f06616 in grpc_call_create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:3456:10
E   #7 0x000034669dac in grpc_core::Server::ChannelData::AcceptStream(void*, grpc_transport*, void const*) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1243:29
E   #8 0x000034228207 in grpc_chttp2_parsing_accept_stream(grpc_chttp2_transport*, unsigned int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:852:3
E   #9 0x0000342a29dd in init_header_frame_parser(grpc_chttp2_transport*, int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:640:9
E   #10 0x00003429d86c in init_frame_parser /-S/contrib/libs/cxxsupp/libcxx/include/string_view
E   #11 0x00003429d86c in grpc_chttp2_perform_read(grpc_chttp2_transport*, grpc_slice const&) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:323:13
E   #12 0x00003423d3ad in read_action_locked(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:2533:19
E   #13 0x000033e25ac6 in grpc_combiner_continue_exec_ctx() /-S/contrib/libs/grpc/src/core/lib/iomgr/combiner.cc:231:5
E   #14 0x000033e00974 in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:75:17
E   #15 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #16 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #17 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #18 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/pollset.cc:48:10
E   #19 0x000033fada38 in cq_next(grpc_completion_queue*, gpr_timespec, void*) /-S/contrib/libs/grpc/src/core/lib/surface/completion_queue.cc:1036:29
E   #20 0x00003469365e in grpc::CompletionQueue::AsyncNextInternal(void**, bool*, gpr_timespec) /-S/contrib/libs/grpc/src/cpp/common/completion_queue_cc.cc:166:15
E   #21 0x000033db57cf in Next /-S/contrib/libs/grpc/include/grpcpp/completion_queue.h:182:13
E   #22 0x000033db57cf in NYdbGrpc::Dev::PullEvents(grpc::CompletionQueue*) /-S/ydb/public/sdk/cpp/src/library/grpc/client/grpc_client_low.cpp:190:18
E   #23 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:431:12
E   #24 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:990:10
E   #25 0x0000219ee24e in (anonymous namespace)::TThreadFactoryFuncObj::DoExecute() /-S/util/thread/factory.cpp:61:13
E   #26 0x0000219ee7ac in Execute /-S/util/thread/factory.h:15:13
E   #27 0x0000219ee7ac in (anonymous namespace)::TSystemThreadFactory::TPoolThread::ThreadProc(void*) /-S/util/thread/factory.cpp:36:41
E   #28 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #29 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 10560 byte(s) in 1 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandshakeDone(void*, y_absl:...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping.log

teardown failed:
ydb/tests/fq/multi_plane/test_dispatch.py:29: in kikimr
    kikimr.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:748: in stop
    tenant.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_nodes/cp/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_nodes/cp/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 5, spent: 3.302035 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 5, spent: 6.599794 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 5, spent: 9.988869 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 5, spent: 13.384687 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 5, spent: 16.920229 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 5, spent: 20.296805 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 5, spent: 23.607019 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 5, spent: 26.947135 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 5, spent: 30.007494 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==182153==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 50675 byte(s) in 5 object(s) allocated from:
E   #0 0x00001f28aa54 in malloc /-S/contrib/libs/clang20-rt/lib/asan/asan_malloc_linux.cpp:67:3
E   #1 0x000033ddfb90 in gpr_malloc /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:32:7
E   #2 0x000033ddfb90 in gpr_malloc_aligned /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:63:13
E   #3 0x000033edb2e7 in ArenaStorage /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:42:10
E   #4 0x000033edb2e7 in grpc_core::Arena::CreateWithAlloc(unsigned long, unsigned long, grpc_event_engine::experimental::MemoryAllocator*) /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:71:26
E   #5 0x000033ee74da in grpc_core::FilterStackCall::Create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:819:46
E   #6 0x000033f06616 in grpc_call_create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:3456:10
E   #7 0x000034669dac in grpc_core::Server::ChannelData::AcceptStream(void*, grpc_transport*, void const*) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1243:29
E   #8 0x000034228207 in grpc_chttp2_parsing_accept_stream(grpc_chttp2_transport*, unsigned int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:852:3
E   #9 0x0000342a29dd in init_header_frame_parser(grpc_chttp2_transport*, int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:640:9
E   #10 0x00003429d86c in init_frame_parser /-S/contrib/libs/cxxsupp/libcxx/include/string_view
E   #11 0x00003429d86c in grpc_chttp2_perform_read(grpc_chttp2_transport*, grpc_slice const&) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:323:13
E   #12 0x00003423d3ad in read_action_locked(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:2533:19
E   #13 0x000033e25ac6 in grpc_combiner_continue_exec_ctx() /-S/contrib/libs/grpc/src/core/lib/iomgr/combiner.cc:231:5
E   #14 0x000033e00974 in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:75:17
E   #15 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #16 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #17 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #18 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/pollset.cc:48:10
E   #19 0x000033fada38 in cq_next(grpc_completion_queue*, gpr_timespec, void*) /-S/contrib/libs/grpc/src/core/lib/surface/completion_queue.cc:1036:29
E   #20 0x00003469365e in grpc::CompletionQueue::AsyncNextInternal(void**, bool*, gpr_timespec) /-S/contrib/libs/grpc/src/cpp/common/completion_queue_cc.cc:166:15
E   #21 0x000033db57cf in Next /-S/contrib/libs/grpc/include/grpcpp/completion_queue.h:182:13
E   #22 0x000033db57cf in NYdbGrpc::Dev::PullEvents(grpc::CompletionQueue*) /-S/ydb/public/sdk/cpp/src/library/grpc/client/grpc_client_low.cpp:190:18
E   #23 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:431:12
E   #24 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:990:10
E   #25 0x0000219ee24e in (anonymous namespace)::TThreadFactoryFuncObj::DoExecute() /-S/util/thread/factory.cpp:61:13
E   #26 0x0000219ee7ac in Execute /-S/util/thread/factory.h:15:13
E   #27 0x0000219ee7ac in (anonymous namespace)::TSystemThreadFactory::TPoolThread::ThreadProc(void*) /-S/util/thread/factory.cpp:36:41
E   #28 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #29 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 31680 byte(s) in 3 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandsha...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_nodes.log

teardown failed:
ydb/tests/fq/multi_plane/test_dispatch.py:29: in kikimr
    kikimr.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:748: in stop
    tenant.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_nodes_with_scheduler/cp/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_nodes_with_scheduler/cp/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 3, spent: 3.325969 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 6.640286 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 9.889357 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 13.17733 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 16.41247 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 19.681595 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 22.889984 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 26.063541 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 3, spent: 29.416933 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 3, spent: 30.00785 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==199728==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 31680 byte(s) in 3 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandshakeDone(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc:479:52
E   #11 0x000033e0093e in exec_ctx_run /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:45:3
E   #12 0x000033e0093e in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:72:9
E   #13 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #14 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #15 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #16 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/pollset.cc:48:10
E   #17 0x000033fada38 in cq_next(grpc_completion_queue*, gpr_timespec, void*) /-S/contrib/libs/grpc/src/core/lib/surface/completion_queue.cc:1036:29
E   #18 0x00003469365e in grpc::CompletionQueue::AsyncNextInternal(void**, bool*, gpr_timespec) /-S/contrib/libs/grpc/src/cpp/common/completion_queue_cc.cc:166:15
E   #19 0x000033db57cf in Next /-S/contrib/libs/grpc/include/grpcpp/completion_queue.h:182:13
E   #20 0x000033db57cf in NYdbGrpc::Dev::PullEvents(grpc::CompletionQueue*) /-S/ydb/public/sdk/cpp/src/library/grpc/client/grpc_client_low.cpp:190:18
E   #21 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:431:12
E   #22 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:990:10
E   #23 0x0000219ee24e in (anonymous namespace)::TThreadFactoryFuncObj::DoExecute() /-S/util/thread/factory.cpp:61:13
E   #24 0x0000219ee7ac in Execute /-S/util/thread/factory.h:15:13
E   #25 0x0000219ee7ac in (anonymous namespace)::TSystemThreadFactory::TPoolThread::ThreadProc(void*) /-S/util/thread/factory.cpp:36:41
E   #26 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #27 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 30405 byte(s) in 3 object(s) allocated from:
E   #0 0x00001f28aa54 in malloc /-S/contrib/libs/clang20-rt/lib/asan/asan_malloc_linux.cpp:67:3
E   #1 0x000033ddfb90 in gpr_malloc /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:32:7
E   #2 0x000033ddfb90 in gpr_malloc_aligned /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:63:13
E   #3 0x000033edb2e7 in ArenaStorage /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:42:10
E   #4 0x000033edb2e7 in grpc_core::Arena::CreateWithAlloc(unsigned long, unsigned long, grpc_event_engine::experimental::MemoryAllocator*) /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:71:26
E   #5 0x000033ee74da in grpc_core::FilterStackCall::Create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:819:46
E   #6 0x000033f06616 in grpc_call_create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:3456:10
E   #7 0x000034669dac in grpc_core::Server::ChannelData::AcceptStream(void*, grpc_transport*, void const*) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1243:29
E   #8 0x000034228207 in grpc_chttp2_parsing_accept_stream(grpc_chttp2_transport*, unsigned int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:852:3
E   #9 0x0000342a29dd in init_header_frame_parser(grpc_chttp2_transport*, int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:640:9
E   #10 0x00003429d86c in init_frame_parser /-S/contrib/libs/cxxsupp/libcxx/include/string_view
E   #11 0x00003429d86c in grpc_chttp2_perform_read(grpc_chttp2_transport*, grpc_slice const&) /-S/contrib/libs/grpc/src/core/e...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_nodes_with_scheduler.log

ydb/tests/fq/multi_plane/test_dispatch.py:158: in test_mapping_with_row_dispatcher
    assert self.wait_until((lambda: kikimr.tenants["/beta"].get_actor_count(1, "FQ_ROW_DISPATCHER_SESSION") > 0))
E   assert False
E    +  where False = <bound method TestYdsBase.wait_until of <__tests__.test_dispatch.TestMapping object at 0x7c0d95bbd230>>(<function TestMapping.test_mapping_with_row_dispatcher.<locals>.<lambda> at 0x7cad95fee690>)
E    +    where <bound method TestYdsBase.wait_until of <__tests__.test_dispatch.TestMapping object at 0x7c0d95bbd230>> = <__tests__.test_dispatch.TestMapping object at 0x7c0d95bbd230>.wait_untilteardown failed:
ydb/tests/fq/multi_plane/test_dispatch.py:29: in kikimr
    kikimr.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:748: in stop
    tenant.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_row_dispatcher/cp/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_row_dispatcher/cp/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 6, spent: 4.490247 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 6, spent: 7.835851 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 6, spent: 11.243221 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 6, spent: 14.529521 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 6, spent: 17.92125 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 6, spent: 21.412235 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 6, spent: 24.820675 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 6, spent: 28.34141 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 6, spent: 30.006505 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==213386==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 20270 byte(s) in 2 object(s) allocated from:
E   #0 0x00001f28aa54 in malloc /-S/contrib/libs/clang20-rt/lib/asan/asan_malloc_linux.cpp:67:3
E   #1 0x000033ddfb90 in gpr_malloc /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:32:7
E   #2 0x000033ddfb90 in gpr_malloc_aligned /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:63:13
E   #3 0x000033edb2e7 in ArenaStorage /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:42:10
E   #4 0x000033edb2e7 in grpc_core::Arena::CreateWithAlloc(unsigned long, unsigned long, grpc_event_engine::experimental::MemoryAllocator*) /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:71:26
E   #5 0x000033ee74da in grpc_core::FilterStackCall::Create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:819:46
E   #6 0x000033f06616 in grpc_call_create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:3456:10
E   #7 0x000034669dac in grpc_core::Server::ChannelData::AcceptStream(void*, grpc_transport*, void const*) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1243:29
E   #8 0x000034228207 in grpc_chttp2_parsing_accept_stream(grpc_chttp2_transport*, unsigned int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:852:3
E   #9 0x0000342a29dd in init_header_frame_parser(grpc_chttp2_transport*, int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:640:9
E   #10 0x00003429d86c in init_frame_parser /-S/contrib/libs/cxxsupp/libcxx/include/string_view
E   #11 0x00003429d86c in grpc_chttp2_perform_read(grpc_chttp2_transport*, grpc_slice const&) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:323:13
E   #12 0x00003423d3ad in read_action_locked(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:2533:19
E   #13 0x000033e25ac6 in grpc_combiner_continue_exec_ctx() /-S/contrib/libs/grpc/src/core/lib/iomgr/combiner.cc:231:5
E   #14 0x000033e00974 in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:75:17
E   #15 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #16 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #17 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #18 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/pollset.cc:48:10
E   #19 0x000033fada38 in cq_next(grpc_completion_queue*, gpr_timespec, void*) /-S/contrib/libs/grpc/src/core/lib/surface/completion_queue.cc:1036:29
E   #20 0x00003469365e in grpc::CompletionQueue::AsyncNextInternal(void**, bool*, gpr_timespec) /-S/contrib/libs/grpc/src/cpp/common/completion_queue_cc.cc:166:15
E   #21 0x000033db57cf in Next /-S/contrib/libs/grpc/include/grpcpp/completion_queue.h:182:13
E   #22 0x000033db57cf in NYdbGrpc::Dev::PullEvents(grpc::CompletionQueue*) /-S/ydb/public/sdk/cpp/src/library/grpc/client/grpc_client_low.cpp:190:18
E   #23 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:431:12
E   #24 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:990:10
E   #25 0x0000219ee24e in (anonymous namespace)::TThreadFactoryFuncObj::DoExecute() /-S/util/thread/factory.cpp:61:13
E   #26 0x0000219ee7ac in Execute /-S/util/thread/factory.h:15:13
E   #27 0x0000219ee7ac in (anonymous namespace)::TSystemThreadFactory::TPoolThread::ThreadProc(void*) /-S/util/thread/factory.cpp:36:41
E   #28 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #29 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 10560 byte(s) in 1 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::Handshakin...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_dispatch.py.TestMapping.test_mapping_with_row_dispatcher.log

ydb/tests/fq/multi_plane/test_retry.py:96: in test_low_rate
    kikimr.compute_plane.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py.TestRetry.test_low_rate.kikimr0/default/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py.TestRetry.test_low_rate.kikimr0/default/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 1, spent: 3.366707 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 6.651593 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 10.029882 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 13.418888 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 16.754799 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 19.9764 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 23.374505 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 26.750109 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.003766 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==191466==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 11616 byte(s) in 66 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 10560 byte(s) in 1 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandshakeDone(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc:479:52
E   #11 0x000033e0093e in exec_ctx_run /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:45:3
E   #12 0x000033e0093e in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:72:9
E   #13 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #14 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #15 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #16 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/pollset.cc:48:10
E   #17 0x000033fada38 in cq_next(grpc_completion_queue*, gpr_timespec, void*) /-S/contri...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry.py.TestRetry.test_low_rate.kikimr0.log

ydb/tests/fq/multi_plane/test_retry_high_rate.py:73: in test_high_rate
    kikimr.compute_plane.stop()
ydb/tests/tools/fq_runner/kikimr_runner.py:62: in stop
    self.kikimr_cluster.stop(kill=False)
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry_high_rate.py.TestRetry.test_high_rate.kikimr0/default/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry_high_rate.py.TestRetry.test_high_rate.kikimr0/default/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   GRpc shutdown warning: left infly: 1, spent: 5.901141 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 9.384472 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 12.790629 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 16.084249 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 19.43896 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 22.664533 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 26.069914 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 29.334255 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.005023 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==180789==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 11616 byte(s) in 66 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 10560 byte(s) in 1 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandshakeDone(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc:479:52
E   #11 0x000033e0093e in exec_ctx_run /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:45:3
E   #12 0x000033e0093e in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:72:9
E   #13 0x000033fd3674 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc
E   #14 0x000033fd3674 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #15 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #16 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/pollset.cc:48:10
E   #17 0x000033fada38 in cq_next(g...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/multi_plane/test-results/py3test/testing_out_stuff/test_retry_high_rate.py.TestRetry.test_high_rate.kikimr0.log

ydb/tests/fq/restarts/test_insert_restarts.py:88: in test_atomic_upload_commit
    kikimr.compute_plane.kikimr_cluster.restart_nodes()
ydb/tests/library/harness/kikimr_runner.py:643: in restart_nodes
    node.stop()
ydb/tests/library/harness/kikimr_runner.py:262: in stop
    super(KiKiMRNode, self).stop()
ydb/tests/library/harness/daemon.py:213: in stop
    raise DaemonError(
E   ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v2-client0/compute/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v2-client0/compute/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.002158 seconds, 1 sessions to shutdown
E   Current KQP shutdown state: spent 6.004506 seconds, 1 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 5.028031 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 8.057711 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 11.087748 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 14.11831 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 17.148319 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 20.182039 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 23.212637 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 26.243682 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 29.272874 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.006197 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==483718==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned l...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/restarts/test-results/py3test/testing_out_stuff/test_insert_restarts.py.TestS3.test_atomic_upload_commit.v2-client0.log

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_streaming.py::TestStreamingInYdb::test_read_topic_shared_reading_limit (timeout) duration: 609.79s
test_streaming.py::TestStreamingInYdb::test_read_topic (good) duration: 16.13s
test_streaming.py::TestStreamingInYdb::test_read_topic_shared_reading_insert_to_topic test was not launched inside chunk.

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/streaming/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/streaming/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/streaming/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/streaming/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/streaming/test-results/py3test/testing_out_stuff/test_streaming.py.TestStreamingInYdb.test_read_topic_shared_reading_limit.log

ydb/tests/functional/audit/test_canonical_records.py:348: in test_dstool_evict_vdisk_grpc
    execute_dstool_grpc(ydb_cluster, TOKEN, ['vdisk', 'evict', '--vdisk-ids', vdisk_id, '--ignore-degraded-group-check', '--ignore-failure-model-group-check'])
ydb/tests/functional/audit/helpers.py:60: in execute_dstool_grpc
    assert False, f'Command\n{full_cmd}\n finished with exit code {proc_result.exit_code}, stderr:\n\n{proc_result.std_err.decode("utf-8")}\n\nstdout:\n{proc_result.std_out.decode("utf-8")}'
E   AssertionError: Command
E   ['/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/dstool/ydb-dstool', '--endpoint', 'grpc://localhost:23333', 'vdisk', 'evict', '--vdisk-ids', '[82000000:1:0:0:0]', '--ignore-degraded-group-check', '--ignore-failure-model-group-check']
E    finished with exit code 1, stderr:
E   
E   error, add --verbose for more info
E   
E   
E   stdout:

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/audit/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/audit/test-results/py3test/testing_out_stuff/test_canonical_records.py.test_dstool_evict_vdisk_grpc.log

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_generator.py::TestTpcdsGenerator::test_s1_state_and_parts (timeout) duration: 625.40s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/benchmarks_init/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/benchmarks_init/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/benchmarks_init/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/benchmarks_init/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/benchmarks_init/test-results/py3test/testing_out_stuff/test_generator.py.TestTpcdsGenerator.test_s1_state_and_parts.log

ydb/tests/functional/blobstorage/test_vdisks.py:92: in test_enabled_disabled
    utils.read_data("table")
ydb/tests/functional/blobstorage/test_vdisks.py:60: in read_data
    session.transaction().execute(
contrib/python/ydb/py3/ydb/table.py:2392: in execute
    return self._driver(
contrib/python/ydb/py3/ydb/tracing.py:70: in wrapper
    return f(self, *args, **kwargs)
contrib/python/ydb/py3/ydb/pool.py:464: in __call__
    res = connection(
contrib/python/ydb/py3/ydb/connection.py:516: in __call__
    return response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
    issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:237: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.InternalError: message: "Internal error while executing transaction." issue_code: 1 issues { message: "TEvKqpNode::TEvStartKqpTasksRequest lost: ActorUnknown" severity: 1 } ,message: "Query invalidated on scheme/internal error during Data execution" issue_code: 2019 severity: 1 (server_code: 400030)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/blobstorage/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/blobstorage/test-results/py3test/testing_out_stuff/test_vdisks.py.TestTinyVDisks.test_enabled_disabled.log

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_serverless.py::test_turn_on_serverless_storage_billing[enable_alter_database_create_hive_first--true] (timeout) duration: 418.77s
test_serverless.py::test_turn_on_serverless_storage_billing[enable_alter_database_create_hive_first--false] (good) duration: 209.32s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/stderr

setup failed:
ydb/tests/library/fixtures/__init__.py:59: in ydb_cluster
    cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_column_disk_quotas.enable_alter_database_create_hive_first--false/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_column_disk_quotas.enable_alter_database_create_hive_first--false/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   GRpc shutdown warning: left infly: 1, spent: 4.592582 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 7.627108 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 10.657644 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 13.686869 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 16.717348 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 19.745229 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 22.772717 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 25.803168 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 28.838286 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.003485 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==470631==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00001bd79ab7 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00001bd79ab7 in __libcpp_allocate /-S/contrib/li...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_column_disk_quotas.enable_alter_database_create_hive_first--true.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_turn_on_serverless_storage_billing.enable_alter_database_create_hive_first--true.log

ydb/tests/functional/sqs/cloud/test_yandex_cloud_mode.py:829: in test_yc_events_processor
    assert len(lines) >= 2, "Got only %s event lines after all attempts" % len(lines)
E   AssertionError: Got only 0 event lines after all attempts
E   assert 0 >= 2
E    +  where 0 = len([])

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/sqs/cloud/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/sqs/cloud/test-results/py3test/testing_out_stuff/test_yandex_cloud_mode.py.TestSqsYandexCloudMode.test_yc_events_processor.tables_format_v0.log

ydb/tests/functional/statistics/test_restarts.py:92: in test_basic
    node.stop()
ydb/tests/library/harness/kikimr_runner.py:262: in stop
    super(KiKiMRNode, self).stop()
ydb/tests/library/harness/daemon.py:213: in stop
    raise DaemonError(
E   ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/statistics/test-results/py3test/testing_out_stuff/test_restarts.py.test_basic/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/statistics/test-results/py3test/testing_out_stuff/test_restarts.py.test_basic/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 1e-06 seconds, not started yet
E   GRpc shutdown warning: left infly: 1, spent: 5.062798 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 8.125865 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 11.258775 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 14.424185 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 17.699154 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 20.884356 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 24.069978 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 27.357691 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.009108 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==112938==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00001bd79ab7 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00001bd79ab7 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00001bd79ab7 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00001bd79ab7 in __...teardown failed:
ydb/tests/library/fixtures/__init__.py:117: in ydb_database
    yield from _ydb_database(ydb_cluster, ydb_root, ydb_safe_test_name)
ydb/tests/library/fixtures/__init__.py:111: in _ydb_database
    with ydb_database_ctx(cluster, database):
contrib/tools/python3/Lib/contextlib.py:144: in __exit__
    next(self.gen)
ydb/tests/library/fixtures/__init__.py:100: in ydb_database_ctx
    ydb_cluster.remove_database(database_path, timeout_seconds=timeout_seconds, token=token)
ydb/tests/library/harness/kikimr_cluster_interface.py:362: in remove_database
    operation_id = self._remove_database_send_op(database_name, token=token)
ydb/tests/library/harness/kikimr_cluster_interface.py:376: in _remove_database_send_op
    response = self.client.send_request(req.protobuf, method='ConsoleRequest')
ydb/tests/library/clients/kikimr_client.py:163: in send_request
    return self.send(protobuf_request, method)
ydb/tests/library/clients/kikimr_client.py:214: in send
    return self.invoke(request, method)
ydb/tests/library/clients/kikimr_client.py:122: in invoke
    return callee(request, timeout=self.__timeout)
contrib/python/grpcio/py3/grpc/_channel.py:1181: in __call__
    return _end_unary_response_blocking(state, call, False, None)
contrib/python/grpcio/py3/grpc/_channel.py:1006: in _end_unary_response_blocking
    raise _InactiveRpcError(state)  # pytype: disable=not-instantiable
E   grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
E   	status = StatusCode.UNAVAILABLE
E   	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:63315: Failed to connect to remote host: Connection refused"
E   	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:63315: Failed to connect to remote host: Connection refused {created_time:"2025-10-08T20:05:52.816028699+00:00", grpc_status:14}"
E   >

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/statistics/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/statistics/test-results/py3test/testing_out_stuff/test_restarts.py.test_basic.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_clickbench.py::TestClickbenchParallel::test[Query00] (fail) duration: 211.49s
test_clickbench.py::TestClickbench::test_clickbench[Query00] (good) duration: 90.86s
test_clickbench.py::TestClickbench::test_clickbench[Query29] (good) duration: 25.99s
test_clickbench.py::TestClickbench::test_clickbench[Query36] (good) duration: 18.17s
test_clickbench.py::TestClickbench::test_clickbench[Query35] (good) duration: 10.89s
test_clickbench.py::TestClickbench::test_clickbench[Query22] (good) duration: 9.08s
test_clickbench.py::TestClickbench::test_clickbench[Query09] (good) duration: 8.88s
test_clickbench.py::TestClickbench::test_clickbench[Query39] (good) duration: 8.83s
test_clickbench.py::TestClickbench::test_clickbench[Query28] (good) duration: 8.31s
test_clickbench.py::TestClickbench::test_clickbench[Query37] (good) duration: 7.65s
34 more tests with 192.21s total duration are not listed.
86 tests were not launched inside chunk.
Killed by timeout (600 s)

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_upload.py::TestUploadTpchS0_1::test (good) duration: 189.00s
test_upload.py::TestUploadTpchS0_1::test_tpch[7] (good) duration: 44.28s
test_upload.py::TestUploadTpchS0_1::test_tpch[8] (good) duration: 31.02s
test_upload.py::TestUploadTpchS0_1::test_tpch[9] (good) duration: 25.39s
test_upload.py::TestUploadTpchS0_1::test_tpch[11] (good) duration: 24.15s
test_upload.py::TestUploadTpchS0_1::test_tpch[15] (good) duration: 23.60s
test_upload.py::TestUploadTpchS0_1::test_tpch[10] (good) duration: 22.14s
test_upload.py::TestUploadTpchS0_1::test_tpch[17] (good) duration: 22.04s
test_upload.py::TestUploadTpchS0_1::test_tpch[5] (good) duration: 21.41s
test_upload.py::TestUploadTpchS0_1::test_tpch[16] (good) duration: 21.18s
11 more tests with 180.97s total duration are not listed.
2 tests were not launched inside chunk.

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_workload_manager.py::TestClickbenchWM::test (good) duration: 333.87s
test_workload_manager.py::TestTpchWMS0_1::test (timeout) duration: 268.39s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/stderr

setup failed:
ydb/tests/olap/load/lib/conftest.py:579: in setup_class
    cls.process_query_result(result, query_name, True)
ydb/tests/olap/load/lib/conftest.py:556: in process_query_result
    raise exc
ydb/tests/olap/load/lib/conftest.py:569: in setup_class
    cls.do_setup_class()
ydb/tests/olap/load/lib/clickbench.py:76: in do_setup_class
    super().do_setup_class()
ydb/tests/olap/load/lib/conftest.py:967: in do_setup_class
    cls.__results = YdbCliHelper.workload_run(
ydb/tests/olap/lib/ydb_cli.py:403: in workload_run
    with ThreadPoolExecutor(max_workers=len(runners)) as executor:
contrib/tools/python3/Lib/concurrent/futures/_base.py:647: in __exit__
    self.shutdown(wait=True)
contrib/tools/python3/Lib/concurrent/futures/thread.py:239: in shutdown
    t.join()
contrib/tools/python3/Lib/threading.py:1149: in join
    self._wait_for_tstate_lock()
contrib/tools/python3/Lib/threading.py:1169: in _wait_for_tstate_lock
    if lock.acquire(block, timeout):
library/python/pytest/plugins/ya.py:349: in _graceful_shutdown
    _graceful_shutdown_on_log(not capman.is_globally_capturing())
library/python/pytest/plugins/ya.py:321: in _graceful_shutdown_on_log
    pytest.exit("Graceful shutdown requested")
E   Failed: Graceful shutdown requested

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_clickbench.py.TestClickbenchParallel.test.Query00.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_upload.py.TestUploadTpchS0_1.test_tpch.20.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_workload_manager.py.TestTpchWMS0_1.test.log

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_duplicates.py::TestTpchDuplicatesZeroLevel::test_tpch[1] (timeout) duration: 626.75s
21 tests were not launched inside chunk.

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_s1.py::TestTpchS1::test_tpch[1] (good) duration: 319.81s
test_s1.py::TestTpchS1::test_tpch[8] (good) duration: 72.31s
test_s1.py::TestTpchS1::test_tpch[5] (good) duration: 47.07s
test_s1.py::TestTpchS1::test_tpch[9] (timeout) duration: 35.94s
test_s1.py::TestTpchS1::test_tpch[7] (good) duration: 35.70s
test_s1.py::TestTpchS1::test_tpch[2] (good) duration: 27.66s
test_s1.py::TestTpchS1::test_tpch[3] (good) duration: 25.81s
test_s1.py::TestTpchS1::test_tpch[4] (good) duration: 22.76s
test_s1.py::TestTpchS1::test_tpch[6] (good) duration: 17.15s
13 tests were not launched inside chunk.

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_s_float.py::TestTpchS0_2::test_tpch[1] (timeout) duration: 160.62s
test_s_float.py::TestTpchS0_1::test_tpch[1] (good) duration: 97.21s
test_s_float.py::TestTpchS0_1::test_tpch[20] (good) duration: 38.76s
test_s_float.py::TestTpchS0_1::test_tpch[21] (good) duration: 32.98s
test_s_float.py::TestTpchS0_1::test_tpch[22] (good) duration: 24.45s
test_s_float.py::TestTpchS0_1::test_tpch[8] (good) duration: 22.82s
test_s_float.py::TestTpchS0_1::test_tpch[9] (good) duration: 18.51s
test_s_float.py::TestTpchS0_1::test_tpch[16] (good) duration: 18.50s
test_s_float.py::TestTpchS0_1::test_tpch[2] (good) duration: 18.35s
test_s_float.py::TestTpchS0_1::test_tpch[15] (good) duration: 17.94s
13 more tests with 176.72s total duration are not listed.
43 tests were not launched inside chunk.

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff/test_duplicates.py.TestTpchDuplicatesZeroLevel.test_tpch.1.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff/test_s1.py.TestTpchS1.test_tpch.9.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/tpch/test-results/py3test/testing_out_stuff/test_s_float.py.TestTpchS0_2.test_tpch.1.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_delete_by_explicit_row_id.py::TestDeleteByExplicitRowId::test_delete_row_by_explicit_row_id (timeout) duration: 612.61s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/testing_out_stuff/test_delete_by_explicit_row_id.py.TestDeleteByExplicitRowId.test_delete_row_by_explicit_row_id.log

teardown failed:
ydb/tests/olap/scenario/conftest.py:81: in teardown_class
    cls._ydb_instance.stop()
ydb/tests/olap/scenario/conftest.py:63: in stop
    self._temp_ydb_cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_simple.py.TestSimple.test.alter_table/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_simple.py.TestSimple.test.alter_table/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.056528 seconds, 4 sessions to shutdown
E   Current KQP shutdown state: spent 6.100094 seconds, 4 sessions to shutdown
E   Current KQP shutdown state: spent 9.144089 seconds, 4 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 4.754069 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 8.071401 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 11.402822 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 14.825993 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 18.376873 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 21.879868 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 25.330246 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 28.695177 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.010285 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==278072==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_simple.py.TestSimple.test_multi.tablestores.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
ttl_delete_s3.py::TestDeleteS3Ttl::test_data_unchanged_after_ttl_change (good) duration: 349.91s
ttl_delete_s3.py::TestDeleteS3Ttl::test_delete_s3_tiering (timeout) duration: 262.27s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
ttl_delete_s3.py::TestDeleteTtl::test_ttl_delete (timeout) duration: 611.22s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff/ttl_delete_s3.py.TestDeleteS3Ttl.test_delete_s3_tiering.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff/ttl_delete_s3.py.TestDeleteTtl.test_ttl_delete.log

ydb/tests/stress/kafka/tests/test_kafka_streams.py:24: in test
    yatest.common.execute([
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
    res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:411: in wait
    self._finalise(check_exit_code)
library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise
    raise ExecutionError(self)
E   yatest.common.process.ExecutionError: Command '/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/kafka/kafka_streams_test --endpoint grpc://localhost:14122 --database /Root --bootstrap http://localhost:24749 --source-path test-topic --target-path target-topic --consumer workload-consumer-0 --num-workers 2 --duration 120' has failed with code 255.
E   Errors:
E   ...t org.apache.kafka.clients.producer.internals.TransactionManager$TxnRequestHandler.onComplete(TransactionManager.java:1207)
E   	at org.apache.kafka.clients.ClientResponse.onComplete(ClientResponse.java:109)
E   	at org.apache.kafka.clients.NetworkClient.completeResponses(NetworkClient.java:583)
E   	at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:575)
E   	at org.apache.kafka.clients.producer.internals.Sender.maybeSendAndPollTransactionalRequest(Sender.java:426)
E   	at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:316)
E   	at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:243)
E   	at java.base/java.lang.Thread.run(Thread.java:840)
E   Traceback (most recent call last):
E     File "contrib/tools/python3/Lib/runpy.py", line 198, in _run_module_as_main
E       return _run_code(code, main_globals, None,
E              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E     File "contrib/tools/python3/Lib/runpy.py", line 88, in _run_code
E       exec(code, run_globals)
E     File "ydb/tests/stress/kafka/__main__.py", line 27, in <module>
E       workload.loop()
E     File "ydb/tests/stress/kafka/workload/__init__.py", line 123, in loop
E       assert totalMessCountTest == totalMessCountTarget, f"Source and target {self.target_topic_path}-{i} topics total messages count are not equal:" + \
E              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E   AssertionError: Source and target target-topic-0 topics total messages count are not equal:{totalMessCountTest} and {totalMessCountTarget} respectively.

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/kafka/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/kafka/tests/test-results/py3test/testing_out_stuff/test_kafka_streams.py.TestYdbTopicWorkload.test.log

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_workload.py::TestYdbLogWorkload::test[row] (fail) duration: 391.13s
test_workload.py::TestYdbLogWorkload::test[column] (timeout) duration: 233.54s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbLogWorkload.test.column.log

teardown failed:
ydb/tests/stress/log/tests/test_workload.py:12: in setup
    yield from self.setup_cluster(
ydb/tests/library/stress/fixtures.py:35: in setup_cluster
    self.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbLogWorkload.test.row/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbLogWorkload.test.row/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   GRpc shutdown warning: left infly: 2, spent: 5.038795 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 8.093155 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 11.14306 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 14.191105 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 17.232762 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 20.26597 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 23.297291 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 26.328276 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 2, spent: 29.389306 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 2, spent: 30.006048 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==689339==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 34240 byte(s) in 1 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466242b in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00003466242b in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00003466242b in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x00003466242b in __allocate_at_least<std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x00003466242b in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x00003466242b in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x00003466242b in make_unique<std::__y1::vector<grpc_core::Server::ChannelRegisteredMethod, std::__y1::allocator<grpc_core::Server::ChannelRegisteredMethod> >, unsigned long &> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #8 0x00003466242b in grpc_core::Server::ChannelData::InitTransport(grpc_core::RefCountedPtr<grpc_core::Server>, grpc_core::RefCountedPtr<grpc_core::Channel>, unsigned long, grpc_transport*, long) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1155:9
E   #9 0x000034661c9d in grpc_core::Server::SetupTransport(grpc_transport*, grpc_pollset*, grpc_core::ChannelArgs const&, grpc_core::RefCountedPtr<grpc_core::channelz::SocketNode> const&) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:763:10
E   #10 0x00003a4a8ca2 in grpc_core::(anonymous namespace)::Chttp2ServerListener::ActiveConnection::HandshakingState::OnHandshakeDone(void*, y_absl::lts_y_20240722::Status) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc:479:52
E   #11 0x000033e0093e in exec_ctx_run /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:45:3
E   #12 0x000033e0093e in grpc_core::ExecCtx::Flush() /-S/contrib/libs/grpc/src/core/lib/iomgr/exec_ctx.cc:72:9
E   #13 0x000033fd34e4 in end_worker /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:981:34
E   #14 0x000033fd34e4 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:1049:3
E   #15 0x000033fcf248 in pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/ev_posix.cc:249:7
E   #16 0x000033ff2f88 in grpc_pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) /-S/contrib/libs/grpc/src/core/lib/iomgr/pollset.cc:48:10
E   #17 0x000033fada38 in cq_next(grpc_completion_queue*, gpr_timespec, void*) /-S/contrib/libs/grpc/src/core/lib/surface/completion_queue.cc:1036:29
E   #18 0x00003469365e in grpc::CompletionQueue::AsyncNextInternal(void**, bool*, gpr_timespec) /-S/contrib/libs/grpc/src/cpp/common/completion_queue_cc.cc:166:15
E   #19 0x000033db57cf in Next /-S/contrib/libs/grpc/include/grpcpp/completion_queue.h:182:13
E   #20 0x000033db57cf in NYdbGrpc::Dev::PullEvents(grpc::CompletionQueue*) /-S/ydb/public/sdk/cpp/src/library/grpc/client/grpc_client_low.cpp:190:18
E   #21 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:431:12
E   #22 0x0000219ee24e in operator() /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:990:10
E   #23 0x0000219ee24e in (anonymous namespace)::TThreadFactoryFuncObj::DoExecute() /-S/util/thread/factory.cpp:61:13
E   #24 0x0000219ee7ac in Execute /-S/util/thread/factory.h:15:13
E   #25 0x0000219ee7ac in (anonymous namespace)::TSystemThreadFactory::TPoolThread::ThreadProc(void*) /-S/util/thread/factory.cpp:36:41
E   #26 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #27 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 10135 byte(s) in 1 object(s) allocated from:
E   #0 0x00001f28aa54 in malloc /-S/contrib/libs/clang20-rt/lib/asan/asan_malloc_linux.cpp:67:3
E   #1 0x000033ddfb90 in gpr_malloc /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:32:7
E   #2 0x000033ddfb90 in gpr_malloc_aligned /-S/contrib/libs/grpc/src/core/lib/gpr/alloc.cc:63:13
E   #3 0x000033edb2e7 in ArenaStorage /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:42:10
E   #4 0x000033edb2e7 in grpc_core::Arena::CreateWithAlloc(unsigned long, unsigned long, grpc_event_engine::experimental::MemoryAllocator*) /-S/contrib/libs/grpc/src/core/lib/resource_quota/arena.cc:71:26
E   #5 0x000033ee74da in grpc_core::FilterStackCall::Create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:819:46
E   #6 0x000033f06616 in grpc_call_create(grpc_call_create_args*, grpc_call**) /-S/contrib/libs/grpc/src/core/lib/surface/call.cc:3456:10
E   #7 0x000034669dac in grpc_core::Server::ChannelData::AcceptStream(void*, grpc_transport*, void const*) /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1243:29
E   #8 0x000034228207 in grpc_chttp2_parsing_accept_stream(grpc_chttp2_transport*, unsigned int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/chttp2_transport.cc:852:3
E   #9 0x0000342a29dd in init_header_frame_parser(grpc_chttp2_transport*, int) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:640:9
E   #10 0x00003429d86c in init_frame_parser /-S/contrib/libs/cxxsupp/libcxx/include/string_view
E   #11 0x00003429d86c in grpc_chttp2_perform_read(grpc_chttp2_transport*, grpc_slice const&) /-S/contrib/libs/grpc/src/core/ext/transport/chttp2/transport/parsing.cc:323:13
E   #12 0x00003423d3ad in read_action_locked(void*, y_absl::lts_y_20240722::Status) /-S/co...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbLogWorkload.test.row.log

teardown failed:
ydb/tests/stress/s3_backups/tests/test_workload.py:12: in setup
    yield from self.setup_cluster(
ydb/tests/library/stress/fixtures.py:35: in setup_cluster
    self.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/s3_backups/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbWorkload.test/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/s3_backups/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbWorkload.test/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   GRpc shutdown warning: left infly: 1, spent: 4.365559 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 7.723052 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 10.944048 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 14.133638 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 17.521352 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 20.78842 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 24.085227 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 27.314039 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.003293 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==680485==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00001bd79ab7 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00001bd79ab7 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x00001bd79ab7 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/s3_backups/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/s3_backups/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbWorkload.test.log

ydb/tests/stress/topic/tests/test_workload_topic.py:25: in test
    yatest.common.execute(cmd_args)
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
    res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:411: in wait
    self._finalise(check_exit_code)
library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise
    raise ExecutionError(self)
E   yatest.common.process.ExecutionError: Command '/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/topic/workload_topic --endpoint grpc://localhost:25079 --database /Root --duration 60 --consumers 50 --producers 100' has failed with code 1.
E   Errors:
E   ...=====================================
E   Terminating due to uncaught exception 0x7cd608620690    what() -> "util/thread/pool.cpp:369: mtp queue not started"
E    of type TThreadPoolException
E   FATAL: Command '['/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/topic/tests/test-results/py3test/tmpotqpl11e/topic_ydb_cli/ydb_cli', '--verbose', '--endpoint', 'grpc://localhost:25079', '--database=/Root', 'workload', 'topic', 'run', 'full', '-s', '60', '--byte-rate', '100M', '--use-tx', '--tx-commit-interval', '2000', '-p', '100', '-c', '50', '--topic', 'topic/topic']' returned non-zero exit status 100.
E   Traceback (most recent call last):
E     File "ydb/tests/stress/common/common.py", line 100, in wrapper
E       f()
E     File "ydb/tests/stress/topic/workload/__init__.py", line 70, in __loop
E       self.cmd_run(
E     File "ydb/tests/stress/topic/workload/__init__.py", line 55, in cmd_run
E       subprocess.run(cmd, check=True, text=True)
E     File "contrib/tools/python3/Lib/subprocess.py", line 571, in run
E       raise CalledProcessError(retcode, process.args,
E   subprocess.CalledProcessError: Command '['/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/topic/tests/test-results/py3test/tmpotqpl11e/topic_ydb_cli/ydb_cli', '--verbose', '--endpoint', 'grpc://localhost:25079', '--database=/Root', 'workload', 'topic', 'run', 'full', '-s', '60', '--byte-rate', '100M', '--use-tx', '--tx-commit-interval', '2000', '-p', '100', '-c', '50', '--topic', 'topic/topic']' returned non-zero exit status 100.teardown failed:
ydb/tests/stress/topic/tests/test_workload_topic.py:12: in setup
    yield from self.setup_cluster()
ydb/tests/library/stress/fixtures.py:35: in setup_cluster
    self.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/topic/tests/test-results/py3test/testing_out_stuff/test_workload_topic.py.TestYdbTopicWorkload.test/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/topic/tests/test-results/py3test/testing_out_stuff/test_workload_topic.py.TestYdbTopicWorkload.test/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   Current KQP shutdown state: spent 3.009848 seconds, 44 sessions to shutdown
E   Current KQP shutdown state: spent 6.016783 seconds, 44 sessions to shutdown
E   Current KQP shutdown state: spent 9.042917 seconds, 44 sessions to shutdown
E   GRpc shutdown warning: left infly: 1, spent: 4.56831 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 7.750957 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 10.882249 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 14.011943 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 17.11687 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 20.281304 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 23.625471 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 27.133947 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.005047 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==680477==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00001bd79ab7 in __libcpp_operator_new<unsigned long> /-...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/topic/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/topic/tests/test-results/py3test/testing_out_stuff/test_workload_topic.py.TestYdbTopicWorkload.test.log

Test results differ from canonical:
test_result['response_last_offset']['Messages'][3]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][4]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][5]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][6]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][7]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][8]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][9]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.TestViewer.test_topic_data.log

Test results differ from canonical:
test_result['data']['EndOffset']: value 0 differs from canonical 1
test_result['data']['Messages']: value [{'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message'... is missing
test_result['insert']['status']: - SUCCESS
+ ABORTED
test_result['insert']['error']: extra key with value {'issue_code': 2034, 'message': "Cannot parse tx 5. SCHEME_CH..., test_result['insert']['issues']: extra key with value [{'issue_code': 2028, 'issues': [{'issue_code': 2034, 'messag...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.TestViewer.test_topic_data_cdc.log

ydb/tests/functional/hive/test_drain.py:93: in test_drain_on_stop
    wait_tablets_are_active(
ydb/tests/library/common/delayed.py:151: in wait_tablets_are_active
    predicate(raise_error=True)
ydb/tests/library/common/delayed.py:141: in predicate
    raise AssertionError(
E   AssertionError: 
E   ##############################
E   0 seconds passed, 18 tablet(s) are not active. Inactive tablets are (first 10 entries): (72075186224038021: 6) (72075186224038227: 6) (72075186224038239: 5) (72075186224038269: 6) (72075186224038452: 6) (72075186224038487: 6) (72075186224038626: 6) (72075186224038644: 5) (72075186224038674: 6) (72075186224038676: 6). Additional info is empty
E   ##############################

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/hive/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/hive/test-results/py3test/testing_out_stuff/test_drain.py.TestHive.test_drain_on_stop.log

ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
    IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
    return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
    res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
    yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
    return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
    raise self._exception
contrib/python/ydb/py3/ydb/connection.py:121: in _on_response_callback
    response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
    issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:237: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)

During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
    with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E   AssertionError: Regex pattern did not match.
E    Regex: '.*DISK_SPACE_EXHAUSTED.*'
E    Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--false.log

setup failed:
ydb/tests/library/fixtures/__init__.py:59: in ydb_cluster
    cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--false/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--false/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   GRpc shutdown warning: left infly: 1, spent: 4.436768 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 7.481409 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 10.52594 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 13.573912 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 16.642544 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 19.69057 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 22.727468 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 25.78454 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: left infly: 1, spent: 28.863638 sec. GRpcShutdownDeadline: 30
E   GRpc shutdown warning: failed to shutdown all connections, left infly: 1, spent: 30.007807 sec. GRpcShutdownDeadline: 30
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==470759==ERROR: LeakSanitizer: detected memory leaks
E   
E   Too many leaks! Only the first 5000 leaks encountered will be reported.
E   Indirect leak of 37664 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x000034661172 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x000034661172 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x000034661172 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x000034661172 in __allocate_at_least<std::__y1::allocator<grpc_core::LockedMultiProducerSingleConsumerQueue> > /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocate_at_least.h:41:19
E   #5 0x000034661172 in __vallocate /-S/contrib/libs/cxxsupp/libcxx/include/vector:807:25
E   #6 0x000034661172 in vector /-S/contrib/libs/cxxsupp/libcxx/include/vector:461:7
E   #7 0x000034661172 in RealRequestMatcher /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:233:26
E   #8 0x000034661172 in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:30
E   #9 0x000034661172 in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #10 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #11 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #12 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #13 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #14 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #15 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #16 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #17 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #18 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #19 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #20 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #21 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #22 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 18832 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00003466108c in make_unique<grpc_core::Server::RealRequestMatcher, grpc_core::Server *> /-S/contrib/libs/cxxsupp/libcxx/include/__memory/unique_ptr.h:642:26
E   #2 0x00003466108c in grpc_core::Server::Start() /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:710:21
E   #3 0x00003466fdee in grpc_server_start /-S/contrib/libs/grpc/src/core/lib/surface/server.cc:1715:37
E   #4 0x00003a448517 in grpc::Server::Start(grpc::ServerCompletionQueue**, unsigned long) /-S/contrib/libs/grpc/src/cpp/server/server_cc.cc:1214:3
E   #5 0x00003a439e94 in grpc::ServerBuilder::BuildAndStart() /-S/contrib/libs/grpc/src/cpp/server/server_builder.cc:445:11
E   #6 0x00003a4297e9 in NYdbGrpc::TGRpcServer::Start() /-S/ydb/library/grpc/server/grpc_server.cpp:249:23
E   #7 0x0000411df2c9 in NKikimr::TGRpcServersManager::Start() /-S/ydb/core/driver_lib/run/run.cpp:274:21
E   #8 0x0000411de320 in Bootstrap /-S/ydb/core/driver_lib/run/run.cpp:226:9
E   #9 0x0000411de320 in NActors::TActorBootstrapped<NKikimr::TGRpcServersManager>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:26:22
E   #10 0x000021d6cb87 in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:350:17
E   #11 0x000021e23e01 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:267:28
E   #12 0x000021e2d9f4 in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:455:39
E   #13 0x000021e2cfad in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:507:13
E   #14 0x000021e2f01e in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:533:9
E   #15 0x00001f5eab04 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #16 0x00001f288416 in asan_thread_start(void*) /-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 11224 byte(s) in 214 object(s) allocated from:
E   #0 0x00001f2c48fd in operator new(unsigned long) /-S/contrib/libs/clang20-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x00001bd79ab7 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x00001bd79ab7 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--true.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_alter_compression.py::TestAlterCompression::test[alter_compression] (good) duration: 555.88s
test_alter_compression.py::TestAlterCompression::test_multi[alter_compression] (good) duration: 0.01s
Killed by timeout (600 s)
Info: Test run has exceeded 8.0G (8388608K) memory limit with 18.1G (18937628K) used. This may lead to test failure on the Autocheck/CI
You can increase test's ram requirement using REQUIREMENTS(ram:X) in the ya.make
   pid   rss   ref pdirt 
270915 44.8M 44.8M  6.3M test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
270961 33.4M 21.7M  9.1M    └─ test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
270986  1.0G  1.0G  934M       └─ ydb-tests-olap-scenario --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --doctes
272984  2.0G  2.0G  1.4G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu
273126  1.8G  1.9G  1.4G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu
273280  1.8G  1.8G  1.3G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu
273445  2.0G  2.0G  1.4G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu
273852  1.8G  1.8G  1.3G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu
274282  1.8G  1.8G  1.3G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu
274581  2.1G  2.1G  1.5G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu
274864  1.8G  1.7G  1.2G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu
275212  1.8G  1.7G  1.2G          └─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/chu

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/stderr

ydb/tests/olap/scenario/conftest.py:126: in test
    raise errors[0]
ydb/tests/olap/scenario/conftest.py:85: in worker
    self._test_suffix(local_ctx, suffix, codes, idx)
ydb/tests/olap/scenario/conftest.py:136: in _test_suffix
    ctx.executable(self, ctx)
ydb/tests/olap/scenario/test_alter_tiering.py:361: in scenario_many_tables
    threads.start_and_wait_all()
ydb/tests/olap/common/thread_helper.py:49: in start_and_wait_all
    self.join_all()
ydb/tests/olap/common/thread_helper.py:45: in join_all
    thread.join(timeout=timeout)
ydb/tests/olap/common/thread_helper.py:18: in join
    raise self.exc
ydb/tests/olap/common/thread_helper.py:11: in run
    self.ret = self._target(*self._args, **self._kwargs)
ydb/tests/olap/scenario/test_alter_tiering.py:218: in _loop_bulk_upsert
    sth.bulk_upsert(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:647: in bulk_upsert
    self._bulk_upsert_impl(tablename, data_generator, expected_status)
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:390: in _bulk_upsert_impl
    self._run_with_expected_status(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:366: in _run_with_expected_status
    pytest.fail(f'Unexpected status: must be in {repr(expected_status)}, but get {repr(error or status)}')
E   Failed: Unexpected status: must be in {<StatusCode.SUCCESS: 400000>}, but get BadRequest('message: "Bulk upsert to table \\\'/Root/olap_yatests/TestAlterTiering/many_tables/store/table0\\\' " severity: 1 (server_code: 400010)')

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_alter_tiering.py.TestAlterTiering.test.many_tables.log

ydb/tests/olap/scenario/conftest.py:117: in test_multi
    raise errors[0]
ydb/tests/olap/scenario/conftest.py:85: in worker
    self._test_suffix(local_ctx, suffix, codes, idx)
ydb/tests/olap/scenario/conftest.py:136: in _test_suffix
    ctx.executable(self, ctx)
ydb/tests/olap/scenario/test_insert.py:106: in scenario_read_data_during_bulk_upsert
    thread2.join_all()
ydb/tests/olap/common/thread_helper.py:45: in join_all
    thread.join(timeout=timeout)
ydb/tests/olap/common/thread_helper.py:18: in join
    raise self.exc
ydb/tests/olap/common/thread_helper.py:11: in run
    self.ret = self._target(*self._args, **self._kwargs)
ydb/tests/olap/scenario/test_insert.py:56: in _loop_insert
    result = sth.execute_query(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:507: in execute_query
    return self._run_with_expected_status(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:366: in _run_with_expected_status
    pytest.fail(f'Unexpected status: must be in {repr(expected_status)}, but get {repr(error or status)}')
E   Failed: Unexpected status: must be in {<StatusCode.SUCCESS: 400000>}, but get Unavailable('message: "Kikimr cluster or one of its subsystems was unavailable. Error writing to table `/Root/olap_yatests/TestInsert/read_data_during_bulk_upsert3/cnt0`: can\\\'t deliver message to tablet 72075186224038158." issue_code: 2005 severity: 1 (server_code: 400050)')teardown failed:
ydb/tests/olap/scenario/conftest.py:81: in teardown_class
    cls._ydb_instance.stop()
ydb/tests/olap/scenario/conftest.py:63: in stop
    self._temp_ydb_cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:639: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Unexpectedly finished before stop.
E   Process exit_code = -6.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_insert.py.TestInsert.test.read_data_during_bulk_upsert/cluster/node_9/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_insert.py.TestInsert.test.read_data_during_bulk_upsert/cluster/node_9/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   VERIFY failed (2025-10-08T20:20:31.329319Z): tablet_id=72075186224038320;self_id=[9:7558948198367976209:6732];ev=NActors::IEventHandle;tx_id=281474976710803;lock_id=281474976710801;verification=!CommitSnapshot;fline=written.h:89;
E   ydb/library/actors/core/log.cpp:857
E   ~TVerifyFormattedRecordWriter(): requirement false failed
E   0. /-S/util/system/yassert.cpp:83: InternalPanicImpl @ 0x1F5E5C15
E   1. /-S/util/system/yassert.cpp:55: Panic @ 0x1F5D396A
E   2. /root/.ya/build/build_root/jnsn/00044a//place/sandbox-data/tasks/3/2/3451528323/ydb/ydb/library/actors/core/log.cpp:857: ~TVerifyFormattedRecordWriter @ 0x21E4B2FD
E   3. /-S/ydb/core/tx/columnshard/engines/portions/written.h:0: SetCommitSnapshot @ 0x3B2FC904
E   4. /-S/ydb/core/tx/columnshard/engines/storage/granule/granule.h:228: AbortPortionOnExecute @ 0x3D74E770
E   5. /tmp//-S/ydb/core/tx/columnshard/operations/write.cpp:130: AbortOnExecute @ 0x3D74DEF7
E   6. /tmp//-S/ydb/core/tx/columnshard/operations/manager.cpp:134: AbortTransactionOnExecute @ 0x3D73B129
E   7. /place/sandbox-data/tasks/3/2/3451528323/ydb/ydb/core/tx/columnshard/transactions/operators/ev_write/abstract.h:116: ExecuteOnAbort @ 0x1E2995EF
E   8. /tmp//-S/ydb/core/tx/columnshard/transactions/tx_controller.cpp:185: ExecuteOnCancel @ 0x3D7AB325
E   9. /tmp//-S/ydb/core/tx/columnshard/columnshard__propose_cancel.cpp:22: Execute @ 0x3D8AAA55
E   10. /tmp//-S/ydb/core/tablet_flat/flat_executor.cpp:2029: ExecuteTransaction @ 0x26ED1B0E
E   11. /tmp//-S/ydb/core/tablet_flat/flat_executor.cpp:1934: DoExecute @ 0x26ECBE2A
E   12. /tmp//-S/ydb/core/tablet_flat/flat_executor.cpp:1948: Execute @ 0x26ED473E
E   13. /tmp//-S/ydb/core/tablet_flat/tablet_flat_executed.cpp:62: Execute @ 0x26E68B5A
E   14. /tmp//-S/ydb/core/tablet_flat/tablet_flat_executed.cpp:57: Execute @ 0x26E68B5A
E   15. /tmp//-S/ydb/core/tx/columnshard/columnshard__propose_cancel.cpp:38: Handle @ 0x3D8A9475
E   16. /-S/ydb/core/tx/columnshard/columnshard_impl.h:424: StateWork @ 0x3D81BA17
E   17. /tmp//-S/ydb/library/actors/core/actor.cpp:350: Receive @ 0x21D6CB87
E   18. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:267: Execute @ 0x21E23E01
E   19. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:455: operator() @ 0x21E2D9F4
E   20. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:507: ProcessExecutorPool @ 0x21E2CFAD
E   21. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:533: ThreadProc @ 0x21E2F01E
E   22. /-S/util/system/thread.cpp:245: ThreadProxy @ 0x1F5EAB04
E   23. /tmp//-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239: asan_thread_start @ 0x1F288416
E   24. ??:0: ?? @ 0x7F8C8CE94AC2
E   25. ??:0: ?? @ 0x7F8C8CF268BF
E   Daemon failed with message: Unexpectedly finished before stop.
E   Process exit_code = -6.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_insert.py.TestInsert.test.read_data_during_bulk_upsert/cluster/node_6/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_insert.py.TestInsert.test.read_data_during_bulk_upsert/cluster/node_6/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   VERIFY failed (2025-10-08T20:20:24.142785Z): tablet_id=72075186224038158;self_id=[6:7558948198381717619:7017];ev=NActors::IEventHandle;tx_id=281474976710791;lock_id=281474976710787;verification=!CommitSnapshot;fline=written.h:89;
E   ydb/library/actors/core/log.cpp:857
E   ~TVerifyFormattedRecordWriter(): requirement false failed
E   0. /-S/util/system/yassert.cpp:83: InternalPanicImpl @ 0x1F5E5C15
E   1. /-S/util/system/yassert.cpp:55: Panic @ 0x1F5D396A
E   2. /root/.ya/build/build_root/jnsn/00044a//place/sandbox-data/tasks/3/2/3451528323/ydb/ydb/library/actors/core/log.cpp:857: ~TVerifyFormattedRecordWriter @ 0x21E4B2FD
E   3. /-S/ydb/core/tx/columnshard/engines/portions/written.h:0: SetCommitSnapshot @ 0x3B2FC904
E   4. /-S/ydb/core/tx/columnshard/engines/storage/granule/granule.h:228: AbortPortionOnExecute @ 0x3D74E770
E   5. /tmp//-S/ydb/core/tx/columnshard/operations/write.cpp:130: AbortOnExecute @ 0x3D74DEF7
E   6. /tmp//-S/ydb/core/tx/columnshard/operations/manager.cpp:134: AbortTransactionOnExecute @ 0x3D73B129
E   7. /place/sandbox-data/tasks/3/2/3451528323/ydb/ydb/core/tx/columnshard/transactions/operators/ev_write/abstract.h:116: ExecuteOnAbort @ 0x1E2995EF
E   8. /tmp//-S/ydb/core/tx/columnshard/transactions/tx_controller.cpp:185: ExecuteOnCancel @ 0x3D7AB325
E   9. /tmp//-S/ydb/core/tx/columnshard/columnshard__propose_cancel.cpp:22: Execute @ 0x3D8AAA55
E   10. /tmp//-S/ydb/core/tablet_flat/flat_executor.cpp:2029: ExecuteTransaction @ 0x26ED1B0E
E   11. /tmp//-S/ydb/core/tablet_flat/flat_executor.cpp:1934: DoExecute @ 0x26ECBE2A
E   12. /tmp//-S/ydb/core/tablet_flat/flat_executor.cpp:1948: Execute @ 0x26ED473E
E   13. /tmp//-S/ydb/core/tablet_flat/tablet_flat_executed.cpp:62: Execute @ 0x26E68B5A
E   14. /tmp//-S/ydb/core/tablet_flat/tablet_flat_executed.cpp:57: Execute @ 0x26E68B5A
E   15. /tmp//-S/ydb/core/tx/columnshard/columnshard__propose_cancel.cpp:38: Handle @ 0x3D8A9475
E   16. /-S/ydb/core/tx/columnshard/columnshard_impl.h:424: StateWork @ 0x3D81BA17
E   17. /tmp//-S/ydb/library/actors/core/actor.cpp:350: Receive @ 0x21D6CB87
E   18. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:267: Execute @ 0x21E23E01
E   19. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:455: operator() @ 0x21E2D9F4
E   20. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:507: ProcessExecutorPool @ 0x21E2CFAD
E   21. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:533: ThreadProc @ 0x21E2F01E
E   22. /-S/util/system/thread.cpp:245: ThreadProxy @ 0x1F5EAB04
E   23. /tmp//-S/contrib/libs/clang20-rt/lib/asan/asan_interceptors.cpp:239: asan_thread_start @ 0x1F288416
E   24. ??:0: ?? @ 0x7F63B62C7AC2
E   25. ??:0: ?? @ 0x7F63B63598BF
E   Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_insert.py.TestInsert.test.read_data_during_bulk_upsert/cluster/node_7/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_insert.py.TestInsert.test.read_data_during_bulk_upsert/cluster/node_7/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 s...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_insert.py.TestInsert.test_multi.read_data_during_bulk_upsert.log