Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
HugeBlobOnlineSizeChange::Compaction (timeout) duration: 601.68s
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/blobstorage/ut_blobstorage/ut_huge/test-results/unittest/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/blobstorage/ut_blobstorage/ut_huge/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/blobstorage/ut_blobstorage/ut_huge/test-results/unittest/testing_out_stuff/stderr
assertion failed at ydb/core/kqp/ut/query/kqp_analyze_ut.cpp:103, virtual void NKikimr::NKqp::NTestSuiteKqpAnalyze::TTestCaseAnalyzeTable<true>::Execute_(NUnitTest::TTestContext &) [ColumnStore = true]: (stat >= 1500) 0
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:14
Get at /-S/util/generic/ptr.h:595:16
UnRef at /-S/util/generic/ptr.h:640:13
NKikimr::NKqp::NTestSuiteKqpAnalyze::TCurrentTest::Execute()::'lambda'()::operator()() const at /-S/ydb/core/kqp/ut/query/kqp_analyze_ut.cpp:0:1
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:640:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:0
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/query/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/query/test-results/unittest/testing_out_stuff/KqpAnalyze.AnalyzeTable.ColumnStore.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/query/test-results/unittest/testing_out_stuff/KqpAnalyze.AnalyzeTable.ColumnStore.out
Test crashed (return code: -6)
See logs for more info
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/scheme/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/scheme/test-results/unittest/testing_out_stuff/KqpOlapScheme.AddPgColumnWithStore.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/kqp/ut/scheme/test-results/unittest/testing_out_stuff/KqpOlapScheme.AddPgColumnWithStore.out
Test crashed (return code: -6)
See logs for more info
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/tx/schemeshard/ut_vector_index_build_reboots/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/tx/schemeshard/ut_vector_index_build_reboots/test-results/unittest/testing_out_stuff/VectorIndexBuildTestReboots.BaseCase.Prefixed.TabletReboots.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/tx/schemeshard/ut_vector_index_build_reboots/test-results/unittest/testing_out_stuff/VectorIndexBuildTestReboots.BaseCase.Prefixed.TabletReboots.out
Test results differ from canonical:
test_result['response_last_offset']['Messages'][3]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][4]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][5]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][6]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][7]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][8]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][9]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':...
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.TestViewer.test_topic_data.log
Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
HugeCluster::AllToAll (timeout) duration: 717.58s
HugeCluster::AllToOne test was not launched inside chunk.
Info: Test run has exceeded 8.0G (8388608K) memory limit with 9.7G (10210372K) used. This may lead to test failure on the Autocheck/CI
You can increase test's ram requirement using REQUIREMENTS(ram:X) in the ya.make
pid rss ref pdirt
3861616 44.8M 44.8M 6.8M test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
3861931 66.3M 55.4M 42.6M └─ test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
3862067 47.7M 47.7M 24.3M └─ test_tool run_ut @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/test-results/unittest/testing_out_stuff/test_tool.arg
3862423 8.4G 9.6G 4.8G └─ ydb-library-actors-interconnect-ut_huge_cluster --trace-path-append /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/test-results/unittest/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/library/actors/interconnect/ut_huge_cluster/test-results/unittest/testing_out_stuff/stderr
assertion failed at ydb/services/persqueue_v1/persqueue_ut.cpp:3302, virtual void NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCache::Execute_(NUnitTest::TTestContext &): (info9.BlobsFromDisk == 0) failed: (1 != 0)
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:14
Get at /-S/util/generic/ptr.h:595:16
~TStringBuilder at /-S/util/string/builder.h:8:11
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()::'lambda'()::operator()() const at /-S/ydb/services/persqueue_v1/persqueue_ut.cpp:0:1
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:640:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:0
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff/TPersQueueTest.Cache.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/persqueue_v1/ut/test-results/unittest/testing_out_stuff/TPersQueueTest.Cache.out
assertion failed at ydb/services/ydb/ydb_logstore_ut.cpp:437, virtual void NTestSuiteYdbLogStore::TTestCaseAlterLogTable::Execute_(NUnitTest::TTestContext &): (res.GetStatus() == EStatus::SUCCESS) failed: (PRECONDITION_FAILED != SUCCESS) <main>: Error: Column stores are not supported
, with diff:
(PRE|SUC)C(ONDITION_FAIL|)E(D|SS)
TBackTrace::Capture() at /-S/util/system/backtrace.cpp:284:14
Get at /-S/util/generic/ptr.h:595:16
~TStringBuilder at /-S/util/string/builder.h:8:11
NTestSuiteYdbLogStore::TCurrentTest::Execute()::'lambda'()::operator()() const at /-S/ydb/services/ydb/ydb_logstore_ut.cpp:0:1
~__value_func at /-S/contrib/libs/cxxsupp/libcxx/include/__functional/function.h:398:16
UnRef at /-S/util/generic/ptr.h:640:13
NUnitTest::TTestFactory::Execute() at /-S/library/cpp/testing/unittest/registar.cpp:0:19
NUnitTest::RunMain(int, char**) at /-S/library/cpp/testing/unittest/utmain.cpp:0:0
?? at ??:0:0
?? at ??:0:0
_start at ??:0:0
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/ydb/ut/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/ydb/ut/test-results/unittest/testing_out_stuff/YdbLogStore.AlterLogTable.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/services/ydb/ut/test-results/unittest/testing_out_stuff/YdbLogStore.AlterLogTable.out
ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
raise self._exception
contrib/python/ydb/py3/ydb/connection.py:121: in _on_response_callback
response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:237: in _process_response
raise exc_obj(_format_response(response_proto), response_proto.issues)
E ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)
During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E AssertionError: Regex pattern did not match.
E Regex: '.*DISK_SPACE_EXHAUSTED.*'
E Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--false.log
ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
raise self._exception
contrib/python/ydb/py3/ydb/connection.py:121: in _on_response_callback
response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:237: in _process_response
raise exc_obj(_format_response(response_proto), response_proto.issues)
E ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--true_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)
During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E AssertionError: Regex pattern did not match.
E Regex: '.*DISK_SPACE_EXHAUSTED.*'
E Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--true_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--true.log
ydb/tests/functional/tenants/test_tenants.py:433: in test_list_database_above
assert result.children[0].name == ".sys"
E AssertionError: assert '.metadata' == '.sys'
E
E - .sys
E + .metadata
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_tenants.py.TestTenants.test_list_database_above.enable_alter_database_create_hive_first--false.log
ydb/tests/functional/tenants/test_tenants.py:433: in test_list_database_above
assert result.children[0].name == ".sys"
E AssertionError: assert '.metadata' == '.sys'
E
E - .sys
E + .metadata
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_tenants.py.TestTenants.test_list_database_above.enable_alter_database_create_hive_first--true.log
ydb/tests/olap/scenario/conftest.py:126: in test
raise errors[0]
ydb/tests/olap/scenario/conftest.py:85: in worker
self._test_suffix(local_ctx, suffix, codes, idx)
ydb/tests/olap/scenario/conftest.py:136: in _test_suffix
ctx.executable(self, ctx)
ydb/tests/olap/scenario/test_alter_tiering.py:361: in scenario_many_tables
threads.start_and_wait_all()
ydb/tests/olap/common/thread_helper.py:49: in start_and_wait_all
self.join_all()
ydb/tests/olap/common/thread_helper.py:45: in join_all
thread.join(timeout=timeout)
ydb/tests/olap/common/thread_helper.py:18: in join
raise self.exc
ydb/tests/olap/common/thread_helper.py:11: in run
self.ret = self._target(*self._args, **self._kwargs)
ydb/tests/olap/scenario/test_alter_tiering.py:218: in _loop_bulk_upsert
sth.bulk_upsert(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:647: in bulk_upsert
self._bulk_upsert_impl(tablename, data_generator, expected_status)
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:390: in _bulk_upsert_impl
self._run_with_expected_status(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:369: in _run_with_expected_status
pytest.fail(f'Retries exceeded with unexpected status: must be in {repr(expected_status)}, but get {repr(error or status)}')
E Failed: Retries exceeded with unexpected status: must be in {<StatusCode.SUCCESS: 400000>}, but get SchemeError('message: "Bulk upsert to table \\\'/Root/olap_yatests/TestAlterTiering/many_tables/store/table0\\\' All columns are required during BulkUpsert for column table. Missing columns: tmp_column_sgqejeyd" severity: 1 (server_code: 400070)')
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_alter_tiering.py.TestAlterTiering.test.many_tables.log
ydb/tests/stress/olap_workload/tests/test_workload.py:26: in test
yatest.common.execute([
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:411: in wait
self._finalise(check_exit_code)
library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise
raise ExecutionError(self)
E yatest.common.process.ExecutionError: Command '/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/olap_workload/olap_workload --endpoint grpc://localhost:6264 --database /Root --duration 120' has failed with code 1.
E Errors:
E ...ydb/py3/ydb/query/pool.py", line 250, in wrapped_callee
E return [result_set for result_set in it]
E ^^
E File "contrib/python/ydb/py3/ydb/_utilities.py", line 173, in __next__
E return self._next()
E ^^^^^^^^^^^^
E File "contrib/python/ydb/py3/ydb/_utilities.py", line 164, in _next
E res = self.wrapper(next(self.it))
E ^^^^^^^^^^^^^^^^^^^^^^^^^^^
E File "contrib/python/ydb/py3/ydb/query/session.py", line 371, in <lambda>
E lambda resp: base.wrap_execute_query_response(
E ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E File "contrib/python/ydb/py3/ydb/query/base.py", line 188, in decorator
E return func(rpc_state, response_pb, session_state, *args, **kwargs)
E ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E File "contrib/python/ydb/py3/ydb/query/base.py", line 206, in wrap_execute_query_response
E issues._process_response(response_pb)
E File "contrib/python/ydb/py3/ydb/issues.py", line 237, in _process_response
E raise exc_obj(_format_response(response_proto), response_proto.issues)
E ydb.issues.SchemeError: message: "Executing ESchemeOpCreateColumnTable" issue_code: 2003 severity: 1 issues { message: "Type \'Bool\' specified for column \'c0\', but support for bool is disabled (EnableColumnshardBool feature flag is off)" issue_code: 2003 severity: 1 } ,message: "Query invalidated on scheme/internal error during Scheme execution" issue_code: 2019 severity: 1 (server_code: 400070)
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/olap_workload/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/olap_workload/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbWorkload.test.log