Test results differ from canonical:
test_result['PoolStats'][0]['Threads']: value 6 is missing
test_result['PoolStats'][0]['Usage']: value 'number' is missing
test_result['PoolStats'][1]['Threads']: value 1 differs from canonical 9
test_result['PoolStats'][2]['Threads']: value 6 is missing
test_result['PoolStats'][2]['Usage']: value 'number' is missing
test_result['PoolStats'][4]['Threads']: value 3 is missing
test_result['PoolStats'][4]['Usage']: value 'number' is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_cluster.log

Test results differ from canonical:
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_nodes.log

Test results differ from canonical:
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_nodes_all.log

Test results differ from canonical:
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_nodes_issue_14992.log

Test results differ from canonical:
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_storage_nodes.log

Test results differ from canonical:
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_storage_nodes_all.log

Test results differ from canonical:
test_result['SystemStateInfo'][0]['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][0]['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][0]['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['SystemStateInfo'][0]['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][0]['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][0]['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['SystemStateInfo'][1]['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][1]['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][1]['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['SystemStateInfo'][1]['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][1]['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][1]['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['SystemStateInfo'][2]['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][2]['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][2]['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['SystemStateInfo'][2]['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][2]['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][2]['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_sysinfo.log

Test results differ from canonical:
test_result['TenantInfo'][0]['PoolStats'][0]['Threads']: value 2 is missing
test_result['TenantInfo'][0]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['TenantInfo'][0]['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['TenantInfo'][0]['PoolStats'][2]['Threads']: value 2 is missing
test_result['TenantInfo'][0]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['TenantInfo'][0]['PoolStats'][4]['Threads']: value 1 is missing
test_result['TenantInfo'][0]['PoolStats'][4]['Usage']: value 'number' is missing
test_result['TenantInfo'][1]['PoolStats'][0]['Threads']: value 2 is missing
test_result['TenantInfo'][1]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['TenantInfo'][1]['PoolStats'][1]['Threads']: value 3 is missing
test_result['TenantInfo'][1]['PoolStats'][1]['Usage']: value 'number' is missing
test_result['TenantInfo'][1]['PoolStats'][2]['Threads']: value 2 is missing
test_result['TenantInfo'][1]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['TenantInfo'][1]['PoolStats'][4]['Threads']: value 1 is missing
test_result['TenantInfo'][1]['PoolStats'][4]['Usage']: value 'number' is missing
test_result['TenantInfo'][3]['PoolStats'][0]['Threads']: value 2 is missing
test_result['TenantInfo'][3]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['TenantInfo'][3]['PoolStats'][1]['Threads']: value 3 is missing
test_result['TenantInfo'][3]['PoolStats'][1]['Usage']: value 'number' is missing
test_result['TenantInfo'][3]['PoolStats'][2]['Threads']: value 2 is missing
test_result['TenantInfo'][3]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['TenantInfo'][3]['PoolStats'][4]['Threads']: value 1 is missing
test_result['TenantInfo'][3]['PoolStats'][4]['Usage']: value 'number' is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_tenantinfo.log

Test results differ from canonical:
test_result['/Root']['TenantInfo'][0]['PoolStats'][0]['Threads']: value 2 is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['/Root']['TenantInfo'][0]['PoolStats'][2]['Threads']: value 2 is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][4]['Threads']: value 1 is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][4]['Usage']: value 'number' is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][0]['Threads']: value 2 is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][1]['Threads']: value 3 is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][1]['Usage']: value 'number' is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][2]['Threads']: value 2 is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][4]['Threads']: value 1 is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][4]['Usage']: value 'number' is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][0]['Threads']: value 2 is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][1]['Threads']: value 3 is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][1]['Usage']: value 'number' is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][2]['Threads']: value 2 is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][4]['Threads']: value 1 is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][4]['Usage']: value 'number' is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_tenantinfo_db.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/test_alloc_default.py.TestAlloc.test_hard_limit.kikimr0.log

ydb/tests/functional/config/test_distconf.py:222: in test_cluster_expand_with_seed_nodes
    tablet_ids = create_kv_tablets_and_wait_for_start(
ydb/tests/library/kv/helpers.py:65: in create_kv_tablets_and_wait_for_start
    assert_that(response.operation.status == StatusIds.SUCCESS)
E   AssertionError: Assertion failed

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/config/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/config/test-results/py3test/testing_out_stuff/test_distconf.py.TestKiKiMRDistConfBasic.test_cluster_expand_with_seed_nodes.log

Test crashed (return code: -6)
See logs for more info

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/kqp/kqp_indexes/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/kqp/kqp_indexes/test-results/unittest/testing_out_stuff/ConsistentIndexRead.InteractiveTx.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/kqp/kqp_indexes/test-results/unittest/testing_out_stuff/ConsistentIndexRead.InteractiveTx.out

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_clickbench.py.TestClickbench.test_clickbench.Query00.log

setup failed:
ydb/tests/functional/tpc/medium/test_diff_processing.py:75: in setup_class
    cls.run_cli(['workload', 'clickbench', '-p', 'olap_yatests/clickbench/hits', 'init', '--store=column'])
ydb/tests/functional/tpc/lib/conftest.py:60: in run_cli
    return yatest.common.execute(YdbCliHelper.get_cli_command() + argv)
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
    res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:411: in wait
    self._finalise(check_exit_code)
library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise
    raise ExecutionError(self)
E   yatest.common.process.ExecutionError: Command '/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/ydb/ydb -e grpc://localhost:24230 -d /local/test_db workload clickbench -p olap_yatests/clickbench/hits init --store=column' has failed with code 1.
E   Errors:
E   Status: UNAVAILABLE
E   Issues: 
E   <main>: Error: Database nodes resolve failed with no certain result, code: 200400
E   <main>: Error: Endpoint list is empty for database /local/test_db, cluster endpoint localhost:24230.

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_diff_processing.py.TestClickbenchDiffProcessing.test_clickbench.CheckCanonicalPolicy.ERROR.log

setup failed:
ydb/tests/functional/tpc/medium/test_diff_processing.py:75: in setup_class
    cls.run_cli(['workload', 'clickbench', '-p', 'olap_yatests/clickbench/hits', 'init', '--store=column'])
ydb/tests/functional/tpc/lib/conftest.py:60: in run_cli
    return yatest.common.execute(YdbCliHelper.get_cli_command() + argv)
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
    res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:411: in wait
    self._finalise(check_exit_code)
library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise
    raise ExecutionError(self)
E   yatest.common.process.ExecutionError: Command '/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/ydb/ydb -e grpc://localhost:24230 -d /local/test_db workload clickbench -p olap_yatests/clickbench/hits init --store=column' has failed with code 1.
E   Errors:
E   Status: UNAVAILABLE
E   Issues: 
E   <main>: Error: Database nodes resolve failed with no certain result, code: 200400
E   <main>: Error: Endpoint list is empty for database /local/test_db, cluster endpoint localhost:24230.

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_diff_processing.py.TestClickbenchDiffProcessing.test_clickbench.CheckCanonicalPolicy.NO.log

setup failed:
ydb/tests/functional/tpc/medium/test_diff_processing.py:75: in setup_class
    cls.run_cli(['workload', 'clickbench', '-p', 'olap_yatests/clickbench/hits', 'init', '--store=column'])
ydb/tests/functional/tpc/lib/conftest.py:60: in run_cli
    return yatest.common.execute(YdbCliHelper.get_cli_command() + argv)
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
    res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:411: in wait
    self._finalise(check_exit_code)
library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise
    raise ExecutionError(self)
E   yatest.common.process.ExecutionError: Command '/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/ydb/ydb -e grpc://localhost:24230 -d /local/test_db workload clickbench -p olap_yatests/clickbench/hits init --store=column' has failed with code 1.
E   Errors:
E   Status: UNAVAILABLE
E   Issues: 
E   <main>: Error: Database nodes resolve failed with no certain result, code: 200400
E   <main>: Error: Endpoint list is empty for database /local/test_db, cluster endpoint localhost:24230.

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_diff_processing.py.TestClickbenchDiffProcessing.test_clickbench.CheckCanonicalPolicy.WARNING.log

ydb/tests/olap/column_family/compression/alter_compression.py:113: in test_availability_data
    check_data(table=test_table, rows_cont=rows_count)
ydb/tests/olap/column_family/compression/alter_compression.py:93: in check_data
    result_set = self.ydb_client.query(f"SELECT * FROM `{table.path}` ORDER BY `value`")
ydb/tests/olap/common/ydb_client.py:24: in query
    return self.session_pool.execute_with_retries(statement)
contrib/python/ydb/py3/ydb/query/pool.py:204: in execute_with_retries
    return retry_operation_sync(wrapped_callee, retry_settings)
contrib/python/ydb/py3/ydb/retries.py:133: in retry_operation_sync
    for next_opt in opt_generator:
contrib/python/ydb/py3/ydb/retries.py:94: in retry_operation_impl
    result = YdbRetryOperationFinalResult(callee(*args, **kwargs))
contrib/python/ydb/py3/ydb/query/pool.py:202: in wrapped_callee
    return [result_set for result_set in it]
contrib/python/ydb/py3/ydb/_utilities.py:173: in __next__
    return self._next()
contrib/python/ydb/py3/ydb/_utilities.py:164: in _next
    res = self.wrapper(next(self.it))
contrib/python/ydb/py3/ydb/query/session.py:368: in <lambda>
    lambda resp: base.wrap_execute_query_response(
contrib/python/ydb/py3/ydb/query/base.py:180: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/query/base.py:198: in wrap_execute_query_response
    issues._process_response(response_pb)
contrib/python/ydb/py3/ydb/issues.py:229: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.BadRequest: message: "Table /Root/alter_compression/availability_data/test_table (shard 72075186224037944) scan failed, reason: cannot build metadata withno ranges/Snapshot too old: {1750423073000:max}. CS min read snapshot: {1750423074000:max}. now: 2025-06-20T12:37:59.068823Z" issue_code: 2017 severity: 1 (server_code: 400010)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/column_family/compression/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/column_family/compression/test-results/py3test/testing_out_stuff/alter_compression.py.TestAlterCompression.test_availability_data.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_result_limits.py::TestResultLimits::test_many_rows (good) duration: 246.06s
test_result_limits.py::TestResultLimits::test_large_row (good) duration: 78.53s
test_alloc_default.py::TestAlloc::test_node_limit[kikimr0] (good) duration: 57.13s
test_dc_local.py::TestAlloc::test_dc_locality[kikimr0] (good) duration: 33.56s
test_alloc_default.py::TestAlloc::test_default_delta[kikimr0] (good) duration: 33.36s
test_result_limits.py::TestResultLimits::test_quotas[kikimr0] (good) duration: 31.99s
test_alloc_default.py::TestAlloc::test_hard_limit[kikimr0] (timeout) duration: 27.83s
test_alloc_default.py::TestAlloc::test_default_limits[kikimr0] (good) duration: 27.13s
test_alloc_default.py::TestAlloc::test_alloc_and_free[kikimr0] (good) duration: 24.37s
test_alloc_default.py::TestAlloc::test_up_down[kikimr0] (good) duration: 23.42s
2 more tests with 20.53s total duration are not listed.
Info: Test run has exceeded 8.0G (8388608K) memory limit with 8.5G (8880484K) used. This may lead to test failure on the Autocheck/CI
You can increase test's ram requirement using REQUIREMENTS(ram:X) in the ya.make
   pid   rss   ref pdirt 
733578 45.1M 45.1M  6.5M test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
733701 33.7M 22.1M  9.7M    ├─ test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
740960  719M  720M 85.9M    │  └─ ydb-tests-fq-mem_alloc --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --doctest
818894  644M 21.8M 78.7M    │     ├─ ydb-tests-fq-mem_alloc --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --doct
818895  1.4G  1.4G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/test
818898  1.4G  1.4G  1.1G    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/test
818900  1.4G  1.3G  950M    │     ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/test
818902  1.4G  1.4G  1.0G    │     └─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/test
733810  2.0G  2.1G  1.5G    └─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/ydb_data_c

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/fq/mem_alloc/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_tpch.py.TestTpchS1.test_tpch.1.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_alter_compression.py.TestAlterCompression.test.alter_compression.log

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_upload.py::TestUploadTpchS1::test (timeout) duration: 625.21s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_upload.py.TestUploadTpchS1.test.log

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_tpch_import.py::TestS3TpchImport::test_import_and_export (timeout) duration: 628.00s
Info: Test run has exceeded 8.0G (8388608K) memory limit with 11.3G (11871860K) used. This may lead to test failure on the Autocheck/CI
You can increase test's ram requirement using REQUIREMENTS(ram:X) in the ya.make
   pid   rss   ref pdirt 
733588 45.1M 45.1M  6.5M test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
733719 38.9M 27.1M 14.9M    └─ test_tool run_test @/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ya_command_file_0.args
733733  607M  610M  525M       └─ ydb-tests-olap-s3_import --basetemp /home/runner/actions_runner/_work/ydb/ydb/tmp/out/tmp --capture no -c pkg:library.python.pytest:pytest.yatest.ini -p no:factor --docte
734471  7.5G  7.6G  7.0G          ├─ ydbd server --suppress-version-check --yaml-config=/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/s3_import/test-results/py3test/testing_out_stuff/te
741506  385M  385M  351M          ├─ moto_server s3 --port 6291
753410  2.7G  2.7G  2.6G          └─ ydb -e grpc://localhost:15015 -d /Root workload tpch import generator --scale 1

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/s3_import/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/s3_import/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/s3_import/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_alter_compression.py::TestAlterCompression::test[alter_compression] (timeout) duration: 619.48s
test_alter_compression.py::TestAlterCompression::test_multi[alter_compression] test was not launched inside chunk.

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/stderr

ydb/tests/stress/olap_workload/tests/test_workload.py:19: in test
    yatest.common.execute([
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
    res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:411: in wait
    self._finalise(check_exit_code)
library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise
    raise ExecutionError(self)
E   yatest.common.process.ExecutionError: Command '/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/olap_workload/olap_workload --endpoint grpc://localhost:4164 --database /Root --duration 120' has failed with code 1.
E   Errors:
E   FATAL: Failed to attach session
E   Traceback: File "contrib/tools/python3/Lib/threading.py", line 1032, in _bootstrap
E       self._bootstrap_inner()File "contrib/tools/python3/Lib/threading.py", line 1075, in _bootstrap_inner
E       self.run()File "contrib/tools/python3/Lib/threading.py", line 1012, in run
E       self._target(*self._args, **self._kwargs)File "ydb/tests/stress/common/common.py", line 102, in <lambda>
E       t = threading.Thread(target=lambda: wrapper(f))File "ydb/tests/stress/common/common.py", line 96, in wrapper
E       for line in traceback.format_stack():

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/olap_workload/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/olap_workload/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbWorkload.test.log

teardown failed:
ydb/tests/functional/postgresql/test_postgres.py:77: in teardown_class
    cls.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:606: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/postgresql/test-results/py3test/testing_out_stuff/test_postgres.py.TestPostgresSuite.test_postgres_suite.strings/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/postgresql/test-results/py3test/testing_out_stuff/test_postgres.py.TestPostgresSuite.test_postgres_suite.strings/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   Current KQP shutdown state: spent 0 seconds, not started yet
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   
E   =================================================================
E   ==734277==ERROR: LeakSanitizer: detected memory leaks
E   
E   Indirect leak of 27440 byte(s) in 7 object(s) allocated from:
E   #0 0x1e1e164d in operator new(unsigned long) /-S/contrib/libs/clang18-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x4506b40f in MakeIntrusive<NYql::TYtVersionedConfiguration, TDefaultIntrusivePtrOps<NYql::TYtVersionedConfiguration>, NYql::TTypeAnnotationContext &> /-S/util/generic/ptr.h:834:12
E   #2 0x4506b40f in NYql::TYtState::TYtState(NYql::TTypeAnnotationContext*) /-S/yt/yql/providers/yt/provider/yql_yt_provider.h:102:25
E   #3 0x4505cdd9 in MakeIntrusive<NYql::TYtState, TDefaultIntrusivePtrOps<NYql::TYtState>, NYql::TTypeAnnotationContext *> /-S/util/generic/ptr.h:834:16
E   #4 0x4505cdd9 in NYql::CreateYtNativeState(TIntrusivePtr<NYql::IYtGateway, TDefaultIntrusivePtrOps<NYql::IYtGateway>>, TBasicString<char, std::__y1::char_traits<char>> const&, TBasicString<char, std::__y1::char_traits<char>> const&, NYql::TYtGatewayConfig const*, TIntrusivePtr<NYql::TTypeAnnotationContext, TDefaultIntrusivePtrOps<NYql::TTypeAnnotationContext>>, std::__y1::shared_ptr<NYql::IOptimizerFactory> const&, std::__y1::shared_ptr<NYql::IDqHelper> const&) /-S/yt/yql/providers/yt/provider/yql_yt_provider.cpp:345:20
E   #5 0x4cc00df9 in InitYtProvider /-S/ydb/core/kqp/host/kqp_host.cpp:1880:38
E   #6 0x4cc00df9 in NKikimr::NKqp::(anonymous namespace)::TKqpHost::Init(NYql::EKikimrQueryType) /-S/ydb/core/kqp/host/kqp_host.cpp:1961:17
E   #7 0x4cbfd3a0 in NKikimr::NKqp::(anonymous namespace)::TKqpHost::SetupSession(NYql::EKikimrQueryType) /-S/ydb/core/kqp/host/kqp_host.cpp:2062:9
E   #8 0x4cbf9dd8 in NKikimr::NKqp::(anonymous namespace)::TKqpHost::SetupYqlTransformer(NYql::EKikimrQueryType) /-S/ydb/core/kqp/host/kqp_host.cpp:2077:9
E   #9 0x4cc64884 in NKikimr::NKqp::(anonymous namespace)::TKqpHost::PrepareQueryInternal(NKikimr::NKqp::TKqpQueryRef const&, TIntrusivePtr<NYql::TExprNode, TDefaultIntrusivePtrOps<NYql::TExprNode>>, NYql::EKikimrQueryType, NKikimr::NKqp::IKqpHost::TPrepareSettings const&, NYql::TExprContext&) /-S/ydb/core/kqp/host/kqp_host.cpp:1605:9
E   #10 0x4cbe8b9f in operator() /-S/ydb/core/kqp/host/kqp_host.cpp:1239:24
E   #11 0x4cbe8b9f in CheckedProcess<NYql::IKikimrGateway::TQueryResult, (lambda at /-S/ydb/core/kqp/host/kqp_host.cpp:1238:13) &> /-S/ydb/core/kqp/host/kqp_host.cpp:830:28
E   #12 0x4cbe8b9f in CheckedProcessQuery<(lambda at /-S/ydb/core/kqp/host/kqp_host.cpp:1238:13)> /-S/ydb/core/kqp/host/kqp_host.cpp:853:12
E   #13 0x4cbe8b9f in NKikimr::NKqp::(anonymous namespace)::TKqpHost::PrepareGenericQuery(NKikimr::NKqp::TKqpQueryRef const&, NKikimr::NKqp::IKqpHost::TPrepareSettings const&, TIntrusivePtr<NYql::TExprNode, TDefaultIntrusivePtrOps<NYql::TExprNode>>) /-S/ydb/core/kqp/host/kqp_host.cpp:1237:16
E   #14 0x4c7f93ff in NKikimr::NKqp::TKqpCompileActor::StartCompilation(NActors::TActorContext const&) /-S/ydb/core/kqp/compile_service/kqp_compile_actor.cpp:273:47
E   #15 0x4c7f70c7 in Bootstrap /-S/ydb/core/kqp/compile_service/kqp_compile_actor.cpp:110:17
E   #16 0x4c7f70c7 in NActors::TActorBootstrapped<NKikimr::NKqp::TKqpCompileActor>::StateBootstrap(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor_bootstrapped.h:22:22
E   #17 0x20da55bc in NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&) /-S/ydb/library/actors/core/actor.cpp:280:13
E   #18 0x20e52fe4 in NActors::TExecutorThread::Execute(NActors::TMailbox*, bool) /-S/ydb/library/actors/core/executor_thread.cpp:269:28
E   #19 0x20e5bd0e in NActors::TExecutorThread::ProcessExecutorPool()::$_0::operator()(NActors::TMailbox*, bool) const /-S/ydb/library/actors/core/executor_thread.cpp:460:39
E   #20 0x20e5b269 in NActors::TExecutorThread::ProcessExecutorPool() /-S/ydb/library/actors/core/executor_thread.cpp:512:13
E   #21 0x20e5d2be in NActors::TExecutorThread::ThreadProc() /-S/ydb/library/actors/core/executor_thread.cpp:538:9
E   #22 0x1e4fb764 in (anonymous namespace)::TPosixThread::ThreadProxy(void*) /-S/util/system/thread.cpp:245:20
E   #23 0x1e1ab608 in asan_thread_start(void*) /-S/contrib/libs/clang18-rt/lib/asan/asan_interceptors.cpp:239:28
E   
E   Indirect leak of 21896 byte(s) in 7 object(s) allocated from:
E   #0 0x1e1e164d in operator new(unsigned long) /-S/contrib/libs/clang18-rt/lib/asan/asan_new_delete.cpp:86:3
E   #1 0x44e59b46 in __libcpp_operator_new<unsigned long> /-S/contrib/libs/cxxsupp/libcxx/include/new:271:10
E   #2 0x44e59b46 in __libcpp_allocate /-S/contrib/libs/cxxsupp/libcxx/include/new:295:10
E   #3 0x44e59b46 in allocate /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:103:32
E   #4 0x44e59b46 in initialize_dynamic /-S/util/generic/hash_table.h:233:35
E   #5 0x44e59b46 in initialize_buckets_dynamic /-S/util/generic/hash_table.h:906:17
E   #6 0x44e59b46 in THashTable<std::__y1::pair<TBasicString<char, std::__y1::char_traits<char>> const, TIntrusivePtr<NYql::NCommon::TSettingDispatcher::TSettingHandler, TDefaultIntrusivePtrOps<NYql::NCommon::TSettingDispatcher::TSettingHandler>>>, TBasicString<char, std::__y1::char_traits<char>>, THash<TBasicString<char, std::__y1::char_traits<char>>>, TSelect1st, TEqualTo<TBasicString<char, std::__y1::char_traits<char>>>, std::__y1::allocator<TBasicString<char, std::__y1::char_traits<char>>>>::reserve(unsigned long) /-S/util/generic/hash_table.h:1324:13
E   #7 0x44e3e8b6 in insert_unique<std::__y1::pair<const TBasicString<char, std::__y1::char_traits<char> >, TIntrusivePtr<NYql::NCommon::TSettingDispatcher::TSettingHandler, TDefaultIntrusivePtrOps<NYql::NCommon::TSettingDispatcher::TSettingHandler> > > > /-S/util/generic/hash_table.h:673:9
E   #8 0x44e3e8b6 in insert /-S/util/generic/hash.h:154:20
E   #9 0x44e3e8b6 in NYql::NCommon::TSettingDispatcher::TSettingHandlerImpl<bool, (NYql::NCommon::EConfSettingType)2>& NYql::NCommon::TSettingDispatcher::AddSetting<bool, (NYql::NCommon::EConfSettingType)2>(TBasicString<char, std::__y1::char_traits<char>> const&, NYql::NCommon::TConfSetting<bool, (NYql::NCommon::EConfSettingType)2>&) /-S/yql/essentials/providers/common/config/yql_dispatch.h:355:23
E   #10 0x44e1e053 in NYql::TYtConfiguration::TYtConfiguration(NYql::TTypeAnnotationContext&) /-S/yt/yql/providers/yt/common/yql_yt_settings.cpp:472:5
E   #11 0x4506b420 in TYtVersionedConfiguration /-S/yt/yql/providers/yt/common/yql_yt_settings.h:388:11
E   #12 0x4506b420 in MakeIntrusive<NYql::TYtVersionedConfiguration, TDefaultIntrusivePtrOps<NYql::TYtVersionedConfiguration>, NYql::TTypeAnnotationContext &> /-S/util/generic/ptr.h:834:16
E   #13 0x4506b420 in NYql::TYtState::TYtState(NYql::TTypeAnnotationContext*) /-S/yt/yql/providers/yt/provider/yql_yt_provider.h:102:25
E   #14 0x4505cdd9 in MakeIntrusive<NYql::TYtState, TDefaultIntrusivePtrOps<NYql::TYtState>, NYql::TTypeAnnotationContext *> /-S/util/generic/ptr.h:834:16
E   #15 0x4505cdd9 in NYql::CreateYtNati...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/postgresql/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/postgresql/test-results/py3test/testing_out_stuff/test_postgres.py.TestPostgresSuite.test_postgres_suite.strings.log

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_clickbench.py::TestClickbench::test_clickbench[Query00] (timeout) duration: 626.38s
129 tests were not launched inside chunk.

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout, failed to shutdown gracefully in 30s and was terminated using SIGQUIT signal
List of the tests involved in the launch:
test_tpch.py::TestTpchS1::test_tpch[1] (timeout) duration: 624.70s
21 tests were not launched inside chunk.

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_delete_by_explicit_row_id.py::TestDeleteByExplicitRowId::test_delete_row_by_explicit_row_id (timeout) duration: 618.09s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/delete/test-results/py3test/testing_out_stuff/test_delete_by_explicit_row_id.py.TestDeleteByExplicitRowId.test_delete_row_by_explicit_row_id.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/s3_import/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/s3_import/test-results/py3test/testing_out_stuff/test_tpch_import.py.TestS3TpchImport.test_import_and_export.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
ttl_delete_s3.py::TestDeleteS3Ttl::test_delete_s3_tiering (timeout) duration: 361.41s
ttl_delete_s3.py::TestDeleteS3Ttl::test_data_unchanged_after_ttl_change (good) duration: 250.80s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff/stderr

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
ttl_delete_s3.py::TestDeleteTtl::test_ttl_delete (timeout) duration: 613.73s

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff/stderr

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff/ttl_delete_s3.py.TestDeleteTtl.test_ttl_delete.log

Test results differ from canonical:
test_result['response_last_offset']['Messages'][4]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][5]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][6]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][7]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][8]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':..., test_result['response_last_offset']['Messages'][9]: extra value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_topic_data.log

ydb/tests/functional/hive/test_drain.py:93: in test_drain_on_stop
    wait_tablets_are_active(
ydb/tests/library/common/delayed.py:151: in wait_tablets_are_active
    predicate(raise_error=True)
ydb/tests/library/common/delayed.py:141: in predicate
    raise AssertionError(
E   AssertionError: 
E   ##############################
E   0 seconds passed, 117 tablet(s) are not active. Inactive tablets are (first 10 entries): (72075186224037888: 6) (72075186224037893: 6) (72075186224037899: 4) (72075186224037908: 4) (72075186224037920: 6) (72075186224037936: 6) (72075186224037953: 6) (72075186224037955: 6) (72075186224037969: 6) (72075186224037987: 4). Additional info is empty
E   ##############################

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/hive/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/hive/test-results/py3test/testing_out_stuff/test_drain.py.TestHive.test_drain_on_stop.log

Test results differ from canonical:
test_result['1-get']['children'][2]['created_at']['plan_step']: value 'not-zero-number-text' is missing
test_result['1-get']['children'][2]['created_at']['tx_id']: value 'not-zero-number-text' is missing
test_result['1-get']['children'][2]['name']: - topic1
+ .sys
test_result['1-get']['children'][2]['owner']: value 'root@builtin' is missing
test_result['1-get']['children'][2]['type']: - TOPIC
+ DIRECTORY
test_result['1-get']['children'][3]: value {'created_at': {}, 'name': '.sys', 'type': 'DIRECTORY'} is missing
test_result['1-get']['self']['owner']: - user1
+ root@builtin
test_result['1-get']['self']['size_bytes']: value 'not-zero-number-text' is missing
test_result['3-get']['children'][3]['created_at']['plan_step']: value 'not-zero-number-text' is missing
test_result['3-get']['children'][3]['created_at']['tx_id']: value 'not-zero-number-text' is missing
test_result['3-get']['children'][3]['name']: - topic1
+ .sys
test_result['3-get']['children'][3]['owner']: value 'root@builtin' is missing
test_result['3-get']['children'][3]['type']: - TOPIC
+ DIRECTORY
test_result['3-get']['children'][4]: value {'created_at': {}, 'name': '.sys', 'type': 'DIRECTORY'} is missing
test_result['3-get']['self']['owner']: - user1
+ root@builtin
test_result['3-get']['self']['size_bytes']: value 'not-zero-number-text' is missing
test_result['5-get']['children'][2]['created_at']['plan_step']: value 'not-zero-number-text' is missing
test_result['5-get']['children'][2]['created_at']['tx_id']: value 'not-zero-number-text' is missing
test_result['5-get']['children'][2]['name']: - topic1
+ .sys
test_result['5-get']['children'][2]['owner']: value 'root@builtin' is missing
test_result['5-get']['children'][2]['type']: - TOPIC
+ DIRECTORY
test_result['5-get']['children'][3]: value {'created_at': {}, 'name': '.sys', 'type': 'DIRECTORY'} is missing
test_result['5-get']['self']['owner']: - user1
+ root@builtin
test_result['5-get']['self']['size_bytes']: value 'not-zero-number-text' is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_scheme_directory.log

ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
    IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
    return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
    res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
    yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
    return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
    raise self._exception
contrib/python/ydb/py3/ydb/connection.py:105: in _on_response_callback
    response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
    issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:229: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)

During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
    with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E   AssertionError: Regex pattern did not match.
E    Regex: '.*DISK_SPACE_EXHAUSTED.*'
E    Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--false.log

ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
    IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
    return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
    res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
    yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
    return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
    raise self._exception
contrib/python/ydb/py3/ydb/connection.py:105: in _on_response_callback
    response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
    issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:229: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--true_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)

During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
    with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E   AssertionError: Regex pattern did not match.
E    Regex: '.*DISK_SPACE_EXHAUSTED.*'
E    Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--true_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--true.log

ydb/tests/olap/load/lib/workload_oltp.py:29: in test_workload_oltp
    self.execute_workload_test(
ydb/tests/olap/load/lib/workload_executor.py:224: in execute_workload_test
    return self._execute_workload_with_deployment(
ydb/tests/olap/load/lib/workload_executor.py:251: in _execute_workload_with_deployment
    final_result = self._finalize_workload_results(
ydb/tests/olap/load/lib/workload_executor.py:358: in _finalize_workload_results
    self.process_workload_result_with_diagnostics(overall_result, workload_name, False)
ydb/tests/olap/load/lib/conftest.py:757: in process_workload_result_with_diagnostics
    raise exc
E   Failed: WORKLOAD EXECUTION FAILED: OltpWorkload
E   Main error: All 1 runs failed to execute successfully
E   
E   Execution details:
E   Total iterations attempted: 1
E   
E   FAILED ITERATIONS (1):
E     - Iteration 1: Workload execution failed. stderr: FATAL: exceptions must derive from BaseException
E   Traceback: File "contrib/tools/python3/Lib/threading.py", line 1032, in _bootstrap
E       self._bootstrap_inner()File "contrib/tools/python3/Lib/threading.py", line 1075, in _bootstrap_inner
E       self.run()File "contrib/tools/python3/Lib/threading.py", line 1012, in run
E       self._target(*self._args, **self._kwargs)File "ydb/tests/stress/common/common.py", line 102, in <lambda>
E       t = threading.Thread(target=lambda: wrapper(f))File "ydb/tests/stress/common/common.py", line 96, in wrapper
E       for line in traceback.format_stack():
E    (time: 3.5s)
E   
E   STDERR (last 500 chars):
E   .../python3/Lib/threading.py", line 1032, in _bootstrap
E       self._bootstrap_inner()File "contrib/tools/python3/Lib/threading.py", line 1075, in _bootstrap_inner
E       self.run()File "contrib/tools/python3/Lib/threading.py", line 1012, in run
E       self._target(*self._args, **self._kwargs)File "ydb/tests/stress/common/common.py", line 102, in <lambda>
E       t = threading.Thread(target=lambda: wrapper(f))File "ydb/tests/stress/common/common.py", line 96, in wrapper
E       for line in traceback.format_stack():
E   
E   RUN STATISTICS:
E     Successful runs: 0/1
E     Failed runs: 1
E     Success rate: 0.0%

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_workload_oltp.py.TestWorkloadSimpleQueue.test_workload_oltp.log

ydb/tests/olap/scenario/conftest.py:125: in test
    raise errors[0]
ydb/tests/olap/scenario/conftest.py:84: in worker
    self._test_suffix(local_ctx, suffix, codes, idx)
ydb/tests/olap/scenario/conftest.py:135: in _test_suffix
    ctx.executable(self, ctx)
ydb/tests/olap/scenario/test_alter_tiering.py:357: in scenario_many_tables
    threads.start_and_wait_all()
ydb/tests/olap/common/thread_helper.py:49: in start_and_wait_all
    self.join_all()
ydb/tests/olap/common/thread_helper.py:45: in join_all
    thread.join(timeout=timeout)
ydb/tests/olap/common/thread_helper.py:18: in join
    raise self.exc
ydb/tests/olap/common/thread_helper.py:11: in run
    self.ret = self._target(*self._args, **self._kwargs)
ydb/tests/olap/scenario/test_alter_tiering.py:245: in _loop_scan
    sth.execute_scan_query(
ydb/tests/olap/scenario/helpers/scenario_tests_helper.py:476: in execute_scan_query
    for result_set in it:
contrib/python/ydb/py3/ydb/_utilities.py:173: in __next__
    return self._next()
contrib/python/ydb/py3/ydb/_utilities.py:164: in _next
    res = self.wrapper(next(self.it))
contrib/python/ydb/py3/ydb/table.py:1212: in <lambda>
    lambda resp: _wrap_scan_query_response(resp, self._table_client_settings),
contrib/python/ydb/py3/ydb/table.py:982: in _wrap_scan_query_response
    issues._process_response(response)
contrib/python/ydb/py3/ydb/issues.py:229: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.GenericError: message: "Scan failed at tablet 72075186224037902, reason: task_error:Error reading blob range for data: { Blob: DS:4294967295:[72075186224037902:1:1:255:1:3840:0] Offset: 0 Size: 3840 }, error: cannot get blob: curlCode: 28, Timeout was reached, detailed error: , curlCode: 28, Timeout was reached, status: ERROR" issue_code: 2013 severity: 1 (server_code: 400080)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/scenario/test-results/py3test/testing_out_stuff/test_alter_tiering.py.TestAlterTiering.test.many_tables.log

Killed by timeout (600 s)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/ttl_tiering/test-results/py3test/testing_out_stuff/ttl_delete_s3.py.TestDeleteS3Ttl.test_delete_s3_tiering.log

ydb/tests/stress/log/tests/test_workload.py:76: in test
    yatest.common.execute(command, wait=True)
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
    res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:411: in wait
    self._finalise(check_exit_code)
library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise
    raise ExecutionError(self)
E   yatest.common.process.ExecutionError: Command '/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/ydb/ydb --verbose --endpoint grpc://localhost:8394 --database=/Root workload log import --bulk-size 1000 -t 1 generator --path column --int-cols 2 --str-cols 5 --key-cols 4 --len 200 --rows 100000' has failed with code 1.
E   Errors:
E   ...nt ghrun-xo477clzvi.auto.internal:8394
E   
E   Bulk upset to /Root/column failed, TRANSPORT_UNAVAILABLE, <main>: Error: GRpc error: (14): recvmsg:Connection reset by peer
E   <main>: Error: Grpc error response on endpoint ghrun-xo477clzvi.auto.internal:8394
E   
E   Bulk upset to /Root/column failed, TRANSPORT_UNAVAILABLE, <main>: Error: GRpc error: (14): recvmsg:Connection reset by peer
E   <main>: Error: Grpc error response on endpoint ghrun-xo477clzvi.auto.internal:8394
E   
E   Bulk upset to /Root/column failed, TRANSPORT_UNAVAILABLE, <main>: Error: GRpc error: (14): recvmsg:Connection reset by peer
E   <main>: Error: Grpc error response on endpoint ghrun-xo477clzvi.auto.internal:8394
E   
E   Bulk upset to /Root/column failed, TRANSPORT_UNAVAILABLE, <main>: Error: GRpc error: (14): recvmsg:Connection reset by peer
E   <main>: Error: Grpc error response on endpoint ghrun-xo477clzvi.auto.internal:8394
E   
E   Bulk upset to /Root/column failed, TRANSPORT_UNAVAILABLE, <main>: Error: GRpc error: (14): recvmsg:Connection reset by peer
E   <main>: Error: Grpc error response on endpoint ghrun-xo477clzvi.auto.internal:8394
E   
E   Bulk upset to /Root/column failed, TRANSPORT_UNAVAILABLE, <main>: Error: GRpc error: (14): recvmsg:Connection reset by peer
E   <main>: Error: Grpc error response on endpoint ghrun-xo477clzvi.auto.internal:8394
E   
E   Bulk upset to /Root/column failed, TRANSPORT_UNAVAILABLE, <main>: Error: GRpc error: (14): recvmsg:Connection reset by peer
E   <main>: Error: Grpc error response on endpoint ghrun-xo477clzvi.auto.internal:8394teardown failed:
ydb/tests/stress/log/tests/test_workload.py:41: in teardown_class
    cls.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:606: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Unexpectedly finished before stop.
E   Process exit_code = 100.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbLogWorkload.test.column/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbLogWorkload.test.column/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   =================================================================
E   ==815894==ERROR: AddressSanitizer: heap-use-after-free on address 0x503007d0f689 at pc 0x00001e3875a3 bp 0x7fec39deff40 sp 0x7fec39deff38
E   READ of size 1 at 0x503007d0f689 thread T49 (ydbd.Shared)
E   warning: address range table at offset 0x10c0 has a premature terminator entry at offset 0x10d0
E   #0 0x1e3875a2 in SafeReadUTF8Char<(StrictUTF8)1> /-S/util/charset/utf8.h:196:31
E   #1 0x1e3875a2 in UTF8Detect(char const*, unsigned long) /-S/util/charset/utf8.cpp:140:28
E   #2 0x4e2db7e0 in UTF8Detect /-S/util/charset/utf8.h:415:12
E   #3 0x4e2db7e0 in NKikimr::NKqp::NOpt::(anonymous namespace)::(anonymous namespace)::RemoveJsonPathUnnecessaryQuote(NYql::NNodes::NGenerated::TCoUtf8Stub<NYql::NNodes::TExprBase, NYql::NNodes::NGenerated::TCoDataCtorStub<NYql::NNodes::TExprBase, NYql::NNodes::TCallable, NYql::NNodes::TCoAtom>> const&, NYql::TExprContext&) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:320:9
E   #4 0x4e2d7406 in NKikimr::NKqp::NOpt::(anonymous namespace)::ConvertComparisonNode(NYql::NNodes::TExprBase const&, NYql::TExprNode const&, NYql::TExprContext&, NYql::TPositionHandle, bool)::$_0::operator()(NYql::NNodes::TExprBase const&) const /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:367:23
E   #5 0x4e2d4711 in NKikimr::NKqp::NOpt::(anonymous namespace)::ConvertComparisonNode(NYql::NNodes::TExprBase const&, NYql::TExprNode const&, NYql::TExprContext&, NYql::TPositionHandle, bool) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:457:35
E   #6 0x4e2e0ab0 in NKikimr::NKqp::NOpt::(anonymous namespace)::ExtractComparisonParameters(NYql::NNodes::NGenerated::TCoCompareStub<NYql::NNodes::TExprBase, NYql::NNodes::TCallable> const&, NYql::TExprNode const&, NYql::TExprContext&, NYql::TPositionHandle, bool) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:164:17
E   #7 0x4e2d8341 in NKikimr::NKqp::NOpt::(anonymous namespace)::ConvertComparisonNode(NYql::NNodes::TExprBase const&, NYql::TExprNode const&, NYql::TExprContext&, NYql::TPositionHandle, bool)::$_0::operator()(NYql::NNodes::TExprBase const&) const /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:423:37
E   #8 0x4e2d4711 in NKikimr::NKqp::NOpt::(anonymous namespace)::ConvertComparisonNode(NYql::NNodes::TExprBase const&, NYql::TExprNode const&, NYql::TExprContext&, NYql::TPositionHandle, bool) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:457:35
E   #9 0x4e2d0751 in NKikimr::NKqp::NOpt::(anonymous namespace)::ExtractBinaryFunctionParameters(NYql::NNodes::TExprBase const&, NYql::TExprNode const&, NYql::TExprContext&, NYql::TPositionHandle, bool) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:128:23
E   #10 0x4e2c6e7b in NKikimr::NKqp::NOpt::(anonymous namespace)::CoalescePushdown(NYql::NNodes::NGenerated::TCoCoalesceStub<NYql::NNodes::TExprBase, NYql::NNodes::TCallable> const&, NYql::TExprNode const&, NYql::TExprContext&, bool) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:185:29
E   #11 0x4e2b1b41 in NKikimr::NKqp::NOpt::(anonymous namespace)::PredicatePushdown(NYql::NNodes::TExprBase const&, NYql::TExprNode const&, NYql::TExprContext&, NYql::TPositionHandle, bool) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:663:29
E   #12 0x4e2a2e8b in NKikimr::NKqp::NOpt::KqpPushOlapFilter(NYql::NNodes::TExprBase, NYql::TExprContext&, NKikimr::NKqp::NOpt::TKqpOptimizeContext const&, NYql::TTypeAnnotationContext&) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy_olap_filter.cpp:831:39
E   #13 0x4e108699 in NKikimr::NKqp::NOpt::TKqpPhysicalOptTransformer::PushOlapFilter(NYql::NNodes::TExprBase, NYql::TExprContext&) /-S/ydb/core/kqp/opt/physical/kqp_opt_phy.cpp:235:28
E   #14 0x4e156068 in std::__y1::function<NYql::NNodes::TMaybeNode<NYql::NNodes::TExprBase> (NYql::NNodes::TExprBase, NYql::TExprContext&, NYql::IOptimizationContext&, std::__y1::function<std::__y1::unordered_map<NYql::TExprNode const*, std::__y1::unordered_set<NYql::TExprNode const*, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<NYql::TExprNode const*>>, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<std::__y1::pair<NYql::TExprNode const* const, std::__y1::unordered_set<NYql::TExprNode const*, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<NYql::TExprNode const*>>>>> const* ()> const&)> NYql::TOptimizeTransformerBase::Hndl<NKikimr::NKqp::NOpt::TKqpPhysicalOptTransformer>(NYql::NNodes::TMaybeNode<NYql::NNodes::TExprBase> (NKikimr::NKqp::NOpt::TKqpPhysicalOptTransformer::*)(NYql::NNodes::TExprBase, NYql::TExprContext&))::'lambda'(NYql::NNodes::TExprBase, NYql::TExprContext&, NYql::IOptimizationContext&, std::__y1::function<std::__y1::unordered_map<NYql::TExprNode const*, std::__y1::unordered_set<NYql::TExprNode const*, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<NYql::TExprNode const*>>, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<std::__y1::pair<NYql::TExprNode const* const, std::__y1::unordered_set<NYql::TExprNode const*, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<NYql::TExprNode const*>>>>> const* ()> const&)::operator()(NYql::NNodes::TExprBase, NYql::TExprContext&, NYql::IOptimizationContext&, std::__y1::function<std::__y1::unordered_map<NYql::TExprNode const*, std::__y1::unordered_set<NYql::TExprNode const*, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<NYql::TExprNode const*>>, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<std::__y1::pair<NYql::TExprNode const* const, std::__y1::unordered_set<NYql::TExprNode const*, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<NYql::TExprNode const*>>>>> const* ()> const&) const /-S/yql/essentials/providers/common/transform/yql_optimize.h:86:20
E   #15 0x4e155c57 in decltype(std::declval<NKikimr::NKqp::NOpt::TKqpPhysicalOptTransformer>()(std::declval<NYql::NNodes::TExprBase>(), std::declval<NYql::TExprContext&>(), std::declval<NYql::IOptimizationContext&>(), std::declval<std::__y1::function<std::__y1::unordered_map<NYql::TExprNode const*, std::__y1::unordered_set<NYql::TExprNode const*, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<NYql::TExprNode const*>>, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<std::__y1::pair<NYql::TExprNode const* const, std::__y1::unordered_set<NYql::TExprNode const*, std::__y1::hash<NYql::TExprNode const*>, std::__y1::equal_to<NYql::TExprNode const*>, std::__y1::allocator<NYql::TExprNode const*>>>>> const* ()> const&>())) std::__y1::__invoke[abi:fe200000]<std::__y1::function<NYql::NNodes::TMaybeNode<NYql::NNodes::TExprBase...

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/log/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbLogWorkload.test.column.log