Test results differ from canonical:
test_result['PoolStats'][0]['Threads']: value 6 is missing
test_result['PoolStats'][0]['Usage']: value 'number' is missing
test_result['PoolStats'][1]['Threads']: value 1 differs from canonical 9
test_result['PoolStats'][2]['Threads']: value 6 is missing
test_result['PoolStats'][2]['Usage']: value 'number' is missing
test_result['PoolStats'][4]['Threads']: value 3 is missing
test_result['PoolStats'][4]['Usage']: value 'number' is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_cluster.log

Test results differ from canonical:
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_nodes.log

Test results differ from canonical:
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_nodes_all.log

Test results differ from canonical:
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][1]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['response_group']['Nodes'][2]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_nodes_issue_14992.log

Test results differ from canonical:
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_storage_nodes.log

Test results differ from canonical:
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/dedicated_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/serverless_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['/Root/shared_db']['Nodes'][0]['SystemState']['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_storage_nodes_all.log

Test results differ from canonical:
test_result['SystemStateInfo'][0]['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][0]['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][0]['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['SystemStateInfo'][0]['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][0]['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][0]['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['SystemStateInfo'][1]['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][1]['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][1]['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['SystemStateInfo'][1]['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][1]['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][1]['PoolStats'][4]['Threads']: value 0 differs from canonical 1
test_result['SystemStateInfo'][2]['PoolStats'][0]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][2]['PoolStats'][0]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][2]['PoolStats'][1]['Threads']: value 0 differs from canonical 3
test_result['SystemStateInfo'][2]['PoolStats'][2]['Limit']: canonical results type differs from test results: expected <class 'str'> ('not-zero-number'), got <class 'int'> (0)
test_result['SystemStateInfo'][2]['PoolStats'][2]['Threads']: value 0 differs from canonical 2
test_result['SystemStateInfo'][2]['PoolStats'][4]['Threads']: value 0 differs from canonical 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_sysinfo.log

Test results differ from canonical:
test_result['TenantInfo'][0]['PoolStats'][0]['Threads']: value 2 is missing
test_result['TenantInfo'][0]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['TenantInfo'][0]['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['TenantInfo'][0]['PoolStats'][2]['Threads']: value 2 is missing
test_result['TenantInfo'][0]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['TenantInfo'][0]['PoolStats'][4]['Threads']: value 1 is missing
test_result['TenantInfo'][0]['PoolStats'][4]['Usage']: value 'number' is missing
test_result['TenantInfo'][1]['PoolStats'][0]['Threads']: value 2 is missing
test_result['TenantInfo'][1]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['TenantInfo'][1]['PoolStats'][1]['Threads']: value 3 is missing
test_result['TenantInfo'][1]['PoolStats'][1]['Usage']: value 'number' is missing
test_result['TenantInfo'][1]['PoolStats'][2]['Threads']: value 2 is missing
test_result['TenantInfo'][1]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['TenantInfo'][1]['PoolStats'][4]['Threads']: value 1 is missing
test_result['TenantInfo'][1]['PoolStats'][4]['Usage']: value 'number' is missing
test_result['TenantInfo'][3]['PoolStats'][0]['Threads']: value 2 is missing
test_result['TenantInfo'][3]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['TenantInfo'][3]['PoolStats'][1]['Threads']: value 3 is missing
test_result['TenantInfo'][3]['PoolStats'][1]['Usage']: value 'number' is missing
test_result['TenantInfo'][3]['PoolStats'][2]['Threads']: value 2 is missing
test_result['TenantInfo'][3]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['TenantInfo'][3]['PoolStats'][4]['Threads']: value 1 is missing
test_result['TenantInfo'][3]['PoolStats'][4]['Usage']: value 'number' is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_tenantinfo.log

Test results differ from canonical:
test_result['/Root']['TenantInfo'][0]['PoolStats'][0]['Threads']: value 2 is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][1]['Threads']: value 1 differs from canonical 3
test_result['/Root']['TenantInfo'][0]['PoolStats'][2]['Threads']: value 2 is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][4]['Threads']: value 1 is missing
test_result['/Root']['TenantInfo'][0]['PoolStats'][4]['Usage']: value 'number' is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][0]['Threads']: value 2 is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][1]['Threads']: value 3 is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][1]['Usage']: value 'number' is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][2]['Threads']: value 2 is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][4]['Threads']: value 1 is missing
test_result['/Root/dedicated_db']['TenantInfo'][0]['PoolStats'][4]['Usage']: value 'number' is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][0]['Threads']: value 2 is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][0]['Usage']: value 'number' is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][1]['Threads']: value 3 is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][1]['Usage']: value 'number' is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][2]['Threads']: value 2 is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][2]['Usage']: value 'number' is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][4]['Threads']: value 1 is missing
test_result['/Root/shared_db']['TenantInfo'][0]['PoolStats'][4]['Usage']: value 'number' is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_viewer_tenantinfo_db.log

Chunk exceeded 600s timeout and was killed
List of the tests involved in the launch:
test_tpch.py::TestTpchS1::test_tpch[1] (good) duration: 235.85s
test_tpch.py::TestTpchS1::test_tpch[21] (fail) duration: 32.89s
test_tpch.py::TestTpchS1::test_tpch[17] (good) duration: 30.04s
test_tpch.py::TestTpchS1::test_tpch[4] (good) duration: 25.32s
test_tpch.py::TestTpchS1::test_tpch[3] (good) duration: 25.24s
test_tpch.py::TestTpchS1::test_tpch[8] (good) duration: 23.25s
test_tpch.py::TestTpchS1::test_tpch[15] (good) duration: 23.18s
test_tpch.py::TestTpchS1::test_tpch[10] (good) duration: 22.56s
test_tpch.py::TestTpchS1::test_tpch[5] (good) duration: 22.41s
test_tpch.py::TestTpchS1::test_tpch[9] (good) duration: 21.76s
11 more tests with 141.72s total duration are not listed.
test_tpch.py::TestTpchS1::test_tpch[22] test was not launched inside chunk.
Killed by timeout (600 s)

log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/run_test.log
logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/stderr

ydb/tests/olap/load/lib/tpch.py:49: in test_tpch
    self.run_workload_test(self._get_path(), query_num)
ydb/tests/olap/load/lib/conftest.py:450: in run_workload_test
    self.process_query_result(result, query_name, True)
ydb/tests/olap/load/lib/conftest.py:339: in process_query_result
    raise exc
ydb/tests/olap/lib/ydb_cli.py:213: in run
    process = yatest.common.process.execute(self.__get_cmd(), check_exit_code=False, text=True)
library/python/testing/yatest_common/yatest/common/process.py:656: in execute
    res.wait(check_exit_code, timeout, on_timeout)
library/python/testing/yatest_common/yatest/common/process.py:400: in wait
    _wait()
library/python/testing/yatest_common/yatest/common/process.py:335: in _wait
    pid, sts, rusage = os.wait4(self._process.pid, 0)
library/python/pytest/plugins/ya.py:347: in _graceful_shutdown
    _graceful_shutdown_on_log(not capman.is_globally_capturing())
library/python/pytest/plugins/ya.py:321: in _graceful_shutdown_on_log
    pytest.exit("Graceful shutdown requested")
E   Failed: Graceful shutdown requested

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_tpch.py.TestTpchS1.test_tpch.21.log

ydb/tests/olap/test_log_scenario.py:196: in test_log_deviation
    thread.join()
ydb/tests/olap/common/thread_helper.py:18: in join
    raise self.exc
ydb/tests/olap/common/thread_helper.py:11: in run
    self.ret = self._target(*self._args, **self._kwargs)
ydb/tests/olap/test_log_scenario.py:148: in aggregation_query
    self.ydb_client.query(
ydb/tests/olap/common/ydb_client.py:24: in query
    return self.session_pool.execute_with_retries(statement)
contrib/python/ydb/py3/ydb/query/pool.py:204: in execute_with_retries
    return retry_operation_sync(wrapped_callee, retry_settings)
contrib/python/ydb/py3/ydb/retries.py:133: in retry_operation_sync
    for next_opt in opt_generator:
contrib/python/ydb/py3/ydb/retries.py:94: in retry_operation_impl
    result = YdbRetryOperationFinalResult(callee(*args, **kwargs))
contrib/python/ydb/py3/ydb/query/pool.py:202: in wrapped_callee
    return [result_set for result_set in it]
contrib/python/ydb/py3/ydb/_utilities.py:173: in __next__
    return self._next()
contrib/python/ydb/py3/ydb/_utilities.py:164: in _next
    res = self.wrapper(next(self.it))
contrib/python/grpcio/py3/grpc/_channel.py:475: in __next__
    return self._next()
contrib/python/grpcio/py3/grpc/_channel.py:881: in _next
    raise self
E   grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
E   	status = StatusCode.UNAVAILABLE
E   	details = "Socket closed"
E   	debug_error_string = "UNKNOWN:Error received from peer  {file:"/home/runner/actions_runner/_work/ydb/ydb/contrib/libs/grpc/src/core/lib/surface/call.cc", file_line:1211, created_time:"2025-06-20T11:29:27.942964276+00:00", grpc_status:14, grpc_message:"Socket closed"}"
E   >teardown failed:
ydb/tests/olap/test_log_scenario.py:123: in teardown_class
    cls.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:606: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Bad exit_code..
E   Process exit_code = -6.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff/test_log_scenario.py.TestLogScenario.test_log_deviation.180/cluster/node_1/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff/test_log_scenario.py.TestLogScenario.test_log_deviation.180/cluster/node_1/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option
E   VERIFY failed (2025-06-20T11:29:25.536567Z): memory leak; Expected 851968, actual 786432 (12 page(s), 65536 offloaded); allocator created at: ydb/library/yql/dq/actors/compute/dq_compute_actor_impl.h:200
E   yql/essentials/minikql/aligned_page_pool.cpp:328
E   ~TAlignedPagePoolImpl(): requirement TotalAllocated == FreePages.size() * POOL_PAGE_SIZE failed
E   0. /-S/util/system/yassert.cpp:83: InternalPanicImpl @ 0xA4E7CC5
E   1. /-S/util/system/yassert.cpp:55: Panic @ 0xA4E05B6
E   2. /tmp//-S/yql/essentials/minikql/aligned_page_pool.cpp:325: ~TAlignedPagePoolImpl @ 0xCD021CE
E   3. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:173: __release_shared @ 0x1A502B36
E   4. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:219: __release_shared @ 0x1A502B36
E   5. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/shared_ptr.h:694: ~shared_ptr @ 0x1A502B36
E   6. /tmp//-S/ydb/core/kqp/runtime/kqp_write_actor.cpp:227: ~TKqpTableWriteActor @ 0x1A502B36
E   7. /tmp//-S/ydb/core/kqp/runtime/kqp_write_actor.cpp:227: ?? @ 0x1A502C2D
E   8. /-S/util/generic/ptr.h:36: CheckedDelete<NActors::IActor> @ 0xB3B1CE7
E   9. /-S/util/generic/ptr.h:57: Destroy<NActors::IActor> @ 0xB3B1CE7
E   10. /-S/util/generic/ptr.h:376: DoDestroy @ 0xB3B1CE7
E   11. /-S/util/generic/ptr.h:306: ~THolder @ 0xB3B1CE7
E   12. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator.h:154: destroy @ 0xB3B1CE7
E   13. /-S/contrib/libs/cxxsupp/libcxx/include/__memory/allocator_traits.h:335: destroy<THolder<NActors::IActor, TDelete>, 0> @ 0xB3B1CE7
E   14. /-S/contrib/libs/cxxsupp/libcxx/include/vector:1015: __base_destruct_at_end @ 0xB3B1CE7
E   15. /-S/contrib/libs/cxxsupp/libcxx/include/vector:1009: __clear @ 0xB3B1CE7
E   16. /-S/contrib/libs/cxxsupp/libcxx/include/vector:766: clear @ 0xB3B1CE7
E   17. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:113: DropUnregistered @ 0xB3B1CE7
E   18. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:280: Execute @ 0xB3B2989
E   19. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:460: operator() @ 0xB3B6582
E   20. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:512: ProcessExecutorPool @ 0xB3B6150
E   21. /tmp//-S/ydb/library/actors/core/executor_thread.cpp:538: ThreadProc @ 0xB3B6DDA
E   22. /-S/util/system/thread.cpp:245: ThreadProxy @ 0xA4E912C
E   23. ??:0: ?? @ 0x7F8103416AC2
E   24. ??:0: ?? @ 0x7F81034A884F

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff/test_log_scenario.py.TestLogScenario.test_log_deviation.180.log

teardown failed:
ydb/tests/stress/transfer/tests/test_workload.py:24: in teardown_class
    cls.cluster.stop()
ydb/tests/library/harness/kikimr_runner.py:606: in stop
    raise daemon.SeveralDaemonErrors(saved_exceptions)
E   ydb.tests.library.harness.daemon.SeveralDaemonErrors: Daemon failed with message: Unexpectedly finished before stop.
E   Process exit_code = -4.
E   Stdout file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/transfer/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbTransferWorkload.test.row/cluster/node_6/stdout
E   Stderr file name: 
E   /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/transfer/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbTransferWorkload.test.row/cluster/node_6/stderr
E   Stderr content:
E   
E   GRpc memory quota was set but disabled due to issues with grpc quoter, to enable it use EnableGRpcMemoryQuota option

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/transfer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/stress/transfer/tests/test-results/py3test/testing_out_stuff/test_workload.py.TestYdbTransferWorkload.test.column.log

ydb/tests/olap/upgrade_to_internal_path_id.py:72: in test
    self.restart_cluster(generate_internal_path_id=True)
ydb/tests/olap/upgrade_to_internal_path_id.py:34: in restart_cluster
    driver.wait(5, fail_fast=True)
contrib/python/ydb/py3/ydb/pool.py:407: in wait
    self._store.add_fast_fail().result(timeout)
contrib/tools/python3/Lib/concurrent/futures/_base.py:456: in result
    return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
    raise self._exception
E   ydb.issues.ConnectionFailure: Failed to resolve endpoints for database /Root. Endpoint: "localhost:16754". Error details:
E    message: "Database resolve failed with no certain result" issue_code: 200400 severity: 1 (server_code: 400050)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/olap/test-results/py3test/testing_out_stuff/upgrade_to_internal_path_id.py.TestUpgradeToInternalPathId.test.log

ydb/tests/functional/config/test_distconf.py:442: in test_cluster_change_state_storage
    self.do_test("StateStorage")
ydb/tests/functional/config/test_distconf.py:485: in do_test
    self.do_test_change_state_storage(defaultRingGroup, newRingGroup, storageName)
ydb/tests/functional/config/test_distconf.py:411: in do_test_change_state_storage
    logger.info(self.do_load_and_test({"ReconfigStateStorage": {f"{configName}Config": {
ydb/tests/functional/config/test_distconf.py:379: in do_load_and_test
    assert_that(response.operation.status == StatusIds.SUCCESS, response)
E   AssertionError: operation {
E     ready: true
E     status: SCHEME_ERROR
E     issues {
E       message: "Cannot resolve working dir workingDir# null path# Root/mydb/mytable_1"
E       issue_code: 200400
E       severity: 1
E     }
E     issues {
E       message: "Path does not exist"
E       issue_code: 200200
E       severity: 1
E     }
E   }

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/config/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/config/test-results/py3test/testing_out_stuff/test_distconf.py.TestKiKiMRDistConfReassignStateStorageBadCases.test_cluster_change_state_storage.log

ydb/tests/functional/config/test_distconf.py:442: in test_cluster_change_state_storage
    self.do_test("StateStorage")
ydb/tests/functional/config/test_distconf.py:522: in do_test
    self.do_test_change_state_storage(defaultRingGroup, newRingGroup, configName)
ydb/tests/functional/config/test_distconf.py:411: in do_test_change_state_storage
    logger.info(self.do_load_and_test({"ReconfigStateStorage": {f"{configName}Config": {
ydb/tests/functional/config/test_distconf.py:379: in do_load_and_test
    assert_that(response.operation.status == StatusIds.SUCCESS, response)
E   AssertionError: operation {
E     ready: true
E     status: SCHEME_ERROR
E     issues {
E       message: "Cannot resolve working dir workingDir# null path# Root/mydb/mytable_1"
E       issue_code: 200400
E       severity: 1
E     }
E     issues {
E       message: "Path does not exist"
E       issue_code: 200200
E       severity: 1
E     }
E   }

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/config/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/config/test-results/py3test/testing_out_stuff/test_distconf.py.TestKiKiMRDistConfReassignStateStorageReuseSameNodes.test_cluster_change_state_storage.log

ydb/tests/functional/config/test_distconf.py:442: in test_cluster_change_state_storage
    self.do_test("StateStorage")
ydb/tests/functional/config/test_distconf.py:535: in do_test
    self.do_test_change_state_storage(defaultRingGroup, newRingGroup, configName)
ydb/tests/functional/config/test_distconf.py:411: in do_test_change_state_storage
    logger.info(self.do_load_and_test({"ReconfigStateStorage": {f"{configName}Config": {
ydb/tests/functional/config/test_distconf.py:379: in do_load_and_test
    assert_that(response.operation.status == StatusIds.SUCCESS, response)
E   AssertionError: operation {
E     ready: true
E     status: SCHEME_ERROR
E     issues {
E       message: "Cannot resolve working dir workingDir# null path# Root/mydb/mytable_1"
E       issue_code: 200400
E       severity: 1
E     }
E     issues {
E       message: "Path does not exist"
E       issue_code: 200200
E       severity: 1
E     }
E   }

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/config/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/config/test-results/py3test/testing_out_stuff/test_distconf.py.TestKiKiMRDistConfReassignStateStorageMultipleRingGroup.test_cluster_change_state_storage.log

(yexception) ydb/apps/ydb/ut/run_ydb.cpp:82: 
command: /home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/ydb/ydb -e grpc://localhost:18945 -d /local workload transfer topic-to-table run -s 10 --topic transfer-topic-cbyn
exitcode: 1
stdout: 
Window	Write speed	Write time	Inflight	Read speed	Topic time	Select time	Upsert time	Commit time	
#	msg/s	MB/s	percentile,ms	percentile,msg	msg/s	MB/s	percentile,ms	percentile,ms	percentile,ms	percentile,ms	
1	0	0	0		0		0	0	0		0		0		0	
2	0	0	0		0		0	0	0		0		0		0	
3	0	0	0		0		0	0	0		0		0		0	
4	0	0	0		0		0	0	0		0		0		0	
5	0	0	0		0		0	0	0		0		0		0	
6	5331	52	9		31		0	0	0		0		0		0	
7	4993	48	9		31		0	0	0		0		0		0	
8	4899	47	10		31		0	0	0		0		0		0	
9	2258	22	11		30		0	0	0		0		0		0	
10	0	0	0		0		0	0	0		0		0		0	
Window	Write speed	Write time	Inflight	Read speed	Topic time	Select time	Upsert time	Commit time	
#	msg/s	MB/s	percentile,ms	percentile,msg	msg/s	MB/s	percentile,ms	percentile,ms	percentile,ms	percentile,ms	
Total	3496	34	9		31		0	0	0		0		0		0	

stderr: 
(!) New version of YDB CLI is available. Run 'ydb update' command for update. You can also disable further version checks with 'ydb version --disable-checks' command
2025-06-20T11:35:39.294551Z :EMERG: No messages were read.




logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/ydb/ut/test-results/unittest/testing_out_stuff
stderr:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/ydb/ut/test-results/unittest/testing_out_stuff/YdbWorkloadTransferTopicToTable.Default_Run.err
stdout:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/apps/ydb/ut/test-results/unittest/testing_out_stuff/YdbWorkloadTransferTopicToTable.Default_Run.out

Test results differ from canonical:
test_result['response_last_offset']['Messages'][3]: value {'Codec': 0, 'CreateTimestamp': 'not-zero-number', 'Message':... is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_topic_data.log

Test results differ from canonical:
test_result['1-get']['self']['size_bytes']: value 'not-zero-number-text' is missing
test_result['3-get']['self']['size_bytes']: value 'not-zero-number-text' is missing
test_result['5-get']['self']['size_bytes']: value 'not-zero-number-text' is missing

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/core/viewer/tests/test-results/py3test/testing_out_stuff/test.py.test_scheme_directory.log

ydb/tests/functional/hive/test_drain.py:93: in test_drain_on_stop
    wait_tablets_are_active(
ydb/tests/library/common/delayed.py:151: in wait_tablets_are_active
    predicate(raise_error=True)
ydb/tests/library/common/delayed.py:141: in predicate
    raise AssertionError(
E   AssertionError: 
E   ##############################
E   0 seconds passed, 150 tablet(s) are not active. Inactive tablets are (first 10 entries): (72075186224037897: None) (72075186224037906: None) (72075186224037933: None) (72075186224037951: None) (72075186224037956: None) (72075186224037961: 4) (72075186224037971: None) (72075186224037975: 4) (72075186224037979: None) (72075186224037980: 4). Additional info is empty
E   ##############################

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/hive/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/hive/test-results/py3test/testing_out_stuff/test_drain.py.TestHive.test_drain_on_stop.log

ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
    IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
    return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
    res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
    yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
    return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
    raise self._exception
contrib/python/ydb/py3/ydb/connection.py:105: in _on_response_callback
    response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
    issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:229: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)

During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
    with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E   AssertionError: Regex pattern did not match.
E    Regex: '.*DISK_SPACE_EXHAUSTED.*'
E    Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--false_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--false.log

ydb/tests/functional/serverless/test_serverless.py:452: in test_database_with_disk_quotas
    IOLoop.current().run_sync(lambda: async_write_key(path, 0, 'test', ignore_out_of_space=False))
contrib/python/tornado/tornado-4/tornado/ioloop.py:458: in run_sync
    return future_cell[0].result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:349: in wrapped
    res = yield func(*args, **kwargs)
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/python/tornado/tornado-4/tornado/concurrent.py:238: in result
    raise_exc_info(self._exc_info)
<string>:4: in raise_exc_info
    ???
contrib/python/tornado/tornado-4/tornado/gen.py:1064: in run
    yielded = self.gen.throw(*exc_info)
ydb/tests/functional/serverless/test_serverless.py:369: in async_write_key
    yield tx.async_execute(
contrib/python/tornado/tornado-4/tornado/gen.py:1056: in run
    value = future.result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:449: in result
    return self.__get_result()
contrib/tools/python3/Lib/concurrent/futures/_base.py:401: in __get_result
    raise self._exception
contrib/python/ydb/py3/ydb/connection.py:105: in _on_response_callback
    response = response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
    issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:229: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.Unavailable: message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--true_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)

During handling of the above exception, another exception occurred:
ydb/tests/functional/serverless/test_serverless.py:451: in test_database_with_disk_quotas
    with pytest.raises(ydb.Unavailable, match=r'.*DISK_SPACE_EXHAUSTED.*'):
E   AssertionError: Regex pattern did not match.
E    Regex: '.*DISK_SPACE_EXHAUSTED.*'
E    Input: 'message: "Disk space exhausted. Table `/Root/quoted_serverless/test_database_with_disk_quotas_enable_alter_database_create_hive_first--true_/dirA0/table`." issue_code: 2033 severity: 1 issues { message: "Cannot perform writes: database is out of disk space" issue_code: 2033 severity: 1 } (server_code: 400050)'

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/serverless/test-results/py3test/testing_out_stuff/test_serverless.py.test_database_with_disk_quotas.enable_alter_database_create_hive_first--true.log

ydb/tests/functional/tenants/test_dynamic_tenants.py:350: in test_create_and_drop_the_same_tenant2
    pool.retry_operation_sync(write_some_data, None, "table", "table_for_rm", value)
contrib/python/ydb/py3/ydb/table.py:2655: in retry_operation_sync
    return retry_operation_sync(wrapped_callee, retry_settings)
contrib/python/ydb/py3/ydb/retries.py:133: in retry_operation_sync
    for next_opt in opt_generator:
contrib/python/ydb/py3/ydb/retries.py:94: in retry_operation_impl
    result = YdbRetryOperationFinalResult(callee(*args, **kwargs))
contrib/python/ydb/py3/ydb/table.py:2653: in wrapped_callee
    return callee(session, *args, **kwargs)
ydb/tests/functional/tenants/test_dynamic_tenants.py:340: in write_some_data
    session.transaction().execute(
contrib/python/ydb/py3/ydb/table.py:2392: in execute
    return self._driver(
contrib/python/ydb/py3/ydb/tracing.py:70: in wrapper
    return f(self, *args, **kwargs)
contrib/python/ydb/py3/ydb/pool.py:464: in __call__
    res = connection(
contrib/python/ydb/py3/ydb/connection.py:465: in __call__
    return response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
    issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:229: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.SchemeError: message: "Failed to create default pool in database /Root/users/database" severity: 1 issues { message: "Failed to create resource pool: StatusPathDoesNotExist" severity: 1 issues { message: "Path does not exist" issue_code: 200200 severity: 1 } } ,message: "Query failed during adding/waiting in workload pool " severity: 1 (server_code: 400070)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_dynamic_tenants.py.test_create_and_drop_the_same_tenant2.enable_alter_database_create_hive_first--false.log

ydb/tests/functional/tenants/test_dynamic_tenants.py:350: in test_create_and_drop_the_same_tenant2
    pool.retry_operation_sync(write_some_data, None, "table", "table_for_rm", value)
contrib/python/ydb/py3/ydb/table.py:2655: in retry_operation_sync
    return retry_operation_sync(wrapped_callee, retry_settings)
contrib/python/ydb/py3/ydb/retries.py:133: in retry_operation_sync
    for next_opt in opt_generator:
contrib/python/ydb/py3/ydb/retries.py:94: in retry_operation_impl
    result = YdbRetryOperationFinalResult(callee(*args, **kwargs))
contrib/python/ydb/py3/ydb/table.py:2653: in wrapped_callee
    return callee(session, *args, **kwargs)
ydb/tests/functional/tenants/test_dynamic_tenants.py:340: in write_some_data
    session.transaction().execute(
contrib/python/ydb/py3/ydb/table.py:2392: in execute
    return self._driver(
contrib/python/ydb/py3/ydb/tracing.py:70: in wrapper
    return f(self, *args, **kwargs)
contrib/python/ydb/py3/ydb/pool.py:464: in __call__
    res = connection(
contrib/python/ydb/py3/ydb/connection.py:465: in __call__
    return response if wrap_result is None else wrap_result(rpc_state, response, *wrap_args)
contrib/python/ydb/py3/ydb/_session_impl.py:20: in decorator
    return func(rpc_state, response_pb, session_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:9: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:22: in decorator
    return func(rpc_state, response_pb, session_state, tx_state, query, *args, **kwargs)
contrib/python/ydb/py3/ydb/_tx_ctx_impl.py:165: in wrap_result_and_tx_id
    issues._process_response(response_pb.operation)
contrib/python/ydb/py3/ydb/issues.py:229: in _process_response
    raise exc_obj(_format_response(response_proto), response_proto.issues)
E   ydb.issues.SchemeError: message: "Failed to create default pool in database /Root/users/database" severity: 1 issues { message: "Failed to create resource pool: StatusPathDoesNotExist" severity: 1 issues { message: "Path does not exist" issue_code: 200200 severity: 1 } } ,message: "Query failed during adding/waiting in workload pool " severity: 1 (server_code: 400070)

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_dynamic_tenants.py.test_create_and_drop_the_same_tenant2.enable_alter_database_create_hive_first--true.log

ydb/tests/functional/tenants/test_tenants.py:433: in test_list_database_above
    assert result.children[0].name == ".sys"
E   AssertionError: assert '.metadata' == '.sys'
E     
E     - .sys
E     + .metadata

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_tenants.py.TestTenants.test_list_database_above.enable_alter_database_create_hive_first--false.log

ydb/tests/functional/tenants/test_tenants.py:433: in test_list_database_above
    assert result.children[0].name == ".sys"
E   AssertionError: assert '.metadata' == '.sys'
E     
E     - .sys
E     + .metadata

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_tenants.py.TestTenants.test_list_database_above.enable_alter_database_create_hive_first--true.log

ydb/tests/functional/tenants/test_tenants.py:297: in test_stop_start
    with ydb_database_ctx(ydb_cluster, database_path):
contrib/tools/python3/Lib/contextlib.py:137: in __enter__
    return next(self.gen)
ydb/tests/library/fixtures/__init__.py:88: in ydb_database_ctx
    ydb_cluster.create_database(database_path, storage_pool_units_count=storage_pools, timeout_seconds=timeout_seconds, token=token)
ydb/tests/library/harness/kikimr_cluster_interface.py:230: in create_database
    raise RuntimeError('create_database failed: %s, %s' % (operation.status, ydb.issues._format_issues(operation.issues)))
E   RuntimeError: create_database failed: 400080, message: "Group fit error BoxId# 1 StoragePoolId# 5 Error# failed to allocate group: no group options PDisks# {[(1:1-S)]}" severity: 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_tenants.py.TestTenants.test_stop_start.enable_alter_database_create_hive_first--false.log

ydb/tests/functional/tenants/test_tenants.py:297: in test_stop_start
    with ydb_database_ctx(ydb_cluster, database_path):
contrib/tools/python3/Lib/contextlib.py:137: in __enter__
    return next(self.gen)
ydb/tests/library/fixtures/__init__.py:88: in ydb_database_ctx
    ydb_cluster.create_database(database_path, storage_pool_units_count=storage_pools, timeout_seconds=timeout_seconds, token=token)
ydb/tests/library/harness/kikimr_cluster_interface.py:230: in create_database
    raise RuntimeError('create_database failed: %s, %s' % (operation.status, ydb.issues._format_issues(operation.issues)))
E   RuntimeError: create_database failed: 400080, message: "Group fit error BoxId# 1 StoragePoolId# 5 Error# failed to allocate group: no group options PDisks# {[(1:1-S)]}" severity: 1

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tenants/test-results/py3test/testing_out_stuff/test_tenants.py.TestTenants.test_stop_start.enable_alter_database_create_hive_first--true.log

ydb/tests/olap/load/lib/clickbench.py:46: in test_clickbench
    self.run_workload_test(self.path, query_name=query_name)
ydb/tests/olap/load/lib/conftest.py:450: in run_workload_test
    self.process_query_result(result, query_name, True)
ydb/tests/olap/load/lib/conftest.py:339: in process_query_result
    raise exc
E   Failed: Iteration 0: <main>: Error: Type annotation, code: 1030
E       <main>:1:1: Error: At function: RemovePrefixMembers, At function: PgSelect, At tuple, At tuple, At tuple, At function: PgSetItem
E           <main>:2:129: Error: No such column: m

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_clickbench.py.TestClickbenchPg.test_clickbench.Query18.log

ydb/tests/olap/load/lib/clickbench.py:46: in test_clickbench
    self.run_workload_test(self.path, query_name=query_name)
ydb/tests/olap/load/lib/conftest.py:450: in run_workload_test
    self.process_query_result(result, query_name, True)
ydb/tests/olap/load/lib/conftest.py:339: in process_query_result
    raise exc
E   Failed: Iteration 0: <main>: Error: Type annotation, code: 1030
E       <main>:1:1: Error: At function: RemovePrefixMembers, At function: PgSelect, At tuple, At tuple, At tuple, At function: PgSetItem
E           <main>:2:199: Error: No such column: k

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_clickbench.py.TestClickbenchPg.test_clickbench.Query28.log

ydb/tests/olap/load/lib/clickbench.py:46: in test_clickbench
    self.run_workload_test(self.path, query_name=query_name)
ydb/tests/olap/load/lib/conftest.py:450: in run_workload_test
    self.process_query_result(result, query_name, True)
ydb/tests/olap/load/lib/conftest.py:339: in process_query_result
    raise exc
E   Failed: Iteration 0: <main>: Error: Type annotation, code: 1030
E       <main>:1:1: Error: At function: RemovePrefixMembers, At function: PgSelect, At tuple, At tuple, At tuple, At function: PgSetItem
E           <main>:2:360: Error: No such column: Src

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_clickbench.py.TestClickbenchPg.test_clickbench.Query39.log

ydb/tests/olap/load/lib/workload_oltp.py:29: in test_workload_oltp
    self.execute_workload_test(
ydb/tests/olap/load/lib/workload_executor.py:224: in execute_workload_test
    return self._execute_workload_with_deployment(
ydb/tests/olap/load/lib/workload_executor.py:251: in _execute_workload_with_deployment
    final_result = self._finalize_workload_results(
ydb/tests/olap/load/lib/workload_executor.py:358: in _finalize_workload_results
    self.process_workload_result_with_diagnostics(overall_result, workload_name, False)
ydb/tests/olap/load/lib/conftest.py:757: in process_workload_result_with_diagnostics
    raise exc
E   Failed: WORKLOAD EXECUTION FAILED: OltpWorkload
E   Main error: All 1 runs failed to execute successfully
E   
E   Execution details:
E   Total iterations attempted: 1
E   
E   FAILED ITERATIONS (1):
E     - Iteration 1: Workload execution failed. stderr: FATAL: exceptions must derive from BaseException
E   Traceback: File "contrib/tools/python3/Lib/threading.py", line 1032, in _bootstrap
E       self._bootstrap_inner()File "contrib/tools/python3/Lib/threading.py", line 1075, in _bootstrap_inner
E       self.run()File "contrib/tools/python3/Lib/threading.py", line 1012, in run
E       self._target(*self._args, **self._kwargs)File "ydb/tests/stress/common/common.py", line 102, in <lambda>
E       t = threading.Thread(target=lambda: wrapper(f))File "ydb/tests/stress/common/common.py", line 96, in wrapper
E       for line in traceback.format_stack():
E    (time: 1.4s)
E   
E   STDERR (last 500 chars):
E   .../python3/Lib/threading.py", line 1032, in _bootstrap
E       self._bootstrap_inner()File "contrib/tools/python3/Lib/threading.py", line 1075, in _bootstrap_inner
E       self.run()File "contrib/tools/python3/Lib/threading.py", line 1012, in run
E       self._target(*self._args, **self._kwargs)File "ydb/tests/stress/common/common.py", line 102, in <lambda>
E       t = threading.Thread(target=lambda: wrapper(f))File "ydb/tests/stress/common/common.py", line 96, in wrapper
E       for line in traceback.format_stack():
E   
E   RUN STATISTICS:
E     Successful runs: 0/1
E     Failed runs: 1
E     Success rate: 0.0%

logsdir:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff
log:
/home/runner/actions_runner/_work/ydb/ydb/tmp/out/ydb/tests/functional/tpc/medium/test-results/py3test/testing_out_stuff/test_workload_oltp.py.TestWorkloadSimpleQueue.test_workload_oltp.log