2025-12-09 03:42:18,078 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-09 03:42:18,079 - INFO - ya.test - pytest_runtest_setup: test_filters_non_optional_field
2025-12-09 03:42:18,079 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-09 03:42:18,079 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-12-09 03:42:18,080 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1270
2025-12-09 03:42:18,081 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/21511
2025-12-09 03:42:18,146 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:42:18,147 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/29888
2025-12-09 03:42:18,206 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:42:18,207 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/23491
2025-12-09 03:42:18,208 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/7801
2025-12-09 03:42:18,208 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/11390
2025-12-09 03:42:18,209 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/17626
2025-12-09 03:42:18,209 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:42:18,213 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-09 03:42:18,214 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:42:18,223 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-09 03:42:18,224 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, dc97c1a2-20f7-4f53-bd8b-028436241af8, localhost:15610): creating call state
2025-12-09 03:42:18,224 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, dc97c1a2-20f7-4f53-bd8b-028436241af8, localhost:15610): request = { database: "local" }
2025-12-09 03:42:18,227 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, dc97c1a2-20f7-4f53-bd8b-028436241af8, localhost:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-syjwtgwtdu.auto.internal" port: 15610 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-09 03:42:18,228 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-syjwtgwtdu.auto.internal:15610, location 1, ssl: False>]>
2025-12-09 03:42:18,229 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:42:18,237 - INFO - ydb.connection - close: Closing channel for endpoint localhost:15610
2025-12-09 03:42:18,238 - DEBUG - ydb.table.SessionPool - subscribe: Active session queue is empty, subscribe waiter for a session
2025-12-09 03:42:18,239 - DEBUG - ydb.table.SessionPool - subscribe: Subscribe waiter <Future at 0x7f0c683e9690 state=pending>
2025-12-09 03:42:18,240 - DEBUG - ydb.table.SessionPool - subscribe: Session pool is not large enough (active_count < size: 0 < 1). will create a new session.
2025-12-09 03:42:18,240 - DEBUG - ydb.table.SessionPool - _create: Created session <ydb.table.Session object at 0x7f0c682ed500>
2025-12-09 03:42:18,240 - DEBUG - ydb.table.SessionPool - _prepare: Preparing session <ydb.table.Session object at 0x7f0c682ed500>
2025-12-09 03:42:18,240 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateSession, 86bea621-7698-4e84-b3f3-d97d4c983009, ghrun-syjwtgwtdu.auto.internal:15610): creating call state
2025-12-09 03:42:18,241 - DEBUG - ydb.connection - _log_request: RpcState(CreateSession, 86bea621-7698-4e84-b3f3-d97d4c983009, ghrun-syjwtgwtdu.auto.internal:15610): request = { operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } }
2025-12-09 03:42:18,243 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 86bea621-7698-4e84-b3f3-d97d4c983009, ghrun-syjwtgwtdu.auto.internal:15610): on response callback started
2025-12-09 03:42:18,244 - DEBUG - ydb.connection - _log_response: RpcState(CreateSession, 86bea621-7698-4e84-b3f3-d97d4c983009, ghrun-syjwtgwtdu.auto.internal:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.CreateSessionResult] { session_id: "ydb://session/3?node_id=1&id=NWI4ZGY1OWQtZmZiZjFjMTAtZmUyN2FiNTYtZTJjMzZjZjk=" } } } }
2025-12-09 03:42:18,244 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f0c682ed500>
2025-12-09 03:42:18,244 - DEBUG - ydb.table.SessionPool - put: Replying to waiter with a session <ydb.table.Session object at 0x7f0c682ed500>
2025-12-09 03:42:18,245 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 6bf1b36e-b9b9-4b6f-b241-ffc5045e0fb9, ghrun-syjwtgwtdu.auto.internal:15610): creating call state
2025-12-09 03:42:18,245 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 86bea621-7698-4e84-b3f3-d97d4c983009, ghrun-syjwtgwtdu.auto.internal:15610): on response callback success
2025-12-09 03:42:18,246 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 6bf1b36e-b9b9-4b6f-b241-ffc5045e0fb9, ghrun-syjwtgwtdu.auto.internal:15610): request = { session_id: "ydb://session/3?node_id=1&id=NWI4ZGY1OWQtZmZiZjFjMTAtZmUyN2FiNTYtZTJjMzZjZjk=" path: "local/DbPoolStorage_af3055d7-cc16-4afc-8886-7dadb9642879/tenants" columns { name: "tenant" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "common" type { optional_type { item { type_id: BOOL } } } } columns { name: "state" type { optional_type { item { type_id: UINT32 } } } } columns { name: "state_time" type { optional_type { item { type_id: TIMESTAMP } } } } primary_key: "tenant" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-09 03:42:18,272 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 6bf1b36e-b9b9-4b6f-b241-ffc5045e0fb9, ghrun-syjwtgwtdu.auto.internal:15610): response = { operation { ready: true status: SUCCESS } }
2025-12-09 03:42:18,272 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f0c682ed500>
2025-12-09 03:42:18,273 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 0c602894-139d-455b-8164-a7f310cae28b, ghrun-syjwtgwtdu.auto.internal:15610): creating call state
2025-12-09 03:42:18,274 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 0c602894-139d-455b-8164-a7f310cae28b, ghrun-syjwtgwtdu.auto.internal:15610): request = { session_id: "ydb://session/3?node_id=1&id=NWI4ZGY1OWQtZmZiZjFjMTAtZmUyN2FiNTYtZTJjMzZjZjk=" path: "local/DbPoolStorage_af3055d7-cc16-4afc-8886-7dadb9642879/mappings" columns { name: "subject_type" type { optional_type { item { type_id: STRING } } } } columns { name: "subject_id" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "node" type { optional_type { item { type_id: STRING } } } } primary_key: "subject_type" primary_key: "subject_id" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-09 03:42:18,288 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 0c602894-139d-455b-8164-a7f310cae28b, ghrun-syjwtgwtdu.auto.internal:15610): response = { operation { ready: true status: SUCCESS } }
2025-12-09 03:42:18,289 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f0c682ed500>
2025-12-09 03:42:18,290 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteDataQuery, 9ebec17b-0ae3-4ebd-a92c-ec5068988ef7, ghrun-syjwtgwtdu.auto.internal:15610): creating call state
2025-12-09 03:42:18,290 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteDataQuery, 9ebec17b-0ae3-4ebd-a92c-ec5068988ef7, ghrun-syjwtgwtdu.auto.internal:15610): request = { session_id: "ydb://session/3?node_id=1&id=NWI4ZGY1OWQtZmZiZjFjMTAtZmUyN2FiNTYtZTJjMzZjZjk=" tx_control { begin_tx { serializable_read_write { } } commit_tx: true } query { yql_text: "--!syntax_v1\n            PRAGMA TablePathPrefix(\"local/DbPoolStorage_af3055d7-cc16-4afc-8886-7dadb9642879\");\n            UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/compute\", \"/compute\", true, 0, CurrentUtcTimestamp());\n                " } operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-09 03:42:18,356 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteDataQuery, 9ebec17b-0ae3-4ebd-a92c-ec5068988ef7, ghrun-syjwtgwtdu.auto.internal:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.ExecuteQueryResult] { tx_meta { } } } } }
2025-12-09 03:42:18,357 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f0c682ed500>
2025-12-09 03:42:18,417 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:42:18,418 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/23637
2025-12-09 03:42:18,419 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1279
2025-12-09 03:42:18,419 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/12384
2025-12-09 03:42:18,420 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/kikimr_configs"
2025-12-09 03:42:18,420 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/node_1/logfile_byp0j5_g.log --grpc-port=17626 --mon-port=23637 --ic-port=29888
2025-12-09 03:42:18,421 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/kikimr_configs"
2025-12-09 03:42:18,421 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/node_1/logfile_byp0j5_g.log --grpc-port=17626 --mon-port=23637 --ic-port=29888
2025-12-09 03:42:18,422 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/kikimr_configs/config.yaml', '--node=1', '--tenant=/cp', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/node_1/logfile_byp0j5_g.log', '--grpc-port=17626', '--mon-port=23637', '--ic-port=29888')' in '/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/node_1' (no wait)
2025-12-09 03:42:18,424 - DEBUG - ya.test - execute: Command pid: 1610075
2025-12-09 03:42:18,427 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:17626/1
2025-12-09 03:42:18,430 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out
2025-12-09 03:42:18,431 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err
2025-12-09 03:42:18,431 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-09 03:42:18,432 - DEBUG - ya.test - execute: Command pid: 1610109
2025-12-09 03:42:18,817 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) rc: 0
2025-12-09 03:42:18,817 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) elapsed time (sec): 0.3838036060333252
2025-12-09 03:42:18,817 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) idrss: 0
2025-12-09 03:42:18,818 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) inblock: 0
2025-12-09 03:42:18,818 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) isrss: 0
2025-12-09 03:42:18,818 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) ixrss: 0
2025-12-09 03:42:18,818 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) majflt: 0
2025-12-09 03:42:18,818 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) maxrss: 543848
2025-12-09 03:42:18,818 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) minflt: 16233
2025-12-09 03:42:18,819 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) msgrcv: 0
2025-12-09 03:42:18,819 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) msgsnd: 0
2025-12-09 03:42:18,819 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) nivcsw: 9
2025-12-09 03:42:18,819 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) nsignals: 0
2025-12-09 03:42:18,819 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) nswap: 0
2025-12-09 03:42:18,819 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) nvcsw: 17
2025-12-09 03:42:18,820 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) oublock: 8
2025-12-09 03:42:18,820 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) stime: 0.23546199999999998
2025-12-09 03:42:18,820 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) utime: 0.099772
2025-12-09 03:42:18,820 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) wtime: 0.385
2025-12-09 03:42:18,820 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) output:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-syjwtgwtdu
    Host information: 
        Linux ghrun-syjwtgwtdu 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-09 03:42:18,821 - DEBUG - ya.test - _save_outputs: Command (pid 1610109) errors:

2025-12-09 03:42:18,821 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6
2025-12-09 03:42:18,821 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-12-09 03:42:18,868 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:42:18,868 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/28803
2025-12-09 03:42:18,869 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1377
2025-12-09 03:42:18,869 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/21932
2025-12-09 03:42:18,870 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/21533
2025-12-09 03:42:18,870 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-09 03:42:18,871 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_1/logfile_bcexqj1a.log --grpc-port=28803 --mon-port=1377 --ic-port=23491
2025-12-09 03:42:18,871 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:42:18,871 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/15083
2025-12-09 03:42:18,872 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/29037
2025-12-09 03:42:18,872 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/22105
2025-12-09 03:42:18,872 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/32528
2025-12-09 03:42:18,873 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-09 03:42:18,873 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=2 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_2/logfile_8hd31j45.log --grpc-port=15083 --mon-port=29037 --ic-port=7801
2025-12-09 03:42:18,873 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:42:18,874 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/4816
2025-12-09 03:42:18,874 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/10714
2025-12-09 03:42:18,874 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/29579
2025-12-09 03:42:18,875 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/4067
2025-12-09 03:42:18,875 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-09 03:42:18,876 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=3 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_3/logfile_b8rem91d.log --grpc-port=4816 --mon-port=10714 --ic-port=11390
2025-12-09 03:42:18,876 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-09 03:42:18,876 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_1/logfile_bcexqj1a.log --grpc-port=28803 --mon-port=1377 --ic-port=23491
2025-12-09 03:42:18,877 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs/config.yaml', '--node=1', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_1/logfile_bcexqj1a.log', '--grpc-port=28803', '--mon-port=1377', '--ic-port=23491')' in '/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_1' (no wait)
2025-12-09 03:42:18,878 - DEBUG - ya.test - execute: Command pid: 1610496
2025-12-09 03:42:18,879 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:28803/1
2025-12-09 03:42:18,880 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.0
2025-12-09 03:42:18,880 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.0
2025-12-09 03:42:18,881 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-09 03:42:18,881 - DEBUG - ya.test - execute: Command pid: 1610497
2025-12-09 03:42:19,562 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) rc: 0
2025-12-09 03:42:19,563 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) elapsed time (sec): 0.6801085472106934
2025-12-09 03:42:19,563 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) idrss: 0
2025-12-09 03:42:19,563 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) inblock: 0
2025-12-09 03:42:19,563 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) isrss: 0
2025-12-09 03:42:19,563 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) ixrss: 0
2025-12-09 03:42:19,564 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) majflt: 0
2025-12-09 03:42:19,564 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) maxrss: 543848
2025-12-09 03:42:19,564 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) minflt: 16236
2025-12-09 03:42:19,564 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) msgrcv: 0
2025-12-09 03:42:19,564 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) msgsnd: 0
2025-12-09 03:42:19,564 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) nivcsw: 26
2025-12-09 03:42:19,565 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) nsignals: 0
2025-12-09 03:42:19,565 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) nswap: 0
2025-12-09 03:42:19,565 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) nvcsw: 17
2025-12-09 03:42:19,565 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) oublock: 8
2025-12-09 03:42:19,565 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) stime: 0.488021
2025-12-09 03:42:19,566 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) utime: 0.099766
2025-12-09 03:42:19,566 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) wtime: 0.681
2025-12-09 03:42:19,566 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) output:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-syjwtgwtdu
    Host information: 
        Linux ghrun-syjwtgwtdu 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-09 03:42:19,567 - DEBUG - ya.test - _save_outputs: Command (pid 1610497) errors:

2025-12-09 03:42:19,567 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6
2025-12-09 03:42:19,567 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-09 03:42:19,567 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=2 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_2/logfile_8hd31j45.log --grpc-port=15083 --mon-port=29037 --ic-port=7801
2025-12-09 03:42:19,569 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs/config.yaml', '--node=2', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_2/logfile_8hd31j45.log', '--grpc-port=15083', '--mon-port=29037', '--ic-port=7801')' in '/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_2' (no wait)
2025-12-09 03:42:19,571 - DEBUG - ya.test - execute: Command pid: 1610898
2025-12-09 03:42:19,572 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:15083/2
2025-12-09 03:42:19,573 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.1
2025-12-09 03:42:19,573 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.1
2025-12-09 03:42:19,573 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-09 03:42:19,574 - DEBUG - ya.test - execute: Command pid: 1610899
2025-12-09 03:42:20,236 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) rc: 0
2025-12-09 03:42:20,237 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) elapsed time (sec): 0.6612875461578369
2025-12-09 03:42:20,237 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) idrss: 0
2025-12-09 03:42:20,238 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) inblock: 0
2025-12-09 03:42:20,238 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) isrss: 0
2025-12-09 03:42:20,238 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) ixrss: 0
2025-12-09 03:42:20,238 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) majflt: 0
2025-12-09 03:42:20,238 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) maxrss: 543848
2025-12-09 03:42:20,238 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) minflt: 16233
2025-12-09 03:42:20,239 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) msgrcv: 0
2025-12-09 03:42:20,239 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) msgsnd: 0
2025-12-09 03:42:20,239 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) nivcsw: 76
2025-12-09 03:42:20,239 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) nsignals: 0
2025-12-09 03:42:20,239 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) nswap: 0
2025-12-09 03:42:20,239 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) nvcsw: 16
2025-12-09 03:42:20,239 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) oublock: 8
2025-12-09 03:42:20,240 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) stime: 0.467341
2025-12-09 03:42:20,240 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) utime: 0.10086099999999999
2025-12-09 03:42:20,240 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) wtime: 0.662
2025-12-09 03:42:20,240 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) output:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-syjwtgwtdu
    Host information: 
        Linux ghrun-syjwtgwtdu 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-09 03:42:20,240 - DEBUG - ya.test - _save_outputs: Command (pid 1610899) errors:

2025-12-09 03:42:20,241 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 2 version:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6
2025-12-09 03:42:20,241 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-09 03:42:20,241 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=3 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_3/logfile_b8rem91d.log --grpc-port=4816 --mon-port=10714 --ic-port=11390
2025-12-09 03:42:20,242 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs/config.yaml', '--node=3', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_3/logfile_b8rem91d.log', '--grpc-port=4816', '--mon-port=10714', '--ic-port=11390')' in '/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_3' (no wait)
2025-12-09 03:42:20,244 - DEBUG - ya.test - execute: Command pid: 1611225
2025-12-09 03:42:20,244 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:4816/3
2025-12-09 03:42:20,245 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.2
2025-12-09 03:42:20,246 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.2
2025-12-09 03:42:20,246 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-09 03:42:20,249 - DEBUG - ya.test - execute: Command pid: 1611227
2025-12-09 03:42:20,855 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) rc: 0
2025-12-09 03:42:20,855 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) elapsed time (sec): 0.6047360897064209
2025-12-09 03:42:20,856 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) idrss: 0
2025-12-09 03:42:20,856 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) inblock: 0
2025-12-09 03:42:20,856 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) isrss: 0
2025-12-09 03:42:20,856 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) ixrss: 0
2025-12-09 03:42:20,856 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) majflt: 0
2025-12-09 03:42:20,857 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) maxrss: 543848
2025-12-09 03:42:20,857 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) minflt: 16231
2025-12-09 03:42:20,857 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) msgrcv: 0
2025-12-09 03:42:20,857 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) msgsnd: 0
2025-12-09 03:42:20,857 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) nivcsw: 64
2025-12-09 03:42:20,858 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) nsignals: 0
2025-12-09 03:42:20,858 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) nswap: 0
2025-12-09 03:42:20,858 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) nvcsw: 14
2025-12-09 03:42:20,858 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) oublock: 8
2025-12-09 03:42:20,858 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) stime: 0.444256
2025-12-09 03:42:20,858 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) utime: 0.10352
2025-12-09 03:42:20,859 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) wtime: 0.608
2025-12-09 03:42:20,859 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) output:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-syjwtgwtdu
    Host information: 
        Linux ghrun-syjwtgwtdu 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-09 03:42:20,859 - DEBUG - ya.test - _save_outputs: Command (pid 1611227) errors:

2025-12-09 03:42:20,860 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 3 version:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6
2025-12-09 03:42:20,860 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-12-09 03:42:20,866 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_row_dispatcher.py::TestPqRowDispatcher, test_name: test_filters_non_optional_field)
2025-12-09 03:42:21,296 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/test_filters_non_optional_field_input"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-12-09 03:42:21,347 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-09 03:42:21,348 - DEBUG - root - _get_and_check_result: Result: 
2025-12-09 03:42:21,350 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/test_filters_non_optional_field_output"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-12-09 03:42:21,367 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-09 03:42:21,368 - DEBUG - root - _get_and_check_result: Result: 
2025-12-09 03:42:21,385 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-09 03:42:21,386 - DEBUG - root - _get_and_check_result: Result: 
2025-12-09 03:42:21,387 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "e6ff7e7d-fdde-498b-b80d-97d9d4ec8bd7"

2025-12-09 03:42:21,633 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd6g7lnibp4gqe"

2025-12-09 03:42:21,714 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd6g7lnibp4gqe"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251741
        nanos: 395119000
      }
      modified_at {
        seconds: 1765251741
        nanos: 395119000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd6g7lndjcfu9q-ptqudqgd6g7lnibp4gqe"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251741
      nanos: 395119000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
    syntax: YQL_V1
  }
}

2025-12-09 03:42:22,232 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd6g7lnibp4gqe"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251741
        nanos: 395119000
      }
      modified_at {
        seconds: 1765251741
        nanos: 395119000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251741
      nanos: 894000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd6g7lndjcfu9q-ptqudqgd6g7lnibp4gqe"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251741
      nanos: 395119000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`time` > 101)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"time\") $9 $10 \'\"B\\x19\\b\\x06\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15e\\x00\\x00\\x00\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19) (AsStruct \'(\'\"time\" $19)))) (lambda \'($20) (block \'(\n    (let $21 (Member $20 \'\"time\"))\n    (return (OptionalIf (> $21 (Int32 \'\"101\")) (AsStruct \'(\'\"column0\" (SafeCast $21 $12)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200573)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:26,101 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0010*\014shard-000000\032\021\"\0011*\014shard-000000"
  }
}

2025-12-09 03:42:26,101 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:42:26,102 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:42:26,104 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err
2025-12-09 03:42:26,104 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:42:26,105 - DEBUG - ya.test - execute: Command pid: 1614153
2025-12-09 03:42:30,817 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:42:30,817 - DEBUG - ya.test - _save_outputs: Command (pid 1614153) rc: 0
2025-12-09 03:42:30,818 - DEBUG - ya.test - _save_outputs: Command (pid 1614153) elapsed time (sec): 4.7117650508880615
2025-12-09 03:42:30,818 - DEBUG - ya.test - _save_outputs: Command (pid 1614153) wtime: 4.713
2025-12-09 03:42:30,818 - DEBUG - ya.test - _save_outputs: Command (pid 1614153) output:
None
2025-12-09 03:42:30,818 - DEBUG - ya.test - _save_outputs: Command (pid 1614153) errors:
2025-12-09T03:42:26.122953Z :INFO: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Starting read session
2025-12-09T03:42:26.122997Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Starting session to cluster null (localhost:15610)
2025-12-09T03:42:26.123500Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:26.123513Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:26.123519Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:42:26.128391Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] Successfully connected. Initializing session
2025-12-09T03:42:26.129879Z :INFO: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] Server session id: test_filters_non_optional_field_consumer_1_1_14777920363474136250_v1
2025-12-09T03:42:26.129964Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:26.133373Z :INFO: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:42:27.124261Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:0
2025-12-09T03:42:27.124313Z :INFO: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:42:30.728464Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:30.728571Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-12-09T03:42:30.728619Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-12-09T03:42:30.728760Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] Commit offsets [0, 1). Partition stream id: 1
2025-12-09T03:42:30.728886Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:42:30.732331Z :DEBUG: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:42:30.732566Z :INFO: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Closing read session. Close timeout: 5.000000s
2025-12-09T03:42:30.732599Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:1
2025-12-09T03:42:30.732611Z :INFO: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4609 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:42:30.733040Z :NOTICE: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:42:30.733221Z :INFO: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Closing read session. Close timeout: 0.000000s
2025-12-09T03:42:30.733239Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:1
2025-12-09T03:42:30.733270Z :INFO: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4610 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:42:30.733284Z :NOTICE: [local] [local] [3dc5ca16-8cd1a209-6d10ac0e-677117e3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:42:30,819 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:42:31,035 - DEBUG - root - control_query: Result: 
2025-12-09 03:42:31,044 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd6g7lnibp4gqe"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251741
        nanos: 395119000
      }
      modified_at {
        seconds: 1765251750
        nanos: 957900000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251741
      nanos: 894000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd6g7lndjcfu9q-ptqudqgd6g7lnibp4gqe"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251741
      nanos: 395119000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`time` > 101)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"46ms\",\"count\":1,\"avg\":\"46ms\",\"max\":\"46ms\",\"min\":\"46ms\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"time\") $9 $10 \'\"B\\x19\\b\\x06\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15e\\x00\\x00\\x00\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19) (AsStruct \'(\'\"time\" $19)))) (lambda \'($20) (block \'(\n    (let $21 (Member $20 \'\"time\"))\n    (return (OptionalIf (> $21 (Int32 \'\"101\")) (AsStruct \'(\'\"column0\" (SafeCast $21 $12)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200573)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:31,623 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd6g7lnibp4gqe"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251741
        nanos: 395119000
      }
      modified_at {
        seconds: 1765251750
        nanos: 957900000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251741
      nanos: 894000000
    }
    finished_at {
      seconds: 1765251751
      nanos: 322000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd6g7lndjcfu9q-ptqudqgd6g7lnibp4gqe"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251741
      nanos: 395119000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`time` > 101)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"46ms\",\"count\":1,\"avg\":\"46ms\",\"max\":\"46ms\",\"min\":\"46ms\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"time\") $9 $10 \'\"B\\x19\\b\\x06\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15e\\x00\\x00\\x00\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19) (AsStruct \'(\'\"time\" $19)))) (lambda \'($20) (block \'(\n    (let $21 (Member $20 \'\"time\"))\n    (return (OptionalIf (> $21 (Int32 \'\"101\")) (AsStruct \'(\'\"column0\" (SafeCast $21 $12)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200573)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:32,753 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:42:32,754 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "c733fd5a-0fdd-4c53-9c74-6ab66c894bc6"

2025-12-09 03:42:32,775 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd65cq8jctep16"

2025-12-09 03:42:32,784 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd65cq8jctep16"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251752
        nanos: 761008000
      }
      modified_at {
        seconds: 1765251752
        nanos: 761008000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd65cq7rkgcnpt-ptqudqgd65cq8jctep16"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251752
      nanos: 761008000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
}

2025-12-09 03:42:33,296 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd65cq8jctep16"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251752
        nanos: 761008000
      }
      modified_at {
        seconds: 1765251752
        nanos: 761008000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251752
      nanos: 788000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd65cq7rkgcnpt-ptqudqgd65cq8jctep16"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251752
      nanos: 761008000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (== (Member $21 \'\"data\") (String \'\"hello2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200593)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:34,437 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0012*\014shard-000000\032\021\"\0013*\014shard-000000"
  }
}

2025-12-09 03:42:34,438 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:42:34,438 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:42:34,440 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.0
2025-12-09 03:42:34,440 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:42:34,441 - DEBUG - ya.test - execute: Command pid: 1618982
2025-12-09 03:42:38,049 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:42:38,050 - DEBUG - ya.test - _save_outputs: Command (pid 1618982) rc: 0
2025-12-09 03:42:38,050 - DEBUG - ya.test - _save_outputs: Command (pid 1618982) elapsed time (sec): 3.6078760623931885
2025-12-09 03:42:38,050 - DEBUG - ya.test - _save_outputs: Command (pid 1618982) wtime: 3.609
2025-12-09 03:42:38,050 - DEBUG - ya.test - _save_outputs: Command (pid 1618982) output:
None
2025-12-09 03:42:38,051 - DEBUG - ya.test - _save_outputs: Command (pid 1618982) errors:
2025-12-09T03:42:34.460335Z :INFO: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Starting read session
2025-12-09T03:42:34.460379Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Starting session to cluster null (localhost:15610)
2025-12-09T03:42:34.460786Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:34.460799Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:34.460805Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:42:34.465701Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] Successfully connected. Initializing session
2025-12-09T03:42:34.467003Z :INFO: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] Server session id: test_filters_non_optional_field_consumer_1_3_975589605057576580_v1
2025-12-09T03:42:34.467074Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:34.468671Z :INFO: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:42:35.461299Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:1
2025-12-09T03:42:35.461332Z :INFO: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:42:37.975709Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:37.975805Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-12-09T03:42:37.975847Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-12-09T03:42:37.975974Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] Commit offsets [1, 2). Partition stream id: 1
2025-12-09T03:42:37.976074Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:42:37.979984Z :DEBUG: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:42:37.980079Z :INFO: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Closing read session. Close timeout: 5.000000s
2025-12-09T03:42:37.980109Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:1:2
2025-12-09T03:42:37.980131Z :INFO: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3519 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:42:37.980329Z :NOTICE: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:42:37.980563Z :INFO: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Closing read session. Close timeout: 0.000000s
2025-12-09T03:42:37.980574Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:1:2
2025-12-09T03:42:37.980596Z :INFO: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3520 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:42:37.980606Z :NOTICE: [local] [local] [de328214-fbc094ab-d206ba7f-5d385de] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:42:38,051 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:42:38,069 - DEBUG - root - control_query: Result: 
2025-12-09 03:42:38,077 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd65cq8jctep16"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251752
        nanos: 761008000
      }
      modified_at {
        seconds: 1765251758
        nanos: 63939000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251752
      nanos: 788000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd65cq7rkgcnpt-ptqudqgd65cq8jctep16"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251752
      nanos: 761008000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (== (Member $21 \'\"data\") (String \'\"hello2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200593)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:38,587 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:42:39,097 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd65cq8jctep16"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251752
        nanos: 761008000
      }
      modified_at {
        seconds: 1765251758
        nanos: 63939000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251752
      nanos: 788000000
    }
    finished_at {
      seconds: 1765251758
      nanos: 916000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd65cq7rkgcnpt-ptqudqgd65cq8jctep16"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251752
      nanos: 761008000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"71ms\",\"count\":1,\"avg\":\"71ms\",\"max\":\"71ms\",\"min\":\"71ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (== (Member $21 \'\"data\") (String \'\"hello2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200593)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:40,315 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:42:40,316 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "4ab3bc43-8a4b-4beb-8580-7169934d9860"

2025-12-09 03:42:40,332 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd5u639k7k3326"

2025-12-09 03:42:40,339 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5u639k7k3326"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251760
        nanos: 321169000
      }
      modified_at {
        seconds: 1765251760
        nanos: 321169000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5u639fm76sh4-ptqudqgd5u639k7k3326"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251760
      nanos: 321169000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
}

2025-12-09 03:42:40,855 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5u639k7k3326"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251760
        nanos: 321169000
      }
      modified_at {
        seconds: 1765251760
        nanos: 321169000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251760
      nanos: 427000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5u639fm76sh4-ptqudqgd5u639k7k3326"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251760
      nanos: 321169000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrEquals (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:40,901 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0014*\014shard-000000\032\021\"\0015*\014shard-000000"
  }
}

2025-12-09 03:42:40,901 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:42:40,902 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:42:40,903 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.1
2025-12-09 03:42:40,904 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:42:40,905 - DEBUG - ya.test - execute: Command pid: 1621962
2025-12-09 03:42:45,712 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:42:45,712 - DEBUG - ya.test - _save_outputs: Command (pid 1621962) rc: 0
2025-12-09 03:42:45,712 - DEBUG - ya.test - _save_outputs: Command (pid 1621962) elapsed time (sec): 4.806885242462158
2025-12-09 03:42:45,713 - DEBUG - ya.test - _save_outputs: Command (pid 1621962) wtime: 4.808
2025-12-09 03:42:45,713 - DEBUG - ya.test - _save_outputs: Command (pid 1621962) output:
None
2025-12-09 03:42:45,713 - DEBUG - ya.test - _save_outputs: Command (pid 1621962) errors:
2025-12-09T03:42:40.926239Z :INFO: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Starting read session
2025-12-09T03:42:40.926295Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Starting session to cluster null (localhost:15610)
2025-12-09T03:42:40.926827Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:40.926841Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:40.926848Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:42:40.932168Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] Successfully connected. Initializing session
2025-12-09T03:42:40.933228Z :INFO: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] Server session id: test_filters_non_optional_field_consumer_1_5_8827153497281442964_v1
2025-12-09T03:42:40.933283Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:40.934558Z :INFO: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:42:41.927282Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:2
2025-12-09T03:42:41.927321Z :INFO: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:42:45.674059Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:45.674162Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-12-09T03:42:45.674227Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-12-09T03:42:45.674370Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] Commit offsets [2, 3). Partition stream id: 1
2025-12-09T03:42:45.674501Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:42:45.677100Z :DEBUG: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:42:45.677253Z :INFO: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Closing read session. Close timeout: 5.000000s
2025-12-09T03:42:45.677289Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:2:3
2025-12-09T03:42:45.677301Z :INFO: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4751 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:42:45.677759Z :NOTICE: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:42:45.677898Z :INFO: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Closing read session. Close timeout: 0.000000s
2025-12-09T03:42:45.677908Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:2:3
2025-12-09T03:42:45.677929Z :INFO: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4751 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:42:45.677939Z :NOTICE: [local] [local] [cde1799c-33fea1b1-421c5d8-fa0e44c1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:42:45,714 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:42:45,731 - DEBUG - root - control_query: Result: 
2025-12-09 03:42:45,741 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5u639k7k3326"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251760
        nanos: 321169000
      }
      modified_at {
        seconds: 1765251765
        nanos: 725816000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251760
      nanos: 427000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5u639fm76sh4-ptqudqgd5u639k7k3326"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251760
      nanos: 321169000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrEquals (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:46,250 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:42:46,758 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5u639k7k3326"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251760
        nanos: 321169000
      }
      modified_at {
        seconds: 1765251765
        nanos: 725816000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251760
      nanos: 427000000
    }
    finished_at {
      seconds: 1765251766
      nanos: 630000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5u639fm76sh4-ptqudqgd5u639k7k3326"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251760
      nanos: 321169000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"64ms\",\"count\":1,\"avg\":\"64ms\",\"max\":\"64ms\",\"min\":\"64ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrEquals (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:47,880 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:42:47,880 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "9e924a24-d83d-484e-8b5d-46f98c0c4514"

2025-12-09 03:42:47,905 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd5mv8a0m4jh6h"

2025-12-09 03:42:47,916 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5mv8a0m4jh6h"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251767
        nanos: 885435000
      }
      modified_at {
        seconds: 1765251767
        nanos: 885435000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5mv89ph90m2k-ptqudqgd5mv8a0m4jh6h"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251767
      nanos: 885435000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
}

2025-12-09 03:42:48,426 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5mv8a0m4jh6h"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251767
        nanos: 885435000
      }
      modified_at {
        seconds: 1765251767
        nanos: 885435000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251768
      nanos: 80000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5mv89ph90m2k-ptqudqgd5mv8a0m4jh6h"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251767
      nanos: 885435000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrNotEquals (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:49,583 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0016*\014shard-000000\032\021\"\0017*\014shard-000000"
  }
}

2025-12-09 03:42:49,584 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:42:49,585 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:42:49,586 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.2
2025-12-09 03:42:49,586 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:42:49,587 - DEBUG - ya.test - execute: Command pid: 1625836
2025-12-09 03:42:53,502 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:42:53,503 - DEBUG - ya.test - _save_outputs: Command (pid 1625836) rc: 0
2025-12-09 03:42:53,503 - DEBUG - ya.test - _save_outputs: Command (pid 1625836) elapsed time (sec): 3.9146625995635986
2025-12-09 03:42:53,503 - DEBUG - ya.test - _save_outputs: Command (pid 1625836) wtime: 3.916
2025-12-09 03:42:53,503 - DEBUG - ya.test - _save_outputs: Command (pid 1625836) output:
None
2025-12-09 03:42:53,503 - DEBUG - ya.test - _save_outputs: Command (pid 1625836) errors:
2025-12-09T03:42:49.606940Z :INFO: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Starting read session
2025-12-09T03:42:49.606988Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Starting session to cluster null (localhost:15610)
2025-12-09T03:42:49.607498Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:49.607511Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:49.607518Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:42:49.612656Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] Successfully connected. Initializing session
2025-12-09T03:42:49.613728Z :INFO: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] Server session id: test_filters_non_optional_field_consumer_1_7_7964071993263108042_v1
2025-12-09T03:42:49.613783Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:49.615209Z :INFO: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:42:50.608323Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:3
2025-12-09T03:42:50.608363Z :INFO: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:42:53.380656Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:53.380761Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (3-3)
2025-12-09T03:42:53.380811Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-12-09T03:42:53.380960Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] Commit offsets [3, 4). Partition stream id: 1
2025-12-09T03:42:53.381084Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:42:53.388023Z :DEBUG: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:42:53.388202Z :INFO: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Closing read session. Close timeout: 5.000000s
2025-12-09T03:42:53.388231Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:3:4
2025-12-09T03:42:53.388244Z :INFO: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3781 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:42:53.388506Z :NOTICE: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:42:53.388747Z :INFO: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Closing read session. Close timeout: 0.000000s
2025-12-09T03:42:53.388765Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:3:4
2025-12-09T03:42:53.388794Z :INFO: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3781 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:42:53.388806Z :NOTICE: [local] [local] [ad4d8767-a03b5582-5e13283f-aaa98786] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:42:53,504 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:42:53,532 - DEBUG - root - control_query: Result: 
2025-12-09 03:42:53,542 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5mv8a0m4jh6h"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251767
        nanos: 885435000
      }
      modified_at {
        seconds: 1765251773
        nanos: 523988000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251768
      nanos: 80000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5mv89ph90m2k-ptqudqgd5mv8a0m4jh6h"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251767
      nanos: 885435000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrNotEquals (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:54,055 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:42:54,563 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5mv8a0m4jh6h"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251767
        nanos: 885435000
      }
      modified_at {
        seconds: 1765251773
        nanos: 523988000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251768
      nanos: 80000000
    }
    finished_at {
      seconds: 1765251774
      nanos: 310000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5mv89ph90m2k-ptqudqgd5mv8a0m4jh6h"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251767
      nanos: 885435000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"75ms\",\"count\":1,\"avg\":\"75ms\",\"max\":\"75ms\",\"min\":\"75ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrNotEquals (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:55,700 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:42:55,701 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "e8da63cd-b4bf-4b4d-b42a-e783ae6d08cd"

2025-12-09 03:42:55,724 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd5fgh0r4up3be"

2025-12-09 03:42:55,736 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5fgh0r4up3be"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251775
        nanos: 708064000
      }
      modified_at {
        seconds: 1765251775
        nanos: 708064000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5fgh0lnhgk08-ptqudqgd5fgh0r4up3be"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251775
      nanos: 708064000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
}

2025-12-09 03:42:56,248 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5fgh0r4up3be"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251775
        nanos: 708064000
      }
      modified_at {
        seconds: 1765251775
        nanos: 708064000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251775
      nanos: 803000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5fgh0lnhgk08-ptqudqgd5fgh0r4up3be"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251775
      nanos: 708064000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $22 (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200601)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:42:57,397 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0018*\014shard-000000\032\021\"\0019*\014shard-000000"
  }
}

2025-12-09 03:42:57,398 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:42:57,399 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:42:57,400 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.3
2025-12-09 03:42:57,400 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:42:57,401 - DEBUG - ya.test - execute: Command pid: 1629215
2025-12-09 03:43:01,112 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:43:01,113 - DEBUG - ya.test - _save_outputs: Command (pid 1629215) rc: 0
2025-12-09 03:43:01,113 - DEBUG - ya.test - _save_outputs: Command (pid 1629215) elapsed time (sec): 3.7106950283050537
2025-12-09 03:43:01,113 - DEBUG - ya.test - _save_outputs: Command (pid 1629215) wtime: 3.712
2025-12-09 03:43:01,113 - DEBUG - ya.test - _save_outputs: Command (pid 1629215) output:
None
2025-12-09 03:43:01,113 - DEBUG - ya.test - _save_outputs: Command (pid 1629215) errors:
2025-12-09T03:42:57.420388Z :INFO: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Starting read session
2025-12-09T03:42:57.420450Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Starting session to cluster null (localhost:15610)
2025-12-09T03:42:57.420907Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:57.420921Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:57.420927Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:42:57.426275Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] Successfully connected. Initializing session
2025-12-09T03:42:57.427261Z :INFO: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] Server session id: test_filters_non_optional_field_consumer_1_9_15326613221669766623_v1
2025-12-09T03:42:57.427355Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:42:57.428797Z :INFO: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:42:58.421306Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:4
2025-12-09T03:42:58.421348Z :INFO: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:01.024680Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:01.024758Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (4-4)
2025-12-09T03:43:01.024798Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-12-09T03:43:01.024973Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] Commit offsets [4, 5). Partition stream id: 1
2025-12-09T03:43:01.025157Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:43:01.027616Z :DEBUG: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:43:01.027773Z :INFO: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Closing read session. Close timeout: 5.000000s
2025-12-09T03:43:01.027803Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:4:5
2025-12-09T03:43:01.027816Z :INFO: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3607 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:43:01.028146Z :NOTICE: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:43:01.028252Z :INFO: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Closing read session. Close timeout: 0.000000s
2025-12-09T03:43:01.028264Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:4:5
2025-12-09T03:43:01.028285Z :INFO: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3607 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:01.028296Z :NOTICE: [local] [local] [4ffd4789-d838c8f3-68c38f42-c1eb1bd5] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:43:01,114 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:43:01,131 - DEBUG - root - control_query: Result: 
2025-12-09 03:43:01,139 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5fgh0r4up3be"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251775
        nanos: 708064000
      }
      modified_at {
        seconds: 1765251781
        nanos: 125783000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251775
      nanos: 803000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5fgh0lnhgk08-ptqudqgd5fgh0r4up3be"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251775
      nanos: 708064000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $22 (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200601)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:01,649 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:02,157 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd5fgh0r4up3be"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251775
        nanos: 708064000
      }
      modified_at {
        seconds: 1765251781
        nanos: 125783000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251775
      nanos: 803000000
    }
    finished_at {
      seconds: 1765251781
      nanos: 965000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd5fgh0lnhgk08-ptqudqgd5fgh0r4up3be"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251775
      nanos: 708064000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"60ms\",\"count\":1,\"avg\":\"60ms\",\"max\":\"60ms\",\"min\":\"60ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $22 (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200601)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:03,268 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:03,269 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "2acb48f7-855f-41fc-a093-6a54ccf878cf"

2025-12-09 03:43:03,282 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd589l3qo8c032"

2025-12-09 03:43:03,290 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd589l3qo8c032"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251783
        nanos: 273287000
      }
      modified_at {
        seconds: 1765251783
        nanos: 273287000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd589l3kni8bfd-ptqudqgd589l3qo8c032"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251783
      nanos: 273287000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
    syntax: YQL_V1
  }
}

2025-12-09 03:43:03,804 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd589l3qo8c032"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251783
        nanos: 273287000
      }
      modified_at {
        seconds: 1765251783
        nanos: 273287000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251783
      nanos: 448000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd589l3kni8bfd-ptqudqgd589l3qo8c032"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251783
      nanos: 273287000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (`event` IN (\"event1\", \"event3\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"\\n3\\n1*/\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event3\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Not (SqlIn \'((String \'\"event1\") (String \'\"event3\")) (Member $21 \'\"event\") \'(\'(\'ansi)))) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200624)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:03,879 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00210*\014shard-000000\032\022\"\00211*\014shard-000000"
  }
}

2025-12-09 03:43:03,879 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:43:03,880 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:43:03,881 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.4
2025-12-09 03:43:03,882 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:43:03,882 - DEBUG - ya.test - execute: Command pid: 1631277
2025-12-09 03:43:08,711 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:43:08,711 - DEBUG - ya.test - _save_outputs: Command (pid 1631277) rc: 0
2025-12-09 03:43:08,711 - DEBUG - ya.test - _save_outputs: Command (pid 1631277) elapsed time (sec): 4.828111410140991
2025-12-09 03:43:08,712 - DEBUG - ya.test - _save_outputs: Command (pid 1631277) wtime: 4.829
2025-12-09 03:43:08,712 - DEBUG - ya.test - _save_outputs: Command (pid 1631277) output:
None
2025-12-09 03:43:08,712 - DEBUG - ya.test - _save_outputs: Command (pid 1631277) errors:
2025-12-09T03:43:03.901362Z :INFO: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Starting read session
2025-12-09T03:43:03.901420Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Starting session to cluster null (localhost:15610)
2025-12-09T03:43:03.901883Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:03.901898Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:03.901904Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:43:03.907745Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] Successfully connected. Initializing session
2025-12-09T03:43:03.910418Z :INFO: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] Server session id: test_filters_non_optional_field_consumer_1_11_4042316641799514049_v1
2025-12-09T03:43:03.910530Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:03.910976Z :INFO: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:43:04.906015Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:5
2025-12-09T03:43:04.906049Z :INFO: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1004 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:08.639959Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:08.640114Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (5-5)
2025-12-09T03:43:08.640168Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-12-09T03:43:08.640290Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] Commit offsets [5, 6). Partition stream id: 1
2025-12-09T03:43:08.640465Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:43:08.643514Z :DEBUG: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:43:08.644103Z :INFO: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Closing read session. Close timeout: 5.000000s
2025-12-09T03:43:08.644152Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:5:6
2025-12-09T03:43:08.644165Z :INFO: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4742 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:43:08.644427Z :NOTICE: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:43:08.644539Z :INFO: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Closing read session. Close timeout: 0.000000s
2025-12-09T03:43:08.644553Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:5:6
2025-12-09T03:43:08.644580Z :INFO: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4743 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:08.644591Z :NOTICE: [local] [local] [91834385-e127df48-81c94a47-bd50f3c3] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:43:08,713 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:43:08,738 - DEBUG - root - control_query: Result: 
2025-12-09 03:43:08,747 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd589l3qo8c032"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251783
        nanos: 273287000
      }
      modified_at {
        seconds: 1765251788
        nanos: 732090000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251783
      nanos: 448000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd589l3kni8bfd-ptqudqgd589l3qo8c032"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251783
      nanos: 273287000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (`event` IN (\"event1\", \"event3\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"\\n3\\n1*/\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event3\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Not (SqlIn \'((String \'\"event1\") (String \'\"event3\")) (Member $21 \'\"event\") \'(\'(\'ansi)))) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200624)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:09,256 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:09,764 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd589l3qo8c032"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251783
        nanos: 273287000
      }
      modified_at {
        seconds: 1765251788
        nanos: 732090000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251783
      nanos: 448000000
    }
    finished_at {
      seconds: 1765251789
      nanos: 578000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd589l3kni8bfd-ptqudqgd589l3qo8c032"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251783
      nanos: 273287000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (`event` IN (\"event1\", \"event3\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"75ms\",\"count\":1,\"avg\":\"75ms\",\"max\":\"75ms\",\"min\":\"75ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"\\n3\\n1*/\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event3\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Not (SqlIn \'((String \'\"event1\") (String \'\"event3\")) (Member $21 \'\"event\") \'(\'(\'ansi)))) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200624)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:11,008 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:11,009 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "1bfde5ea-4161-4203-921e-08e9e072b08e"

2025-12-09 03:43:11,028 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd50te9ojse7rj"

2025-12-09 03:43:11,037 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd50te9ojse7rj"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251791
        nanos: 13504000
      }
      modified_at {
        seconds: 1765251791
        nanos: 13504000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd50te9ir9t28m-ptqudqgd50te9ojse7rj"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251791
      nanos: 13504000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-09 03:43:11,547 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd50te9ojse7rj"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251791
        nanos: 13504000
      }
      modified_at {
        seconds: 1765251791
        nanos: 13504000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251791
      nanos: 92000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd50te9ir9t28m-ptqudqgd50te9ojse7rj"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251791
      nanos: 13504000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $24 (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200629)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:12,703 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00212*\014shard-000000\032\022\"\00213*\014shard-000000"
  }
}

2025-12-09 03:43:12,704 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:43:12,704 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:43:12,706 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.5
2025-12-09 03:43:12,706 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:43:12,707 - DEBUG - ya.test - execute: Command pid: 1635351
2025-12-09 03:43:16,318 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:43:16,319 - DEBUG - ya.test - _save_outputs: Command (pid 1635351) rc: 0
2025-12-09 03:43:16,319 - DEBUG - ya.test - _save_outputs: Command (pid 1635351) elapsed time (sec): 3.6106948852539062
2025-12-09 03:43:16,319 - DEBUG - ya.test - _save_outputs: Command (pid 1635351) wtime: 3.612
2025-12-09 03:43:16,320 - DEBUG - ya.test - _save_outputs: Command (pid 1635351) output:
None
2025-12-09 03:43:16,320 - DEBUG - ya.test - _save_outputs: Command (pid 1635351) errors:
2025-12-09T03:43:12.731731Z :INFO: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Starting read session
2025-12-09T03:43:12.731779Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Starting session to cluster null (localhost:15610)
2025-12-09T03:43:12.732334Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:12.732348Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:12.732354Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:43:12.739353Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] Successfully connected. Initializing session
2025-12-09T03:43:12.740431Z :INFO: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] Server session id: test_filters_non_optional_field_consumer_1_13_6341008521124814637_v1
2025-12-09T03:43:12.740498Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:12.741822Z :INFO: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:43:13.733264Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:6
2025-12-09T03:43:13.733307Z :INFO: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:16.272846Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:16.272930Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (6-6)
2025-12-09T03:43:16.272982Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-12-09T03:43:16.273115Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] Commit offsets [6, 7). Partition stream id: 1
2025-12-09T03:43:16.273225Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:43:16.276052Z :DEBUG: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:43:16.276213Z :INFO: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Closing read session. Close timeout: 5.000000s
2025-12-09T03:43:16.276255Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:6:7
2025-12-09T03:43:16.276274Z :INFO: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3544 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:43:16.276547Z :NOTICE: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:43:16.276695Z :INFO: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Closing read session. Close timeout: 0.000000s
2025-12-09T03:43:16.276710Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:6:7
2025-12-09T03:43:16.276732Z :INFO: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3545 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:16.276741Z :NOTICE: [local] [local] [fb0771a5-a7b0e37c-1cb4bfd1-68ee8d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:43:16,320 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:43:16,338 - DEBUG - root - control_query: Result: 
2025-12-09 03:43:16,347 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd50te9ojse7rj"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251791
        nanos: 13504000
      }
      modified_at {
        seconds: 1765251796
        nanos: 332316000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251791
      nanos: 92000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd50te9ir9t28m-ptqudqgd50te9ojse7rj"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251791
      nanos: 13504000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $24 (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200629)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:16,860 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:17,373 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd50te9ojse7rj"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251791
        nanos: 13504000
      }
      modified_at {
        seconds: 1765251796
        nanos: 332316000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251791
      nanos: 92000000
    }
    finished_at {
      seconds: 1765251797
      nanos: 208000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd50te9ir9t28m-ptqudqgd50te9ojse7rj"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251791
      nanos: 13504000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"78ms\",\"count\":1,\"avg\":\"78ms\",\"max\":\"78ms\",\"min\":\"78ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $24 (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200629)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:18,514 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:18,515 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "cc77650c-158b-4124-8dce-bc9a15eb9af0"

2025-12-09 03:43:18,536 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd4poc5vuruih8"

2025-12-09 03:43:18,547 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4poc5vuruih8"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251798
        nanos: 519538000
      }
      modified_at {
        seconds: 1765251798
        nanos: 519538000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4poc5q5chpgg-ptqudqgd4poc5vuruih8"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251798
      nanos: 519538000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-09 03:43:19,055 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4poc5vuruih8"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251798
        nanos: 519538000
      }
      modified_at {
        seconds: 1765251798
        nanos: 519538000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251798
      nanos: 822000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4poc5q5chpgg-ptqudqgd4poc5vuruih8"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251798
      nanos: 519538000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"\\x12\\x9A\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $27 (SqlIn $26 $25 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $25 (Member $24 \'\"data\")) $27) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200725)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:43:20,764 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00214*\014shard-000000\032\022\"\00215*\014shard-000000"
  }
}

2025-12-09 03:43:20,765 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:43:20,765 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:43:20,767 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.6
2025-12-09 03:43:20,767 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:43:20,768 - DEBUG - ya.test - execute: Command pid: 1639048
2025-12-09 03:43:24,173 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:43:24,174 - DEBUG - ya.test - _save_outputs: Command (pid 1639048) rc: 0
2025-12-09 03:43:24,174 - DEBUG - ya.test - _save_outputs: Command (pid 1639048) elapsed time (sec): 3.404865026473999
2025-12-09 03:43:24,174 - DEBUG - ya.test - _save_outputs: Command (pid 1639048) wtime: 3.406
2025-12-09 03:43:24,174 - DEBUG - ya.test - _save_outputs: Command (pid 1639048) output:
None
2025-12-09 03:43:24,174 - DEBUG - ya.test - _save_outputs: Command (pid 1639048) errors:
2025-12-09T03:43:20.790201Z :INFO: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Starting read session
2025-12-09T03:43:20.790245Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Starting session to cluster null (localhost:15610)
2025-12-09T03:43:20.790730Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:20.790744Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:20.790751Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:43:20.796342Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] Successfully connected. Initializing session
2025-12-09T03:43:20.797499Z :INFO: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] Server session id: test_filters_non_optional_field_consumer_1_15_2950687477879389018_v1
2025-12-09T03:43:20.797589Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:20.798997Z :INFO: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:43:21.791265Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:7
2025-12-09T03:43:21.791312Z :INFO: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:24.079112Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:24.079193Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (7-7)
2025-12-09T03:43:24.079240Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (7-7)
2025-12-09T03:43:24.079357Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] Commit offsets [7, 8). Partition stream id: 1
2025-12-09T03:43:24.079450Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:43:24.081904Z :DEBUG: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:43:24.082079Z :INFO: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Closing read session. Close timeout: 5.000000s
2025-12-09T03:43:24.082105Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:7:8
2025-12-09T03:43:24.082116Z :INFO: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3291 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:43:24.082375Z :NOTICE: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:43:24.082508Z :INFO: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Closing read session. Close timeout: 0.000000s
2025-12-09T03:43:24.082520Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:7:8
2025-12-09T03:43:24.082541Z :INFO: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3292 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:24.082550Z :NOTICE: [local] [local] [88f9143b-bbb524f1-47f30adf-666d6cbd] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:43:24,177 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:43:24,197 - DEBUG - root - control_query: Result: 
2025-12-09 03:43:24,205 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4poc5vuruih8"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251798
        nanos: 519538000
      }
      modified_at {
        seconds: 1765251804
        nanos: 191451000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251798
      nanos: 822000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4poc5q5chpgg-ptqudqgd4poc5vuruih8"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251798
      nanos: 519538000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"\\x12\\x9A\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $27 (SqlIn $26 $25 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $25 (Member $24 \'\"data\")) $27) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200725)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:43:24,714 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:25,222 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4poc5vuruih8"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251798
        nanos: 519538000
      }
      modified_at {
        seconds: 1765251804
        nanos: 191451000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251798
      nanos: 822000000
    }
    finished_at {
      seconds: 1765251805
      nanos: 12000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4poc5q5chpgg-ptqudqgd4poc5vuruih8"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251798
      nanos: 519538000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"80ms\",\"count\":1,\"avg\":\"80ms\",\"max\":\"80ms\",\"min\":\"80ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"\\x12\\x9A\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $27 (SqlIn $26 $25 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $25 (Member $24 \'\"data\")) $27) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200725)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:43:26,329 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:26,329 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "2c98bf40-43ad-4a06-932c-26d18a937cc3"

2025-12-09 03:43:26,344 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd4i9t5cb4jrr1"

2025-12-09 03:43:26,351 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4i9t5cb4jrr1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251806
        nanos: 333728000
      }
      modified_at {
        seconds: 1765251806
        nanos: 333728000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4i9t4tlp1ufb-ptqudqgd4i9t5cb4jrr1"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251806
      nanos: 333728000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
}

2025-12-09 03:43:26,860 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4i9t5cb4jrr1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251806
        nanos: 333728000
      }
      modified_at {
        seconds: 1765251806
        nanos: 333728000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251806
      nanos: 459000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4i9t4tlp1ufb-ptqudqgd4i9t5cb4jrr1"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251806
      nanos: 333728000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF((`event` = \"event2\"), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"ZI\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 (If (== $25 (String \'\"event2\")) (AggrNotEquals $25 (Member $24 \'\"data\")) (Bool \'\"false\")))\n    (return (OptionalIf $26 (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:43:26,926 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00216*\014shard-000000\032\022\"\00217*\014shard-000000"
  }
}

2025-12-09 03:43:26,926 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:43:26,927 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:43:26,929 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.7
2025-12-09 03:43:26,929 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:43:26,930 - DEBUG - ya.test - execute: Command pid: 1642180
2025-12-09 03:43:31,643 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:43:31,644 - DEBUG - ya.test - _save_outputs: Command (pid 1642180) rc: 0
2025-12-09 03:43:31,644 - DEBUG - ya.test - _save_outputs: Command (pid 1642180) elapsed time (sec): 4.713246583938599
2025-12-09 03:43:31,644 - DEBUG - ya.test - _save_outputs: Command (pid 1642180) wtime: 4.714
2025-12-09 03:43:31,644 - DEBUG - ya.test - _save_outputs: Command (pid 1642180) output:
None
2025-12-09 03:43:31,644 - DEBUG - ya.test - _save_outputs: Command (pid 1642180) errors:
2025-12-09T03:43:26.945355Z :INFO: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Starting read session
2025-12-09T03:43:26.945403Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Starting session to cluster null (localhost:15610)
2025-12-09T03:43:26.945907Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:26.945922Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:26.945928Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:43:26.951983Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] Successfully connected. Initializing session
2025-12-09T03:43:26.953919Z :INFO: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] Server session id: test_filters_non_optional_field_consumer_1_17_16867855572373145981_v1
2025-12-09T03:43:26.954016Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:26.955335Z :INFO: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:43:27.946256Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:8
2025-12-09T03:43:27.946303Z :INFO: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:31.632376Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:31.632451Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (8-8)
2025-12-09T03:43:31.632523Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-12-09T03:43:31.632654Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] Commit offsets [8, 9). Partition stream id: 1
2025-12-09T03:43:31.632737Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:43:31.634877Z :DEBUG: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:43:31.635051Z :INFO: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Closing read session. Close timeout: 5.000000s
2025-12-09T03:43:31.635080Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:8:9
2025-12-09T03:43:31.635087Z :INFO: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4689 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:43:31.635280Z :NOTICE: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:43:31.635468Z :INFO: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Closing read session. Close timeout: 0.000000s
2025-12-09T03:43:31.635493Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:8:9
2025-12-09T03:43:31.635516Z :INFO: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4690 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:31.635530Z :NOTICE: [local] [local] [e2a784c-c3959d71-bcd99bfc-29621c76] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:43:31,645 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:43:31,663 - DEBUG - root - control_query: Result: 
2025-12-09 03:43:31,671 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4i9t5cb4jrr1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251806
        nanos: 333728000
      }
      modified_at {
        seconds: 1765251811
        nanos: 656675000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251806
      nanos: 459000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4i9t4tlp1ufb-ptqudqgd4i9t5cb4jrr1"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251806
      nanos: 333728000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF((`event` = \"event2\"), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"ZI\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 (If (== $25 (String \'\"event2\")) (AggrNotEquals $25 (Member $24 \'\"data\")) (Bool \'\"false\")))\n    (return (OptionalIf $26 (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:43:32,196 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:32,705 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4i9t5cb4jrr1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251806
        nanos: 333728000
      }
      modified_at {
        seconds: 1765251811
        nanos: 656675000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251806
      nanos: 459000000
    }
    finished_at {
      seconds: 1765251812
      nanos: 566000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4i9t4tlp1ufb-ptqudqgd4i9t5cb4jrr1"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251806
      nanos: 333728000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF((`event` = \"event2\"), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"82ms\",\"count\":1,\"avg\":\"82ms\",\"max\":\"82ms\",\"min\":\"82ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"ZI\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 (If (== $25 (String \'\"event2\")) (AggrNotEquals $25 (Member $24 \'\"data\")) (Bool \'\"false\")))\n    (return (OptionalIf $26 (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:43:33,826 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:33,827 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "1de396c6-8962-4d82-a65e-eff01220308d"

2025-12-09 03:43:33,842 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd4b52vcrgbdqd"

2025-12-09 03:43:33,849 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4b52vcrgbdqd"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251813
        nanos: 831627000
      }
      modified_at {
        seconds: 1765251813
        nanos: 831627000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4b52v8cp8ki9-ptqudqgd4b52vcrgbdqd"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251813
      nanos: 831627000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
}

2025-12-09 03:43:34,358 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4b52vcrgbdqd"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251813
        nanos: 831627000
      }
      modified_at {
        seconds: 1765251813
        nanos: 831627000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251814
      nanos: 102000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4b52v8cp8ki9-ptqudqgd4b52vcrgbdqd"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251813
      nanos: 831627000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (ToBytes (Member $22 \'\"nested\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200688)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:35,520 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00218*\014shard-000000\032\022\"\00219*\014shard-000000"
  }
}

2025-12-09 03:43:35,520 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:43:35,521 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:43:35,523 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.8
2025-12-09 03:43:35,523 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:43:35,524 - DEBUG - ya.test - execute: Command pid: 1645791
2025-12-09 03:43:39,330 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:43:39,331 - DEBUG - ya.test - _save_outputs: Command (pid 1645791) rc: 0
2025-12-09 03:43:39,331 - DEBUG - ya.test - _save_outputs: Command (pid 1645791) elapsed time (sec): 3.8056914806365967
2025-12-09 03:43:39,331 - DEBUG - ya.test - _save_outputs: Command (pid 1645791) wtime: 3.807
2025-12-09 03:43:39,331 - DEBUG - ya.test - _save_outputs: Command (pid 1645791) output:
None
2025-12-09 03:43:39,331 - DEBUG - ya.test - _save_outputs: Command (pid 1645791) errors:
2025-12-09T03:43:35.540549Z :INFO: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Starting read session
2025-12-09T03:43:35.540593Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Starting session to cluster null (localhost:15610)
2025-12-09T03:43:35.541079Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:35.541093Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:35.541099Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:43:35.545686Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] Successfully connected. Initializing session
2025-12-09T03:43:35.546883Z :INFO: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] Server session id: test_filters_non_optional_field_consumer_1_19_10640997012640097244_v1
2025-12-09T03:43:35.547004Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:35.548515Z :INFO: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:43:36.541271Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:9
2025-12-09T03:43:36.541308Z :INFO: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:39.286576Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:39.286677Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (9-9)
2025-12-09T03:43:39.286732Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (9-9)
2025-12-09T03:43:39.286837Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] Commit offsets [9, 10). Partition stream id: 1
2025-12-09T03:43:39.286947Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:43:39.289529Z :DEBUG: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:43:39.289663Z :INFO: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Closing read session. Close timeout: 5.000000s
2025-12-09T03:43:39.289689Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:9:10
2025-12-09T03:43:39.289697Z :INFO: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3749 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:43:39.289920Z :NOTICE: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:43:39.290069Z :INFO: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Closing read session. Close timeout: 0.000000s
2025-12-09T03:43:39.290083Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:9:10
2025-12-09T03:43:39.290110Z :INFO: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3749 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:39.290117Z :NOTICE: [local] [local] [8fe37328-787bbe94-1f928918-d487fef9] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:43:39,332 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:43:39,348 - DEBUG - root - control_query: Result: 
2025-12-09 03:43:39,355 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4b52vcrgbdqd"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251813
        nanos: 831627000
      }
      modified_at {
        seconds: 1765251819
        nanos: 342576000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251814
      nanos: 102000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4b52v8cp8ki9-ptqudqgd4b52vcrgbdqd"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251813
      nanos: 831627000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (ToBytes (Member $22 \'\"nested\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200688)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:39,864 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:40,372 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd4b52vcrgbdqd"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251813
        nanos: 831627000
      }
      modified_at {
        seconds: 1765251819
        nanos: 342576000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251814
      nanos: 102000000
    }
    finished_at {
      seconds: 1765251820
      nanos: 215000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd4b52v8cp8ki9-ptqudqgd4b52vcrgbdqd"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251813
      nanos: 831627000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"83ms\",\"count\":1,\"avg\":\"83ms\",\"max\":\"83ms\",\"min\":\"83ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (ToBytes (Member $22 \'\"nested\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200688)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:41,479 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:41,480 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "2cd60290-2586-4304-a7d8-76def263c7b2"

2025-12-09 03:43:41,496 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd43rh3rei7vaa"

2025-12-09 03:43:41,505 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd43rh3rei7vaa"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251821
        nanos: 484876000
      }
      modified_at {
        seconds: 1765251821
        nanos: 484876000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd43rh3mnt8qr1-ptqudqgd43rh3rei7vaa"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251821
      nanos: 484876000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
}

2025-12-09 03:43:42,017 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd43rh3rei7vaa"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251821
        nanos: 484876000
      }
      modified_at {
        seconds: 1765251821
        nanos: 484876000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251821
      nanos: 829000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd43rh3mnt8qr1-ptqudqgd43rh3rei7vaa"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251821
      nanos: 484876000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 120
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 120
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 165
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 165
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 150
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 150
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 155
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 155
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: Map, At function: NarrowMap, At function: WideFilter, At lambda"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 165
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 165
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 150
            }
            message: "At function: Just, At function: SafeCast"
            end_position {
              row: 5
              column: 150
            }
            severity: 2
            issues {
              position {
                row: 4
                column: 13
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 4
                column: 13
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (SafeCast (Member $22 \'\"nested\") $13))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200694)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:43,713 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00220*\014shard-000000\032\022\"\00221*\014shard-000000"
  }
}

2025-12-09 03:43:43,714 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:43:43,714 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:43:43,715 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.9
2025-12-09 03:43:43,716 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:43:43,717 - DEBUG - ya.test - execute: Command pid: 1648707
2025-12-09 03:43:47,022 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:43:47,023 - DEBUG - ya.test - _save_outputs: Command (pid 1648707) rc: 0
2025-12-09 03:43:47,023 - DEBUG - ya.test - _save_outputs: Command (pid 1648707) elapsed time (sec): 3.3051257133483887
2025-12-09 03:43:47,023 - DEBUG - ya.test - _save_outputs: Command (pid 1648707) wtime: 3.306
2025-12-09 03:43:47,024 - DEBUG - ya.test - _save_outputs: Command (pid 1648707) output:
None
2025-12-09 03:43:47,024 - DEBUG - ya.test - _save_outputs: Command (pid 1648707) errors:
2025-12-09T03:43:43.733121Z :INFO: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Starting read session
2025-12-09T03:43:43.733171Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Starting session to cluster null (localhost:15610)
2025-12-09T03:43:43.733603Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:43.733616Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:43.733621Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:43:43.738904Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] Successfully connected. Initializing session
2025-12-09T03:43:43.739949Z :INFO: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] Server session id: test_filters_non_optional_field_consumer_1_21_17605859348511208409_v1
2025-12-09T03:43:43.740025Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:43.741319Z :INFO: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:43:44.734284Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:10
2025-12-09T03:43:44.734326Z :INFO: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:47.012245Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:47.012333Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (10-10)
2025-12-09T03:43:47.012381Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-12-09T03:43:47.012481Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] Commit offsets [10, 11). Partition stream id: 1
2025-12-09T03:43:47.012559Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:43:47.015327Z :DEBUG: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:43:47.015478Z :INFO: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Closing read session. Close timeout: 5.000000s
2025-12-09T03:43:47.015523Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:10:11
2025-12-09T03:43:47.015534Z :INFO: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3282 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:43:47.015779Z :NOTICE: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:43:47.015928Z :INFO: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Closing read session. Close timeout: 0.000000s
2025-12-09T03:43:47.015945Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:10:11
2025-12-09T03:43:47.015965Z :INFO: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3282 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:47.015976Z :NOTICE: [local] [local] [f3f122a8-629a2ace-fef8cff1-74c27c42] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:43:47,025 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:43:47,041 - DEBUG - root - control_query: Result: 
2025-12-09 03:43:47,050 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd43rh3rei7vaa"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251821
        nanos: 484876000
      }
      modified_at {
        seconds: 1765251827
        nanos: 36000000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251821
      nanos: 829000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd43rh3mnt8qr1-ptqudqgd43rh3rei7vaa"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251821
      nanos: 484876000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 120
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 120
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 165
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 165
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 150
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 150
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 155
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 155
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: Map, At function: NarrowMap, At function: WideFilter, At lambda"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 165
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 165
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 150
            }
            message: "At function: Just, At function: SafeCast"
            end_position {
              row: 5
              column: 150
            }
            severity: 2
            issues {
              position {
                row: 4
                column: 13
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 4
                column: 13
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (SafeCast (Member $22 \'\"nested\") $13))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200694)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:47,561 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:48,069 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd43rh3rei7vaa"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251821
        nanos: 484876000
      }
      modified_at {
        seconds: 1765251827
        nanos: 36000000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251821
      nanos: 829000000
    }
    finished_at {
      seconds: 1765251827
      nanos: 944000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd43rh3mnt8qr1-ptqudqgd43rh3rei7vaa"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251821
      nanos: 484876000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 120
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 120
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 165
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 165
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 150
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 150
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 155
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 155
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: Map, At function: NarrowMap, At function: WideFilter, At lambda"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 165
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 165
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 150
            }
            message: "At function: Just, At function: SafeCast"
            end_position {
              row: 5
              column: 150
            }
            severity: 2
            issues {
              position {
                row: 4
                column: 13
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 4
                column: 13
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"85ms\",\"count\":1,\"avg\":\"85ms\",\"max\":\"85ms\",\"min\":\"85ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (SafeCast (Member $22 \'\"nested\") $13))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200694)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:43:49,181 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:49,181 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "2ab12398-cf5e-4359-bf15-dd2ca4831df0"

2025-12-09 03:43:49,197 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd3sggfv54mhdb"

2025-12-09 03:43:49,204 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3sggfv54mhdb"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251829
        nanos: 185976000
      }
      modified_at {
        seconds: 1765251829
        nanos: 185976000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3sgg7r6grma2-ptqudqgd3sggfv54mhdb"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251829
      nanos: 185976000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
}

2025-12-09 03:43:49,712 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3sggfv54mhdb"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251829
        nanos: 185976000
      }
      modified_at {
        seconds: 1765251829
        nanos: 185976000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251829
      nanos: 472000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3sgg7r6grma2-ptqudqgd3sggfv54mhdb"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251829
      nanos: 185976000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:50,850 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00222*\014shard-000000\032\022\"\00223*\014shard-000000"
  }
}

2025-12-09 03:43:50,850 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:43:50,851 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:43:50,852 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.10
2025-12-09 03:43:50,853 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:43:50,853 - DEBUG - ya.test - execute: Command pid: 1650902
2025-12-09 03:43:54,659 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:43:54,659 - DEBUG - ya.test - _save_outputs: Command (pid 1650902) rc: 0
2025-12-09 03:43:54,660 - DEBUG - ya.test - _save_outputs: Command (pid 1650902) elapsed time (sec): 3.8054826259613037
2025-12-09 03:43:54,660 - DEBUG - ya.test - _save_outputs: Command (pid 1650902) wtime: 3.807
2025-12-09 03:43:54,660 - DEBUG - ya.test - _save_outputs: Command (pid 1650902) output:
None
2025-12-09 03:43:54,660 - DEBUG - ya.test - _save_outputs: Command (pid 1650902) errors:
2025-12-09T03:43:50.872402Z :INFO: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Starting read session
2025-12-09T03:43:50.872443Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Starting session to cluster null (localhost:15610)
2025-12-09T03:43:50.872898Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:50.872912Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:50.872919Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:43:50.878132Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] Successfully connected. Initializing session
2025-12-09T03:43:50.879438Z :INFO: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] Server session id: test_filters_non_optional_field_consumer_1_23_17769454838849015481_v1
2025-12-09T03:43:50.879490Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:50.880860Z :INFO: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:43:51.873213Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:11
2025-12-09T03:43:51.873246Z :INFO: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:54.620524Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:54.620601Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (11-11)
2025-12-09T03:43:54.620645Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (11-11)
2025-12-09T03:43:54.620760Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] Commit offsets [11, 12). Partition stream id: 1
2025-12-09T03:43:54.620861Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:43:54.623274Z :DEBUG: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:43:54.623382Z :INFO: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Closing read session. Close timeout: 5.000000s
2025-12-09T03:43:54.623402Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:11:12
2025-12-09T03:43:54.623409Z :INFO: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3751 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:43:54.623649Z :NOTICE: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:43:54.627026Z :INFO: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Closing read session. Close timeout: 0.000000s
2025-12-09T03:43:54.627042Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:11:12
2025-12-09T03:43:54.627059Z :INFO: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3754 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:43:54.627081Z :NOTICE: [local] [local] [feba57df-255035a2-2b2215d1-6336ca42] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:43:54,660 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:43:54,675 - DEBUG - root - control_query: Result: 
2025-12-09 03:43:54,682 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3sggfv54mhdb"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251829
        nanos: 185976000
      }
      modified_at {
        seconds: 1765251834
        nanos: 670586000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251829
      nanos: 472000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3sgg7r6grma2-ptqudqgd3sggfv54mhdb"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251829
      nanos: 185976000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:55,190 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:55,697 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3sggfv54mhdb"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251829
        nanos: 185976000
      }
      modified_at {
        seconds: 1765251834
        nanos: 670586000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251829
      nanos: 472000000
    }
    finished_at {
      seconds: 1765251835
      nanos: 573000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3sgg7r6grma2-ptqudqgd3sggfv54mhdb"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251829
      nanos: 185976000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"60ms\",\"count\":1,\"avg\":\"60ms\",\"max\":\"60ms\",\"min\":\"60ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:56,257 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-09 03:43:56,257 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:43:56,263 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-09 03:43:56,263 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, e348bbb4-ab08-42cd-a19b-0b405455ea7d, localhost:15610): creating call state
2025-12-09 03:43:56,264 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, e348bbb4-ab08-42cd-a19b-0b405455ea7d, localhost:15610): request = { database: "local" }
2025-12-09 03:43:56,266 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, e348bbb4-ab08-42cd-a19b-0b405455ea7d, localhost:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-syjwtgwtdu.auto.internal" port: 15610 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-09 03:43:56,267 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-syjwtgwtdu.auto.internal:15610, location 1, ssl: False>]>
2025-12-09 03:43:56,268 - INFO - ydb.connection - close: Closing channel for endpoint localhost:15610
2025-12-09 03:43:56,800 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:43:56,801 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "d4f54139-c233-4fce-9be7-29f2ca78503a"

2025-12-09 03:43:56,816 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd3l808hqik8dq"

2025-12-09 03:43:56,824 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3l808hqik8dq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251836
        nanos: 804792000
      }
      modified_at {
        seconds: 1765251836
        nanos: 804792000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3l808c9pr1ae-ptqudqgd3l808hqik8dq"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251836
      nanos: 804792000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
}

2025-12-09 03:43:57,333 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3l808hqik8dq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251836
        nanos: 804792000
      }
      modified_at {
        seconds: 1765251836
        nanos: 804792000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251836
      nanos: 830000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3l808c9pr1ae-ptqudqgd3l808hqik8dq"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251836
      nanos: 804792000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:43:58,455 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00224*\014shard-000000\032\022\"\00225*\014shard-000000"
  }
}

2025-12-09 03:43:58,456 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:43:58,456 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:43:58,457 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.11
2025-12-09 03:43:58,458 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:43:58,458 - DEBUG - ya.test - execute: Command pid: 1653690
2025-12-09 03:44:02,064 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:44:02,066 - DEBUG - ya.test - _save_outputs: Command (pid 1653690) rc: 0
2025-12-09 03:44:02,066 - DEBUG - ya.test - _save_outputs: Command (pid 1653690) elapsed time (sec): 3.605613946914673
2025-12-09 03:44:02,067 - DEBUG - ya.test - _save_outputs: Command (pid 1653690) wtime: 3.607
2025-12-09 03:44:02,067 - DEBUG - ya.test - _save_outputs: Command (pid 1653690) output:
None
2025-12-09 03:44:02,067 - DEBUG - ya.test - _save_outputs: Command (pid 1653690) errors:
2025-12-09T03:43:58.474321Z :INFO: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Starting read session
2025-12-09T03:43:58.474373Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Starting session to cluster null (localhost:15610)
2025-12-09T03:43:58.474815Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:58.474831Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:58.474837Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:43:58.479106Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] Successfully connected. Initializing session
2025-12-09T03:43:58.480036Z :INFO: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] Server session id: test_filters_non_optional_field_consumer_1_25_8385423351044014221_v1
2025-12-09T03:43:58.480111Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:43:58.481156Z :INFO: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:43:59.475198Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:12
2025-12-09T03:43:59.475237Z :INFO: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:44:01.964726Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:01.964840Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (12-12)
2025-12-09T03:44:01.964895Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (12-12)
2025-12-09T03:44:01.965021Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] Commit offsets [12, 13). Partition stream id: 1
2025-12-09T03:44:01.965152Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:44:01.967567Z :DEBUG: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:44:01.967727Z :INFO: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Closing read session. Close timeout: 5.000000s
2025-12-09T03:44:01.967759Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:12:13
2025-12-09T03:44:01.967768Z :INFO: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3493 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:44:01.968010Z :NOTICE: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:44:01.968190Z :INFO: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Closing read session. Close timeout: 0.000000s
2025-12-09T03:44:01.968206Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:12:13
2025-12-09T03:44:01.968224Z :INFO: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3493 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:44:01.968234Z :NOTICE: [local] [local] [cf5f99e0-d05cc0f3-8a268bd9-243723e6] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:44:02,067 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:44:02,086 - DEBUG - root - control_query: Result: 
2025-12-09 03:44:02,095 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3l808hqik8dq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251836
        nanos: 804792000
      }
      modified_at {
        seconds: 1765251842
        nanos: 80090000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251836
      nanos: 830000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3l808c9pr1ae-ptqudqgd3l808hqik8dq"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251836
      nanos: 804792000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:44:02,605 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:44:03,111 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3l808hqik8dq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251836
        nanos: 804792000
      }
      modified_at {
        seconds: 1765251842
        nanos: 80090000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251836
      nanos: 830000000
    }
    finished_at {
      seconds: 1765251842
      nanos: 922000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3l808c9pr1ae-ptqudqgd3l808hqik8dq"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251836
      nanos: 804792000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"47ms\",\"count\":1,\"avg\":\"47ms\",\"max\":\"47ms\",\"min\":\"47ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:44:04,223 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:44:04,223 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "56932443-470f-48a0-b990-1f62294766c0"

2025-12-09 03:44:04,238 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd3e5f07p5ncs4"

2025-12-09 03:44:04,247 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3e5f07p5ncs4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251844
        nanos: 228012000
      }
      modified_at {
        seconds: 1765251844
        nanos: 228012000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3e5evc4lqohv-ptqudqgd3e5f07p5ncs4"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251844
      nanos: 228012000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
}

2025-12-09 03:44:04,756 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3e5f07p5ncs4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251844
        nanos: 228012000
      }
      modified_at {
        seconds: 1765251844
        nanos: 228012000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251844
      nanos: 476000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3e5evc4lqohv-ptqudqgd3e5f07p5ncs4"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251844
      nanos: 228012000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:44:05,899 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00226*\014shard-000000\032\022\"\00227*\014shard-000000"
  }
}

2025-12-09 03:44:05,899 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-09 03:44:05,900 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:44:05,903 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.12
2025-12-09 03:44:05,903 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:44:05,904 - DEBUG - ya.test - execute: Command pid: 1655512
2025-12-09 03:44:09,711 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:44:09,712 - DEBUG - ya.test - _save_outputs: Command (pid 1655512) rc: 0
2025-12-09 03:44:09,712 - DEBUG - ya.test - _save_outputs: Command (pid 1655512) elapsed time (sec): 3.8065125942230225
2025-12-09 03:44:09,712 - DEBUG - ya.test - _save_outputs: Command (pid 1655512) wtime: 3.809
2025-12-09 03:44:09,713 - DEBUG - ya.test - _save_outputs: Command (pid 1655512) output:
None
2025-12-09 03:44:09,713 - DEBUG - ya.test - _save_outputs: Command (pid 1655512) errors:
2025-12-09T03:44:05.922678Z :INFO: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Starting read session
2025-12-09T03:44:05.922728Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Starting session to cluster null (localhost:15610)
2025-12-09T03:44:05.923073Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:05.923085Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:05.923091Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:44:05.927888Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] Successfully connected. Initializing session
2025-12-09T03:44:05.929015Z :INFO: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] Server session id: test_filters_non_optional_field_consumer_1_27_8881098617077533652_v1
2025-12-09T03:44:05.929095Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:05.930619Z :INFO: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:44:06.923214Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:13
2025-12-09T03:44:06.923239Z :INFO: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:44:09.626808Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:09.630307Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (13-13)
2025-12-09T03:44:09.630357Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (13-13)
2025-12-09T03:44:09.630482Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] Commit offsets [13, 14). Partition stream id: 1
2025-12-09T03:44:09.630613Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:44:09.635315Z :DEBUG: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:44:09.635472Z :INFO: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Closing read session. Close timeout: 5.000000s
2025-12-09T03:44:09.635493Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:13:14
2025-12-09T03:44:09.635502Z :INFO: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3712 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:44:09.635680Z :NOTICE: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:44:09.637261Z :INFO: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Closing read session. Close timeout: 0.000000s
2025-12-09T03:44:09.637273Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:13:14
2025-12-09T03:44:09.637295Z :INFO: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3714 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:44:09.637307Z :NOTICE: [local] [local] [e06243d1-514aa49b-b2bf6b85-c390700] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:44:09,714 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-09 03:44:09,732 - DEBUG - root - control_query: Result: 
2025-12-09 03:44:09,741 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3e5f07p5ncs4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251844
        nanos: 228012000
      }
      modified_at {
        seconds: 1765251849
        nanos: 726467000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251844
      nanos: 476000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3e5evc4lqohv-ptqudqgd3e5f07p5ncs4"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251844
      nanos: 228012000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:44:10,252 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:44:10,760 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd3e5f07p5ncs4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251844
        nanos: 228012000
      }
      modified_at {
        seconds: 1765251849
        nanos: 726467000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251844
      nanos: 476000000
    }
    finished_at {
      seconds: 1765251850
      nanos: 564000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd3e5evc4lqohv-ptqudqgd3e5f07p5ncs4"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251844
      nanos: 228012000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"59ms\",\"count\":1,\"avg\":\"59ms\",\"max\":\"59ms\",\"min\":\"59ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd6gl2jl1u5ng9\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:44:11,882 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:44:11,888 - INFO - ya.test - pytest_runtest_teardown: Test teardown
2025-12-09 03:44:43,892 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:17626/1
2025-12-09 03:44:43,894 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/12384
2025-12-09 03:44:43,894 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/1279
2025-12-09 03:44:43,894 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/23637
2025-12-09 03:44:43,895 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/17626
2025-12-09 03:44:43,895 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/29888
2025-12-09 03:44:43,895 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/21511
2025-12-09 03:44:44,896 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:28803/1
2025-12-09 03:44:44,898 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:15083/2
2025-12-09 03:44:44,898 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:4816/3
2025-12-09 03:44:44,900 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/4067
2025-12-09 03:44:44,900 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/29579
2025-12-09 03:44:44,901 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/10714
2025-12-09 03:44:44,901 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/4816
2025-12-09 03:44:44,901 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/32528
2025-12-09 03:44:44,901 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/22105
2025-12-09 03:44:44,901 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/29037
2025-12-09 03:44:44,902 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/15083
2025-12-09 03:44:44,902 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/21533
2025-12-09 03:44:44,902 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/21932
2025-12-09 03:44:44,902 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/1377
2025-12-09 03:44:44,902 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/28803
2025-12-09 03:44:44,903 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/11390
2025-12-09 03:44:44,903 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/7801
2025-12-09 03:44:44,903 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/23491
