2025-12-12 12:35:08,446 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-12 12:35:08,446 - INFO - ya.test - pytest_runtest_setup: test_filters_non_optional_field
2025-12-12 12:35:08,446 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-12 12:35:08,446 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-12-12 12:35:08,453 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/10228
2025-12-12 12:35:08,455 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/7579
2025-12-12 12:35:08,509 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:35:08,510 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/29505
2025-12-12 12:35:08,571 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:35:08,572 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16991
2025-12-12 12:35:08,573 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/2006
2025-12-12 12:35:08,573 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/15278
2025-12-12 12:35:08,574 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/7286
2025-12-12 12:35:08,575 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:35:08,579 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-12 12:35:08,582 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:35:08,589 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-12 12:35:08,589 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 440967c9-952b-4fa0-b7a3-2e72b021e205, localhost:63390): creating call state
2025-12-12 12:35:08,590 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 440967c9-952b-4fa0-b7a3-2e72b021e205, localhost:63390): request = { database: "local" }
2025-12-12 12:35:08,593 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 440967c9-952b-4fa0-b7a3-2e72b021e205, localhost:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-fhkyrtz6p4.auto.internal" port: 63390 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-12 12:35:08,594 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-fhkyrtz6p4.auto.internal:63390, location 1, ssl: False>]>
2025-12-12 12:35:08,594 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:35:08,602 - INFO - ydb.connection - close: Closing channel for endpoint localhost:63390
2025-12-12 12:35:08,603 - DEBUG - ydb.table.SessionPool - subscribe: Active session queue is empty, subscribe waiter for a session
2025-12-12 12:35:08,604 - DEBUG - ydb.table.SessionPool - subscribe: Subscribe waiter <Future at 0x7fcaa2125280 state=pending>
2025-12-12 12:35:08,606 - DEBUG - ydb.table.SessionPool - subscribe: Session pool is not large enough (active_count < size: 0 < 1). will create a new session.
2025-12-12 12:35:08,606 - DEBUG - ydb.table.SessionPool - _create: Created session <ydb.table.Session object at 0x7fcaa25f8a60>
2025-12-12 12:35:08,607 - DEBUG - ydb.table.SessionPool - _prepare: Preparing session <ydb.table.Session object at 0x7fcaa25f8a60>
2025-12-12 12:35:08,607 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateSession, 44275f2a-635b-414c-8ea3-2e102313304d, ghrun-fhkyrtz6p4.auto.internal:63390): creating call state
2025-12-12 12:35:08,608 - DEBUG - ydb.connection - _log_request: RpcState(CreateSession, 44275f2a-635b-414c-8ea3-2e102313304d, ghrun-fhkyrtz6p4.auto.internal:63390): request = { operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } }
2025-12-12 12:35:08,610 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 44275f2a-635b-414c-8ea3-2e102313304d, ghrun-fhkyrtz6p4.auto.internal:63390): on response callback started
2025-12-12 12:35:08,611 - DEBUG - ydb.connection - _log_response: RpcState(CreateSession, 44275f2a-635b-414c-8ea3-2e102313304d, ghrun-fhkyrtz6p4.auto.internal:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.CreateSessionResult] { session_id: "ydb://session/3?node_id=1&id=ZTkwZDZhMDktNGJmNzg4NWEtZmRkNTk4MTQtM2VkNThjZWI=" } } } }
2025-12-12 12:35:08,613 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7fcaa25f8a60>
2025-12-12 12:35:08,613 - DEBUG - ydb.table.SessionPool - put: Replying to waiter with a session <ydb.table.Session object at 0x7fcaa25f8a60>
2025-12-12 12:35:08,613 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 44275f2a-635b-414c-8ea3-2e102313304d, ghrun-fhkyrtz6p4.auto.internal:63390): on response callback success
2025-12-12 12:35:08,614 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 9f4f377b-bdcb-4bf1-9d6a-f7554a8944a8, ghrun-fhkyrtz6p4.auto.internal:63390): creating call state
2025-12-12 12:35:08,615 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 9f4f377b-bdcb-4bf1-9d6a-f7554a8944a8, ghrun-fhkyrtz6p4.auto.internal:63390): request = { session_id: "ydb://session/3?node_id=1&id=ZTkwZDZhMDktNGJmNzg4NWEtZmRkNTk4MTQtM2VkNThjZWI=" path: "local/DbPoolStorage_5beb902e-3fb4-4299-803e-d17a5b8774af/tenants" columns { name: "tenant" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "common" type { optional_type { item { type_id: BOOL } } } } columns { name: "state" type { optional_type { item { type_id: UINT32 } } } } columns { name: "state_time" type { optional_type { item { type_id: TIMESTAMP } } } } primary_key: "tenant" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-12 12:35:08,653 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 9f4f377b-bdcb-4bf1-9d6a-f7554a8944a8, ghrun-fhkyrtz6p4.auto.internal:63390): response = { operation { ready: true status: SUCCESS } }
2025-12-12 12:35:08,654 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7fcaa25f8a60>
2025-12-12 12:35:08,655 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 020611be-d60a-44fb-aaf1-4dbf341440a3, ghrun-fhkyrtz6p4.auto.internal:63390): creating call state
2025-12-12 12:35:08,655 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 020611be-d60a-44fb-aaf1-4dbf341440a3, ghrun-fhkyrtz6p4.auto.internal:63390): request = { session_id: "ydb://session/3?node_id=1&id=ZTkwZDZhMDktNGJmNzg4NWEtZmRkNTk4MTQtM2VkNThjZWI=" path: "local/DbPoolStorage_5beb902e-3fb4-4299-803e-d17a5b8774af/mappings" columns { name: "subject_type" type { optional_type { item { type_id: STRING } } } } columns { name: "subject_id" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "node" type { optional_type { item { type_id: STRING } } } } primary_key: "subject_type" primary_key: "subject_id" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-12 12:35:08,680 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 020611be-d60a-44fb-aaf1-4dbf341440a3, ghrun-fhkyrtz6p4.auto.internal:63390): response = { operation { ready: true status: SUCCESS } }
2025-12-12 12:35:08,681 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7fcaa25f8a60>
2025-12-12 12:35:08,681 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteDataQuery, fdb04f8a-eb82-4d98-b393-8730c3ba074c, ghrun-fhkyrtz6p4.auto.internal:63390): creating call state
2025-12-12 12:35:08,682 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteDataQuery, fdb04f8a-eb82-4d98-b393-8730c3ba074c, ghrun-fhkyrtz6p4.auto.internal:63390): request = { session_id: "ydb://session/3?node_id=1&id=ZTkwZDZhMDktNGJmNzg4NWEtZmRkNTk4MTQtM2VkNThjZWI=" tx_control { begin_tx { serializable_read_write { } } commit_tx: true } query { yql_text: "--!syntax_v1\n            PRAGMA TablePathPrefix(\"local/DbPoolStorage_5beb902e-3fb4-4299-803e-d17a5b8774af\");\n            UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/compute\", \"/compute\", true, 0, CurrentUtcTimestamp());\n                " } operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-12 12:35:08,737 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteDataQuery, fdb04f8a-eb82-4d98-b393-8730c3ba074c, ghrun-fhkyrtz6p4.auto.internal:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.ExecuteQueryResult] { tx_meta { } } } } }
2025-12-12 12:35:08,738 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7fcaa25f8a60>
2025-12-12 12:35:08,811 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:35:08,816 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16902
2025-12-12 12:35:08,817 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/20950
2025-12-12 12:35:08,822 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/9797
2025-12-12 12:35:08,826 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/kikimr_configs"
2025-12-12 12:35:08,829 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/node_1/logfile_2td2ubg2.log --grpc-port=7286 --mon-port=16902 --ic-port=29505
2025-12-12 12:35:08,829 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/kikimr_configs"
2025-12-12 12:35:08,831 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/node_1/logfile_2td2ubg2.log --grpc-port=7286 --mon-port=16902 --ic-port=29505
2025-12-12 12:35:08,833 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/kikimr_configs/config.yaml', '--node=1', '--tenant=/cp', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/node_1/logfile_2td2ubg2.log', '--grpc-port=7286', '--mon-port=16902', '--ic-port=29505')' in '/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/cp/node_1' (no wait)
2025-12-12 12:35:08,841 - DEBUG - ya.test - execute: Command pid: 1479282
2025-12-12 12:35:08,845 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:7286/1
2025-12-12 12:35:08,846 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out
2025-12-12 12:35:08,847 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err
2025-12-12 12:35:08,847 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-12 12:35:08,848 - DEBUG - ya.test - execute: Command pid: 1479289
2025-12-12 12:35:09,277 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) rc: 0
2025-12-12 12:35:09,278 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) elapsed time (sec): 0.42863011360168457
2025-12-12 12:35:09,278 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) idrss: 0
2025-12-12 12:35:09,278 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) inblock: 0
2025-12-12 12:35:09,278 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) isrss: 0
2025-12-12 12:35:09,278 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) ixrss: 0
2025-12-12 12:35:09,279 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) majflt: 0
2025-12-12 12:35:09,279 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) maxrss: 544132
2025-12-12 12:35:09,279 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) minflt: 16225
2025-12-12 12:35:09,279 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) msgrcv: 0
2025-12-12 12:35:09,279 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) msgsnd: 0
2025-12-12 12:35:09,279 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) nivcsw: 37
2025-12-12 12:35:09,279 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) nsignals: 0
2025-12-12 12:35:09,279 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) nswap: 0
2025-12-12 12:35:09,280 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) nvcsw: 13
2025-12-12 12:35:09,280 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) oublock: 8
2025-12-12 12:35:09,280 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) stime: 0.25937699999999997
2025-12-12 12:35:09,280 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) utime: 0.108456
2025-12-12 12:35:09,280 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) wtime: 0.43
2025-12-12 12:35:09,281 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) output:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-fhkyrtz6p4
    Host information: 
        Linux ghrun-fhkyrtz6p4 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-12 12:35:09,281 - DEBUG - ya.test - _save_outputs: Command (pid 1479289) errors:

2025-12-12 12:35:09,282 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd
2025-12-12 12:35:09,282 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-12-12 12:35:09,314 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:35:09,315 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1791
2025-12-12 12:35:09,315 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/3804
2025-12-12 12:35:09,318 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/18260
2025-12-12 12:35:09,319 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/3373
2025-12-12 12:35:09,320 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-12 12:35:09,321 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_1/logfile_l0xw7t0g.log --grpc-port=1791 --mon-port=3804 --ic-port=16991
2025-12-12 12:35:09,322 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:35:09,322 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/7833
2025-12-12 12:35:09,323 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1066
2025-12-12 12:35:09,323 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/1066
2025-12-12 12:35:09,323 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1067
2025-12-12 12:35:09,325 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1983
2025-12-12 12:35:09,325 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/63373
2025-12-12 12:35:09,326 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-12 12:35:09,326 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=2 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_2/logfile_n94hy1b5.log --grpc-port=7833 --mon-port=1067 --ic-port=2006
2025-12-12 12:35:09,326 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:35:09,327 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/19680
2025-12-12 12:35:09,327 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/23727
2025-12-12 12:35:09,329 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/8356
2025-12-12 12:35:09,329 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/21918
2025-12-12 12:35:09,329 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-12 12:35:09,330 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=3 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_3/logfile_jarfj8tt.log --grpc-port=19680 --mon-port=23727 --ic-port=15278
2025-12-12 12:35:09,330 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-12 12:35:09,330 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_1/logfile_l0xw7t0g.log --grpc-port=1791 --mon-port=3804 --ic-port=16991
2025-12-12 12:35:09,331 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs/config.yaml', '--node=1', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_1/logfile_l0xw7t0g.log', '--grpc-port=1791', '--mon-port=3804', '--ic-port=16991')' in '/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_1' (no wait)
2025-12-12 12:35:09,333 - DEBUG - ya.test - execute: Command pid: 1480063
2025-12-12 12:35:09,333 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:1791/1
2025-12-12 12:35:09,334 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.0
2025-12-12 12:35:09,334 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.0
2025-12-12 12:35:09,335 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-12 12:35:09,335 - DEBUG - ya.test - execute: Command pid: 1480071
2025-12-12 12:35:09,769 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) rc: 0
2025-12-12 12:35:09,769 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) elapsed time (sec): 0.4326057434082031
2025-12-12 12:35:09,769 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) idrss: 0
2025-12-12 12:35:09,769 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) inblock: 0
2025-12-12 12:35:09,770 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) isrss: 0
2025-12-12 12:35:09,770 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) ixrss: 0
2025-12-12 12:35:09,770 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) majflt: 0
2025-12-12 12:35:09,770 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) maxrss: 544132
2025-12-12 12:35:09,770 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) minflt: 16257
2025-12-12 12:35:09,770 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) msgrcv: 0
2025-12-12 12:35:09,771 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) msgsnd: 0
2025-12-12 12:35:09,771 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) nivcsw: 32
2025-12-12 12:35:09,771 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) nsignals: 0
2025-12-12 12:35:09,771 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) nswap: 0
2025-12-12 12:35:09,771 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) nvcsw: 13
2025-12-12 12:35:09,771 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) oublock: 8
2025-12-12 12:35:09,772 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) stime: 0.263751
2025-12-12 12:35:09,772 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) utime: 0.109523
2025-12-12 12:35:09,772 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) wtime: 0.434
2025-12-12 12:35:09,772 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) output:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-fhkyrtz6p4
    Host information: 
        Linux ghrun-fhkyrtz6p4 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-12 12:35:09,772 - DEBUG - ya.test - _save_outputs: Command (pid 1480071) errors:

2025-12-12 12:35:09,773 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd
2025-12-12 12:35:09,773 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-12 12:35:09,773 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=2 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_2/logfile_n94hy1b5.log --grpc-port=7833 --mon-port=1067 --ic-port=2006
2025-12-12 12:35:09,775 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs/config.yaml', '--node=2', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_2/logfile_n94hy1b5.log', '--grpc-port=7833', '--mon-port=1067', '--ic-port=2006')' in '/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_2' (no wait)
2025-12-12 12:35:09,776 - DEBUG - ya.test - execute: Command pid: 1480483
2025-12-12 12:35:09,777 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:7833/2
2025-12-12 12:35:09,778 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.1
2025-12-12 12:35:09,778 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.1
2025-12-12 12:35:09,779 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-12 12:35:09,780 - DEBUG - ya.test - execute: Command pid: 1480484
2025-12-12 12:35:10,207 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) rc: 0
2025-12-12 12:35:10,208 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) elapsed time (sec): 0.426422119140625
2025-12-12 12:35:10,208 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) idrss: 0
2025-12-12 12:35:10,208 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) inblock: 0
2025-12-12 12:35:10,208 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) isrss: 0
2025-12-12 12:35:10,208 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) ixrss: 0
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) majflt: 0
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) maxrss: 544132
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) minflt: 16231
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) msgrcv: 0
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) msgsnd: 0
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) nivcsw: 53
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) nsignals: 0
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) nswap: 0
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) nvcsw: 13
2025-12-12 12:35:10,209 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) oublock: 8
2025-12-12 12:35:10,210 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) stime: 0.25032699999999997
2025-12-12 12:35:10,210 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) utime: 0.11920299999999999
2025-12-12 12:35:10,210 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) wtime: 0.427
2025-12-12 12:35:10,210 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) output:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-fhkyrtz6p4
    Host information: 
        Linux ghrun-fhkyrtz6p4 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-12 12:35:10,211 - DEBUG - ya.test - _save_outputs: Command (pid 1480484) errors:

2025-12-12 12:35:10,211 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 2 version:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd
2025-12-12 12:35:10,211 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs"
2025-12-12 12:35:10,212 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=3 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_3/logfile_jarfj8tt.log --grpc-port=19680 --mon-port=23727 --ic-port=15278
2025-12-12 12:35:10,212 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/kikimr_configs/config.yaml', '--node=3', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_3/logfile_jarfj8tt.log', '--grpc-port=19680', '--mon-port=23727', '--ic-port=15278')' in '/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_non_optional_field/compute/node_3' (no wait)
2025-12-12 12:35:10,225 - DEBUG - ya.test - execute: Command pid: 1481157
2025-12-12 12:35:10,237 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:19680/3
2025-12-12 12:35:10,239 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.2
2025-12-12 12:35:10,239 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.2
2025-12-12 12:35:10,240 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-12 12:35:10,241 - DEBUG - ya.test - execute: Command pid: 1481168
2025-12-12 12:35:10,703 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) rc: 0
2025-12-12 12:35:10,703 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) elapsed time (sec): 0.45859670639038086
2025-12-12 12:35:10,703 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) idrss: 0
2025-12-12 12:35:10,704 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) inblock: 0
2025-12-12 12:35:10,704 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) isrss: 0
2025-12-12 12:35:10,704 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) ixrss: 0
2025-12-12 12:35:10,704 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) majflt: 0
2025-12-12 12:35:10,704 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) maxrss: 544132
2025-12-12 12:35:10,705 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) minflt: 16227
2025-12-12 12:35:10,705 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) msgrcv: 0
2025-12-12 12:35:10,705 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) msgsnd: 0
2025-12-12 12:35:10,705 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) nivcsw: 31
2025-12-12 12:35:10,705 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) nsignals: 0
2025-12-12 12:35:10,705 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) nswap: 0
2025-12-12 12:35:10,705 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) nvcsw: 14
2025-12-12 12:35:10,706 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) oublock: 8
2025-12-12 12:35:10,706 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) stime: 0.278995
2025-12-12 12:35:10,706 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) utime: 0.11558299999999999
2025-12-12 12:35:10,706 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) wtime: 0.46
2025-12-12 12:35:10,706 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) output:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-fhkyrtz6p4
    Host information: 
        Linux ghrun-fhkyrtz6p4 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-12 12:35:10,706 - DEBUG - ya.test - _save_outputs: Command (pid 1481168) errors:

2025-12-12 12:35:10,707 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 3 version:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd
2025-12-12 12:35:10,710 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-12-12 12:35:10,717 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_row_dispatcher.py::TestPqRowDispatcher, test_name: test_filters_non_optional_field)
2025-12-12 12:35:11,151 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/test_filters_non_optional_field_input"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-12-12 12:35:11,204 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-12 12:35:11,205 - DEBUG - root - _get_and_check_result: Result: 
2025-12-12 12:35:11,207 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/test_filters_non_optional_field_output"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-12-12 12:35:11,231 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-12 12:35:11,240 - DEBUG - root - _get_and_check_result: Result: 
2025-12-12 12:35:11,264 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-12 12:35:11,264 - DEBUG - root - _get_and_check_result: Result: 
2025-12-12 12:35:11,265 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "52c2ade2-7303-458c-a4e2-8052a1ad7e1a"

2025-12-12 12:35:11,511 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7u0uvtjq4molhg"

2025-12-12 12:35:11,588 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0uvtjq4molhg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542911
        nanos: 281428000
      }
      modified_at {
        seconds: 1765542911
        nanos: 281428000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0uvtjjlaooam-ptqudq7u0uvtjq4molhg"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542911
      nanos: 281428000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
    syntax: YQL_V1
  }
}

2025-12-12 12:35:12,110 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0uvtjq4molhg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542911
        nanos: 281428000
      }
      modified_at {
        seconds: 1765542911
        nanos: 281428000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542911
      nanos: 632000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0uvtjjlaooam-ptqudq7u0uvtjq4molhg"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542911
      nanos: 281428000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`time` > 101)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"time\") $9 $10 \'\"B\\x19\\b\\x06\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15e\\x00\\x00\\x00\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19) (AsStruct \'(\'\"time\" $19)))) (lambda \'($20) (block \'(\n    (let $21 (Member $20 \'\"time\"))\n    (return (OptionalIf (> $21 (Int32 \'\"101\")) (AsStruct \'(\'\"column0\" (SafeCast $21 $12)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200573)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:17,024 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0010*\014shard-000000\032\021\"\0011*\014shard-000000"
  }
}

2025-12-12 12:35:17,040 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:35:17,041 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:35:17,042 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err
2025-12-12 12:35:17,042 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:35:17,043 - DEBUG - ya.test - execute: Command pid: 1488811
2025-12-12 12:35:21,388 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:35:21,396 - DEBUG - ya.test - _save_outputs: Command (pid 1488811) rc: 0
2025-12-12 12:35:21,399 - DEBUG - ya.test - _save_outputs: Command (pid 1488811) elapsed time (sec): 4.335004806518555
2025-12-12 12:35:21,399 - DEBUG - ya.test - _save_outputs: Command (pid 1488811) wtime: 4.353
2025-12-12 12:35:21,400 - DEBUG - ya.test - _save_outputs: Command (pid 1488811) output:
None
2025-12-12 12:35:21,401 - DEBUG - ya.test - _save_outputs: Command (pid 1488811) errors:
2025-12-12T12:35:17.061921Z :INFO: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Starting read session
2025-12-12T12:35:17.061966Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Starting session to cluster null (localhost:63390)
2025-12-12T12:35:17.062515Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:17.085556Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:17.085581Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:35:17.091173Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] Successfully connected. Initializing session
2025-12-12T12:35:17.101956Z :INFO: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] Server session id: test_filters_non_optional_field_consumer_1_1_13162638609942831773_v1
2025-12-12T12:35:17.104724Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:17.104882Z :INFO: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:35:18.067271Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:0
2025-12-12T12:35:18.067324Z :INFO: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1005 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:21.323646Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:21.327677Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-12-12T12:35:21.336229Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-12-12T12:35:21.343768Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] Commit offsets [0, 1). Partition stream id: 1
2025-12-12T12:35:21.343976Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:35:21.349570Z :DEBUG: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:35:21.350708Z :INFO: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Closing read session. Close timeout: 5.000000s
2025-12-12T12:35:21.350749Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:1
2025-12-12T12:35:21.350762Z :INFO: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4288 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:35:21.351054Z :NOTICE: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:35:21.363116Z :INFO: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Closing read session. Close timeout: 0.000000s
2025-12-12T12:35:21.363138Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:1
2025-12-12T12:35:21.363169Z :INFO: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4301 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:21.363189Z :NOTICE: [local] [local] [b647b33-39b7d406-af0e017e-c945a47e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:35:21,402 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:35:21,621 - DEBUG - root - control_query: Result: 
2025-12-12 12:35:21,636 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0uvtjq4molhg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542911
        nanos: 281428000
      }
      modified_at {
        seconds: 1765542921
        nanos: 549907000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542911
      nanos: 632000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0uvtjjlaooam-ptqudq7u0uvtjq4molhg"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542911
      nanos: 281428000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`time` > 101)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"41ms\",\"count\":1,\"avg\":\"41ms\",\"max\":\"41ms\",\"min\":\"41ms\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"time\") $9 $10 \'\"B\\x19\\b\\x06\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15e\\x00\\x00\\x00\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19) (AsStruct \'(\'\"time\" $19)))) (lambda \'($20) (block \'(\n    (let $21 (Member $20 \'\"time\"))\n    (return (OptionalIf (> $21 (Int32 \'\"101\")) (AsStruct \'(\'\"column0\" (SafeCast $21 $12)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200573)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:22,155 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0uvtjq4molhg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542911
        nanos: 281428000
      }
      modified_at {
        seconds: 1765542921
        nanos: 549907000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542911
      nanos: 632000000
    }
    finished_at {
      seconds: 1765542921
      nanos: 739000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0uvtjjlaooam-ptqudq7u0uvtjq4molhg"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542911
      nanos: 281428000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE time > 101;"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`time` > 101)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"41ms\",\"count\":1,\"avg\":\"41ms\",\"max\":\"41ms\",\"min\":\"41ms\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"time\") $9 $10 \'\"B\\x19\\b\\x06\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15e\\x00\\x00\\x00\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19) (AsStruct \'(\'\"time\" $19)))) (lambda \'($20) (block \'(\n    (let $21 (Member $20 \'\"time\"))\n    (return (OptionalIf (> $21 (Int32 \'\"101\")) (AsStruct \'(\'\"column0\" (SafeCast $21 $12)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200573)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:22,204 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:22,212 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "3f1d3026-884a-4138-aee0-b654fc26d58c"

2025-12-12 12:35:22,248 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7u0ki05uouhrcu"

2025-12-12 12:35:22,262 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0ki05uouhrcu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542922
        nanos: 223346000
      }
      modified_at {
        seconds: 1765542922
        nanos: 223346000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0ki05oenimb2-ptqudq7u0ki05uouhrcu"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542922
      nanos: 223346000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
}

2025-12-12 12:35:22,775 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0ki05uouhrcu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542922
        nanos: 223346000
      }
      modified_at {
        seconds: 1765542922
        nanos: 223346000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542922
      nanos: 549000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0ki05oenimb2-ptqudq7u0ki05uouhrcu"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542922
      nanos: 223346000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (== (Member $21 \'\"data\") (String \'\"hello2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200593)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:23,360 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0012*\014shard-000000\032\021\"\0013*\014shard-000000"
  }
}

2025-12-12 12:35:23,368 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:35:23,372 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:35:23,379 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.0
2025-12-12 12:35:23,379 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:35:23,385 - DEBUG - ya.test - execute: Command pid: 1496186
2025-12-12 12:35:27,916 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:35:27,935 - DEBUG - ya.test - _save_outputs: Command (pid 1496186) rc: 0
2025-12-12 12:35:27,935 - DEBUG - ya.test - _save_outputs: Command (pid 1496186) elapsed time (sec): 4.543564081192017
2025-12-12 12:35:27,942 - DEBUG - ya.test - _save_outputs: Command (pid 1496186) wtime: 4.55
2025-12-12 12:35:27,943 - DEBUG - ya.test - _save_outputs: Command (pid 1496186) output:
None
2025-12-12 12:35:27,943 - DEBUG - ya.test - _save_outputs: Command (pid 1496186) errors:
2025-12-12T12:35:23.423858Z :INFO: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Starting read session
2025-12-12T12:35:23.423916Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Starting session to cluster null (localhost:63390)
2025-12-12T12:35:23.424460Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:23.424474Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:23.424482Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:35:23.436325Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] Successfully connected. Initializing session
2025-12-12T12:35:23.453407Z :INFO: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] Server session id: test_filters_non_optional_field_consumer_1_3_1184613148045655910_v1
2025-12-12T12:35:23.461840Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:23.462603Z :INFO: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:35:24.425329Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:1
2025-12-12T12:35:24.425369Z :INFO: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:27.792813Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:27.792979Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-12-12T12:35:27.793019Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-12-12T12:35:27.795306Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] Commit offsets [1, 2). Partition stream id: 1
2025-12-12T12:35:27.795469Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:35:27.799464Z :DEBUG: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:35:27.808023Z :INFO: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Closing read session. Close timeout: 5.000000s
2025-12-12T12:35:27.808065Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:1:2
2025-12-12T12:35:27.808077Z :INFO: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4384 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:35:27.808317Z :NOTICE: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:35:27.808486Z :INFO: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Closing read session. Close timeout: 0.000000s
2025-12-12T12:35:27.808504Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:1:2
2025-12-12T12:35:27.808523Z :INFO: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4384 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:27.808532Z :NOTICE: [local] [local] [8335eb3d-1f318f79-878bacba-3ada571] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:35:27,948 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:35:27,975 - DEBUG - root - control_query: Result: 
2025-12-12 12:35:27,987 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0ki05uouhrcu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542922
        nanos: 223346000
      }
      modified_at {
        seconds: 1765542927
        nanos: 965315000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542922
      nanos: 549000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0ki05oenimb2-ptqudq7u0ki05uouhrcu"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542922
      nanos: 223346000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (== (Member $21 \'\"data\") (String \'\"hello2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200593)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:28,517 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:29,028 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0ki05uouhrcu"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542922
        nanos: 223346000
      }
      modified_at {
        seconds: 1765542927
        nanos: 965315000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542922
      nanos: 549000000
    }
    finished_at {
      seconds: 1765542928
      nanos: 744000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0ki05oenimb2-ptqudq7u0ki05uouhrcu"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542922
      nanos: 223346000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"66ms\",\"count\":1,\"avg\":\"66ms\",\"max\":\"66ms\",\"min\":\"66ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (== (Member $21 \'\"data\") (String \'\"hello2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200593)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:30,141 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:30,142 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "091f8a3e-55d6-4918-b02b-6162af80b63b"

2025-12-12 12:35:30,176 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7u0d05pouiblvr"

2025-12-12 12:35:30,195 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0d05pouiblvr"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542930
        nanos: 147457000
      }
      modified_at {
        seconds: 1765542930
        nanos: 147457000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0d05pit0gh93-ptqudq7u0d05pouiblvr"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542930
      nanos: 147457000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
}

2025-12-12 12:35:30,707 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0d05pouiblvr"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542930
        nanos: 147457000
      }
      modified_at {
        seconds: 1765542930
        nanos: 147457000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542930
      nanos: 542000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0d05pit0gh93-ptqudq7u0d05pouiblvr"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542930
      nanos: 147457000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrEquals (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:31,308 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0014*\014shard-000000\032\021\"\0015*\014shard-000000"
  }
}

2025-12-12 12:35:31,308 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:35:31,309 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:35:31,310 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.1
2025-12-12 12:35:31,311 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:35:31,319 - DEBUG - ya.test - execute: Command pid: 1504988
2025-12-12 12:35:35,843 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:35:35,844 - DEBUG - ya.test - _save_outputs: Command (pid 1504988) rc: 0
2025-12-12 12:35:35,846 - DEBUG - ya.test - _save_outputs: Command (pid 1504988) elapsed time (sec): 4.521553039550781
2025-12-12 12:35:35,846 - DEBUG - ya.test - _save_outputs: Command (pid 1504988) wtime: 4.526
2025-12-12 12:35:35,847 - DEBUG - ya.test - _save_outputs: Command (pid 1504988) output:
None
2025-12-12 12:35:35,847 - DEBUG - ya.test - _save_outputs: Command (pid 1504988) errors:
2025-12-12T12:35:31.337298Z :INFO: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Starting read session
2025-12-12T12:35:31.347387Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Starting session to cluster null (localhost:63390)
2025-12-12T12:35:31.348154Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:31.348168Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:31.348176Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:35:31.354659Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] Successfully connected. Initializing session
2025-12-12T12:35:31.357516Z :INFO: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] Server session id: test_filters_non_optional_field_consumer_1_5_14192291901178130710_v1
2025-12-12T12:35:31.358869Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:31.359506Z :INFO: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:35:32.350646Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:2
2025-12-12T12:35:32.353716Z :INFO: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1013 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:35.761191Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:35.763181Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-12-12T12:35:35.763243Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-12-12T12:35:35.763360Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] Commit offsets [2, 3). Partition stream id: 1
2025-12-12T12:35:35.763489Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:35:35.766950Z :DEBUG: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:35:35.772245Z :INFO: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Closing read session. Close timeout: 5.000000s
2025-12-12T12:35:35.772281Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:2:3
2025-12-12T12:35:35.772303Z :INFO: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4435 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:35:35.773608Z :NOTICE: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:35:35.775207Z :INFO: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Closing read session. Close timeout: 0.000000s
2025-12-12T12:35:35.775229Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:2:3
2025-12-12T12:35:35.775253Z :INFO: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4437 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:35.775267Z :NOTICE: [local] [local] [1aaec589-c26cc37c-5fbdaa93-6e119c27] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:35:35,848 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:35:35,872 - DEBUG - root - control_query: Result: 
2025-12-12 12:35:35,881 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0d05pouiblvr"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542930
        nanos: 147457000
      }
      modified_at {
        seconds: 1765542935
        nanos: 865900000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542930
      nanos: 542000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0d05pit0gh93-ptqudq7u0d05pouiblvr"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542930
      nanos: 147457000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrEquals (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:36,401 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:36,916 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u0d05pouiblvr"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542930
        nanos: 147457000
      }
      modified_at {
        seconds: 1765542935
        nanos: 865900000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542930
      nanos: 542000000
    }
    finished_at {
      seconds: 1765542936
      nanos: 690000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7u0d05pit0gh93-ptqudq7u0d05pouiblvr"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542930
      nanos: 147457000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"65ms\",\"count\":1,\"avg\":\"65ms\",\"max\":\"65ms\",\"min\":\"65ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":2097152,\"count\":1,\"avg\":2097152,\"max\":2097152,\"min\":2097152},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrEquals (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:38,047 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:38,050 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "30f67ce7-68bf-429c-b670-a4943d4d9cf6"

2025-12-12 12:35:38,079 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7u05epm8vqn2nh"

2025-12-12 12:35:38,093 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u05epm8vqn2nh"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542938
        nanos: 56939000
      }
      modified_at {
        seconds: 1765542938
        nanos: 56939000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7u05epm3s94uoh-ptqudq7u05epm8vqn2nh"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542938
      nanos: 56939000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
}

2025-12-12 12:35:38,609 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u05epm8vqn2nh"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542938
        nanos: 56939000
      }
      modified_at {
        seconds: 1765542938
        nanos: 56939000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542938
      nanos: 155000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7u05epm3s94uoh-ptqudq7u05epm8vqn2nh"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542938
      nanos: 56939000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrNotEquals (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:39,744 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0016*\014shard-000000\032\021\"\0017*\014shard-000000"
  }
}

2025-12-12 12:35:39,745 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:35:39,746 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:35:39,747 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.2
2025-12-12 12:35:39,748 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:35:39,748 - DEBUG - ya.test - execute: Command pid: 1514804
2025-12-12 12:35:43,464 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:35:43,466 - DEBUG - ya.test - _save_outputs: Command (pid 1514804) rc: 0
2025-12-12 12:35:43,466 - DEBUG - ya.test - _save_outputs: Command (pid 1514804) elapsed time (sec): 3.7166638374328613
2025-12-12 12:35:43,466 - DEBUG - ya.test - _save_outputs: Command (pid 1514804) wtime: 3.718
2025-12-12 12:35:43,466 - DEBUG - ya.test - _save_outputs: Command (pid 1514804) output:
None
2025-12-12 12:35:43,466 - DEBUG - ya.test - _save_outputs: Command (pid 1514804) errors:
2025-12-12T12:35:39.768694Z :INFO: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Starting read session
2025-12-12T12:35:39.768729Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Starting session to cluster null (localhost:63390)
2025-12-12T12:35:39.769144Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:39.770011Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:39.770022Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:35:39.774880Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] Successfully connected. Initializing session
2025-12-12T12:35:39.776148Z :INFO: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] Server session id: test_filters_non_optional_field_consumer_1_7_7345721654507875518_v1
2025-12-12T12:35:39.776595Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:39.777603Z :INFO: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:35:40.769568Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:3
2025-12-12T12:35:40.771038Z :INFO: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:43.365857Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:43.365946Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (3-3)
2025-12-12T12:35:43.366003Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-12-12T12:35:43.366104Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] Commit offsets [3, 4). Partition stream id: 1
2025-12-12T12:35:43.366176Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:35:43.369887Z :DEBUG: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:35:43.370074Z :INFO: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Closing read session. Close timeout: 5.000000s
2025-12-12T12:35:43.370102Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:3:4
2025-12-12T12:35:43.370113Z :INFO: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3601 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:35:43.370365Z :NOTICE: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:35:43.371203Z :INFO: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Closing read session. Close timeout: 0.000000s
2025-12-12T12:35:43.371221Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:3:4
2025-12-12T12:35:43.371243Z :INFO: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3602 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:43.371260Z :NOTICE: [local] [local] [dae55343-1f58a18b-6a818b89-fa2f9314] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:35:43,467 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:35:43,491 - DEBUG - root - control_query: Result: 
2025-12-12 12:35:43,502 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u05epm8vqn2nh"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542938
        nanos: 56939000
      }
      modified_at {
        seconds: 1765542943
        nanos: 485057000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542938
      nanos: 155000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7u05epm3s94uoh-ptqudq7u05epm8vqn2nh"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542938
      nanos: 56939000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrNotEquals (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:44,032 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:44,549 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7u05epm8vqn2nh"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542938
        nanos: 56939000
      }
      modified_at {
        seconds: 1765542943
        nanos: 485057000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542938
      nanos: 155000000
    }
    finished_at {
      seconds: 1765542944
      nanos: 303000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7u05epm3s94uoh-ptqudq7u05epm8vqn2nh"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542938
      nanos: 56939000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"65ms\",\"count\":1,\"avg\":\"65ms\",\"max\":\"65ms\",\"min\":\"65ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (AggrNotEquals (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200609)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:45,692 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:45,692 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "a15a3e02-0a0d-4d22-9762-7d15b14fe14f"

2025-12-12 12:35:45,730 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tvu59a0imsl3n"

2025-12-12 12:35:45,761 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvu59a0imsl3n"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542945
        nanos: 708666000
      }
      modified_at {
        seconds: 1765542945
        nanos: 708666000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvu599sk79irv-ptqudq7tvu59a0imsl3n"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542945
      nanos: 708666000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
}

2025-12-12 12:35:46,273 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvu59a0imsl3n"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542945
        nanos: 708666000
      }
      modified_at {
        seconds: 1765542945
        nanos: 708666000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542945
      nanos: 998000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvu599sk79irv-ptqudq7tvu59a0imsl3n"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542945
      nanos: 708666000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $22 (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200601)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:47,421 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0018*\014shard-000000\032\021\"\0019*\014shard-000000"
  }
}

2025-12-12 12:35:47,422 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:35:47,423 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:35:47,424 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.3
2025-12-12 12:35:47,424 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:35:47,425 - DEBUG - ya.test - execute: Command pid: 1523525
2025-12-12 12:35:51,257 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:35:51,257 - DEBUG - ya.test - _save_outputs: Command (pid 1523525) rc: 0
2025-12-12 12:35:51,257 - DEBUG - ya.test - _save_outputs: Command (pid 1523525) elapsed time (sec): 3.831544876098633
2025-12-12 12:35:51,258 - DEBUG - ya.test - _save_outputs: Command (pid 1523525) wtime: 3.833
2025-12-12 12:35:51,259 - DEBUG - ya.test - _save_outputs: Command (pid 1523525) output:
None
2025-12-12 12:35:51,259 - DEBUG - ya.test - _save_outputs: Command (pid 1523525) errors:
2025-12-12T12:35:47.444872Z :INFO: [local] [local] [646309cb-98715800-11674999-3e8664d6] Starting read session
2025-12-12T12:35:47.444916Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] Starting session to cluster null (localhost:63390)
2025-12-12T12:35:47.445370Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:47.446534Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:47.446551Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:35:47.452372Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] Successfully connected. Initializing session
2025-12-12T12:35:47.453412Z :INFO: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] Server session id: test_filters_non_optional_field_consumer_1_9_14312696536866063480_v1
2025-12-12T12:35:47.453514Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:47.455247Z :INFO: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:35:48.447091Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:4
2025-12-12T12:35:48.447123Z :INFO: [local] [local] [646309cb-98715800-11674999-3e8664d6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1002 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:51.230145Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:51.230243Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (4-4)
2025-12-12T12:35:51.230316Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-12-12T12:35:51.230437Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] Commit offsets [4, 5). Partition stream id: 1
2025-12-12T12:35:51.230597Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:35:51.233472Z :DEBUG: [local] [local] [646309cb-98715800-11674999-3e8664d6] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:35:51.233642Z :INFO: [local] [local] [646309cb-98715800-11674999-3e8664d6] Closing read session. Close timeout: 5.000000s
2025-12-12T12:35:51.233685Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:4:5
2025-12-12T12:35:51.233697Z :INFO: [local] [local] [646309cb-98715800-11674999-3e8664d6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3788 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:35:51.233935Z :NOTICE: [local] [local] [646309cb-98715800-11674999-3e8664d6] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:35:51.234087Z :INFO: [local] [local] [646309cb-98715800-11674999-3e8664d6] Closing read session. Close timeout: 0.000000s
2025-12-12T12:35:51.234098Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:4:5
2025-12-12T12:35:51.234126Z :INFO: [local] [local] [646309cb-98715800-11674999-3e8664d6] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3789 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:51.234136Z :NOTICE: [local] [local] [646309cb-98715800-11674999-3e8664d6] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:35:51,260 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:35:51,284 - DEBUG - root - control_query: Result: 
2025-12-12 12:35:51,295 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvu59a0imsl3n"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542945
        nanos: 708666000
      }
      modified_at {
        seconds: 1765542951
        nanos: 275258000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542945
      nanos: 998000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvu599sk79irv-ptqudq7tvu59a0imsl3n"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542945
      nanos: 708666000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $22 (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200601)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:51,805 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:52,313 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvu59a0imsl3n"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542945
        nanos: 708666000
      }
      modified_at {
        seconds: 1765542951
        nanos: 275258000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542945
      nanos: 998000000
    }
    finished_at {
      seconds: 1765542952
      nanos: 171000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvu599sk79irv-ptqudq7tvu59a0imsl3n"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542945
      nanos: 708666000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"70ms\",\"count\":1,\"avg\":\"70ms\",\"max\":\"70ms\",\"min\":\"70ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $22 (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200601)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:53,442 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:53,442 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "32b34c69-e33e-43b5-bee3-26aa3c9c0299"

2025-12-12 12:35:53,469 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tvmovi8r06b2u"

2025-12-12 12:35:53,485 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvmovi8r06b2u"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542953
        nanos: 451902000
      }
      modified_at {
        seconds: 1765542953
        nanos: 451902000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvmovi49afuee-ptqudq7tvmovi8r06b2u"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542953
      nanos: 451902000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
    syntax: YQL_V1
  }
}

2025-12-12 12:35:54,009 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvmovi8r06b2u"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542953
        nanos: 451902000
      }
      modified_at {
        seconds: 1765542953
        nanos: 451902000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542953
      nanos: 583000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvmovi49afuee-ptqudq7tvmovi8r06b2u"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542953
      nanos: 451902000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (`event` IN (\"event1\", \"event3\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"\\n3\\n1*/\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event3\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Not (SqlIn \'((String \'\"event1\") (String \'\"event3\")) (Member $21 \'\"event\") \'(\'(\'ansi)))) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200624)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:55,183 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00210*\014shard-000000\032\022\"\00211*\014shard-000000"
  }
}

2025-12-12 12:35:55,187 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:35:55,189 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:35:55,189 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.4
2025-12-12 12:35:55,190 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:35:55,191 - DEBUG - ya.test - execute: Command pid: 1531699
2025-12-12 12:35:58,910 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:35:58,910 - DEBUG - ya.test - _save_outputs: Command (pid 1531699) rc: 0
2025-12-12 12:35:58,911 - DEBUG - ya.test - _save_outputs: Command (pid 1531699) elapsed time (sec): 3.7192342281341553
2025-12-12 12:35:58,911 - DEBUG - ya.test - _save_outputs: Command (pid 1531699) wtime: 3.72
2025-12-12 12:35:58,911 - DEBUG - ya.test - _save_outputs: Command (pid 1531699) output:
None
2025-12-12 12:35:58,912 - DEBUG - ya.test - _save_outputs: Command (pid 1531699) errors:
2025-12-12T12:35:55.213556Z :INFO: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Starting read session
2025-12-12T12:35:55.213591Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Starting session to cluster null (localhost:63390)
2025-12-12T12:35:55.214069Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:55.214081Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:55.214086Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:35:55.220714Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] Successfully connected. Initializing session
2025-12-12T12:35:55.227146Z :INFO: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] Server session id: test_filters_non_optional_field_consumer_1_11_3084123846750703529_v1
2025-12-12T12:35:55.227266Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:55.231743Z :INFO: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:35:56.214336Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:5
2025-12-12T12:35:56.221912Z :INFO: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:58.804967Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:35:58.805043Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (5-5)
2025-12-12T12:35:58.805077Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-12-12T12:35:58.807145Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] Commit offsets [5, 6). Partition stream id: 1
2025-12-12T12:35:58.807332Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:35:58.814882Z :DEBUG: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:35:58.818585Z :INFO: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Closing read session. Close timeout: 5.000000s
2025-12-12T12:35:58.818615Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:5:6
2025-12-12T12:35:58.818628Z :INFO: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3605 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:35:58.819054Z :NOTICE: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:35:58.822401Z :INFO: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Closing read session. Close timeout: 0.000000s
2025-12-12T12:35:58.822419Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:5:6
2025-12-12T12:35:58.822439Z :INFO: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3608 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:35:58.822454Z :NOTICE: [local] [local] [64d03a2c-fc05f541-2b34e272-f8f91370] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:35:58,912 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:35:58,940 - DEBUG - root - control_query: Result: 
2025-12-12 12:35:58,952 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvmovi8r06b2u"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542953
        nanos: 451902000
      }
      modified_at {
        seconds: 1765542958
        nanos: 931355000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542953
      nanos: 583000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvmovi49afuee-ptqudq7tvmovi8r06b2u"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542953
      nanos: 451902000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (`event` IN (\"event1\", \"event3\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"\\n3\\n1*/\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event3\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Not (SqlIn \'((String \'\"event1\") (String \'\"event3\")) (Member $21 \'\"event\") \'(\'(\'ansi)))) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200624)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:35:59,469 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:35:59,978 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvmovi8r06b2u"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542953
        nanos: 451902000
      }
      modified_at {
        seconds: 1765542958
        nanos: 931355000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542953
      nanos: 583000000
    }
    finished_at {
      seconds: 1765542959
      nanos: 753000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvmovi49afuee-ptqudq7tvmovi8r06b2u"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542953
      nanos: 451902000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event NOT IN (\"event1\", \"event3\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (`event` IN (\"event1\", \"event3\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"63ms\",\"count\":1,\"avg\":\"63ms\",\"max\":\"63ms\",\"min\":\"63ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"\\n3\\n1*/\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event3\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Not (SqlIn \'((String \'\"event1\") (String \'\"event3\")) (Member $21 \'\"event\") \'(\'(\'ansi)))) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200624)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:01,104 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:01,113 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "c4e391c9-fd8f-420e-a2b9-5e5f1b64aeae"

2025-12-12 12:36:01,137 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tvfequum7lhb1"

2025-12-12 12:36:01,150 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvfequum7lhb1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542961
        nanos: 124311000
      }
      modified_at {
        seconds: 1765542961
        nanos: 124311000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvfequpkfah6f-ptqudq7tvfequum7lhb1"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542961
      nanos: 124311000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-12 12:36:01,668 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvfequum7lhb1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542961
        nanos: 124311000
      }
      modified_at {
        seconds: 1765542961
        nanos: 124311000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542961
      nanos: 173000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvfequpkfah6f-ptqudq7tvfequum7lhb1"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542961
      nanos: 124311000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $24 (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200629)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:02,819 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00212*\014shard-000000\032\022\"\00213*\014shard-000000"
  }
}

2025-12-12 12:36:02,829 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:36:02,831 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:36:02,838 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.5
2025-12-12 12:36:02,838 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:36:02,840 - DEBUG - ya.test - execute: Command pid: 1539811
2025-12-12 12:36:06,452 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:36:06,453 - DEBUG - ya.test - _save_outputs: Command (pid 1539811) rc: 0
2025-12-12 12:36:06,453 - DEBUG - ya.test - _save_outputs: Command (pid 1539811) elapsed time (sec): 3.6123814582824707
2025-12-12 12:36:06,453 - DEBUG - ya.test - _save_outputs: Command (pid 1539811) wtime: 3.614
2025-12-12 12:36:06,453 - DEBUG - ya.test - _save_outputs: Command (pid 1539811) output:
None
2025-12-12 12:36:06,454 - DEBUG - ya.test - _save_outputs: Command (pid 1539811) errors:
2025-12-12T12:36:02.861625Z :INFO: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Starting read session
2025-12-12T12:36:02.861659Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Starting session to cluster null (localhost:63390)
2025-12-12T12:36:02.862503Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:02.862521Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:02.862528Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:36:02.869093Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] Successfully connected. Initializing session
2025-12-12T12:36:02.870311Z :INFO: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] Server session id: test_filters_non_optional_field_consumer_1_13_2955887286452938513_v1
2025-12-12T12:36:02.870419Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:02.872271Z :INFO: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:36:03.867088Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:6
2025-12-12T12:36:03.867127Z :INFO: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1005 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:06.352117Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:06.358637Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (6-6)
2025-12-12T12:36:06.358700Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-12-12T12:36:06.358831Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] Commit offsets [6, 7). Partition stream id: 1
2025-12-12T12:36:06.358955Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:36:06.361935Z :DEBUG: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:36:06.363528Z :INFO: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Closing read session. Close timeout: 5.000000s
2025-12-12T12:36:06.363585Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:6:7
2025-12-12T12:36:06.363595Z :INFO: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3501 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:36:06.367073Z :NOTICE: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:36:06.367723Z :INFO: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Closing read session. Close timeout: 0.000000s
2025-12-12T12:36:06.367741Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:6:7
2025-12-12T12:36:06.367764Z :INFO: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3506 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:06.367785Z :NOTICE: [local] [local] [ad62d52c-cff5bc97-a9efbfa3-9c953302] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:36:06,454 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:36:06,474 - DEBUG - root - control_query: Result: 
2025-12-12 12:36:06,483 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvfequum7lhb1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542961
        nanos: 124311000
      }
      modified_at {
        seconds: 1765542966
        nanos: 467631000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542961
      nanos: 173000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvfequpkfah6f-ptqudq7tvfequum7lhb1"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542961
      nanos: 124311000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $24 (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200629)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:06,998 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:07,509 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tvfequum7lhb1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542961
        nanos: 124311000
      }
      modified_at {
        seconds: 1765542966
        nanos: 467631000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542961
      nanos: 173000000
    }
    finished_at {
      seconds: 1765542967
      nanos: 301000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tvfequpkfah6f-ptqudq7tvfequum7lhb1"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542961
      nanos: 124311000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"70ms\",\"count\":1,\"avg\":\"70ms\",\"max\":\"70ms\",\"min\":\"70ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf $24 (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200629)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:08,619 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:08,619 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "11f2f6ea-22ec-4370-88d5-be372a90b9bb"

2025-12-12 12:36:08,641 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tv89ts1fsdt2q"

2025-12-12 12:36:08,653 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tv89ts1fsdt2q"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542968
        nanos: 625205000
      }
      modified_at {
        seconds: 1765542968
        nanos: 625205000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tv89trshbhk6j-ptqudq7tv89ts1fsdt2q"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542968
      nanos: 625205000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-12 12:36:09,164 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tv89ts1fsdt2q"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542968
        nanos: 625205000
      }
      modified_at {
        seconds: 1765542968
        nanos: 625205000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542969
      nanos: 7000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tv89trshbhk6j-ptqudq7tv89ts1fsdt2q"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542968
      nanos: 625205000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"\\x12\\x9A\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $27 (SqlIn $26 $25 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $25 (Member $24 \'\"data\")) $27) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200725)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:36:10,858 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00214*\014shard-000000\032\022\"\00215*\014shard-000000"
  }
}

2025-12-12 12:36:10,859 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:36:10,860 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:36:10,861 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.6
2025-12-12 12:36:10,862 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:36:10,863 - DEBUG - ya.test - execute: Command pid: 1548631
2025-12-12 12:36:14,271 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:36:14,271 - DEBUG - ya.test - _save_outputs: Command (pid 1548631) rc: 0
2025-12-12 12:36:14,271 - DEBUG - ya.test - _save_outputs: Command (pid 1548631) elapsed time (sec): 3.4077107906341553
2025-12-12 12:36:14,271 - DEBUG - ya.test - _save_outputs: Command (pid 1548631) wtime: 3.409
2025-12-12 12:36:14,271 - DEBUG - ya.test - _save_outputs: Command (pid 1548631) output:
None
2025-12-12 12:36:14,272 - DEBUG - ya.test - _save_outputs: Command (pid 1548631) errors:
2025-12-12T12:36:10.884097Z :INFO: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Starting read session
2025-12-12T12:36:10.885630Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Starting session to cluster null (localhost:63390)
2025-12-12T12:36:10.886257Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:10.886271Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:10.886277Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:36:10.893390Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] Successfully connected. Initializing session
2025-12-12T12:36:10.894933Z :INFO: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] Server session id: test_filters_non_optional_field_consumer_1_15_10722179523607033697_v1
2025-12-12T12:36:10.895057Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:10.898036Z :INFO: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:36:11.886265Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:7
2025-12-12T12:36:11.886309Z :INFO: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1002 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:14.195303Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:14.199505Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (7-7)
2025-12-12T12:36:14.199598Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (7-7)
2025-12-12T12:36:14.199732Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] Commit offsets [7, 8). Partition stream id: 1
2025-12-12T12:36:14.199909Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:36:14.202670Z :DEBUG: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:36:14.209392Z :INFO: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Closing read session. Close timeout: 5.000000s
2025-12-12T12:36:14.209429Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:7:8
2025-12-12T12:36:14.209442Z :INFO: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3325 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:36:14.209784Z :NOTICE: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:36:14.209926Z :INFO: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Closing read session. Close timeout: 0.000000s
2025-12-12T12:36:14.209939Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:7:8
2025-12-12T12:36:14.209962Z :INFO: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3325 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:14.209972Z :NOTICE: [local] [local] [cb5ee0d6-424730a-8d2e0170-8ebbe140] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:36:14,272 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:36:14,292 - DEBUG - root - control_query: Result: 
2025-12-12 12:36:14,302 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tv89ts1fsdt2q"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542968
        nanos: 625205000
      }
      modified_at {
        seconds: 1765542974
        nanos: 286759000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542969
      nanos: 7000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tv89trshbhk6j-ptqudq7tv89ts1fsdt2q"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542968
      nanos: 625205000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"\\x12\\x9A\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $27 (SqlIn $26 $25 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $25 (Member $24 \'\"data\")) $27) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200725)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:36:14,812 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:15,319 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tv89ts1fsdt2q"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542968
        nanos: 625205000
      }
      modified_at {
        seconds: 1765542974
        nanos: 286759000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542969
      nanos: 7000000
    }
    finished_at {
      seconds: 1765542975
      nanos: 124000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tv89trshbhk6j-ptqudq7tv89ts1fsdt2q"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542968
      nanos: 625205000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"88ms\",\"count\":1,\"avg\":\"88ms\",\"max\":\"88ms\",\"min\":\"88ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"\\x12\\x9A\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $27 (SqlIn $26 $25 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $25 (Member $24 \'\"data\")) $27) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200725)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:36:15,354 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:15,355 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "1b80532d-77fa-4856-92d4-ebad7b6c6f38"

2025-12-12 12:36:15,371 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tv1scjd50eu20"

2025-12-12 12:36:15,381 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tv1scjd50eu20"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542975
        nanos: 360346000
      }
      modified_at {
        seconds: 1765542975
        nanos: 360346000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tv1scj8pa5mj5-ptqudq7tv1scjd50eu20"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542975
      nanos: 360346000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
}

2025-12-12 12:36:15,890 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tv1scjd50eu20"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542975
        nanos: 360346000
      }
      modified_at {
        seconds: 1765542975
        nanos: 360346000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542975
      nanos: 572000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tv1scj8pa5mj5-ptqudq7tv1scjd50eu20"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542975
      nanos: 360346000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF((`event` = \"event2\"), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"ZI\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 (If (== $25 (String \'\"event2\")) (AggrNotEquals $25 (Member $24 \'\"data\")) (Bool \'\"false\")))\n    (return (OptionalIf $26 (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:36:17,043 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00216*\014shard-000000\032\022\"\00217*\014shard-000000"
  }
}

2025-12-12 12:36:17,044 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:36:17,045 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:36:17,050 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.7
2025-12-12 12:36:17,050 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:36:17,051 - DEBUG - ya.test - execute: Command pid: 1554519
2025-12-12 12:36:20,861 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:36:20,862 - DEBUG - ya.test - _save_outputs: Command (pid 1554519) rc: 0
2025-12-12 12:36:20,864 - DEBUG - ya.test - _save_outputs: Command (pid 1554519) elapsed time (sec): 3.808924913406372
2025-12-12 12:36:20,864 - DEBUG - ya.test - _save_outputs: Command (pid 1554519) wtime: 3.812
2025-12-12 12:36:20,864 - DEBUG - ya.test - _save_outputs: Command (pid 1554519) output:
None
2025-12-12 12:36:20,864 - DEBUG - ya.test - _save_outputs: Command (pid 1554519) errors:
2025-12-12T12:36:17.070637Z :INFO: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Starting read session
2025-12-12T12:36:17.073468Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Starting session to cluster null (localhost:63390)
2025-12-12T12:36:17.073878Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:17.073888Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:17.073893Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:36:17.078941Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] Successfully connected. Initializing session
2025-12-12T12:36:17.080035Z :INFO: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] Server session id: test_filters_non_optional_field_consumer_1_17_7212002486139340647_v1
2025-12-12T12:36:17.081025Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:17.081459Z :INFO: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:36:18.074266Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:8
2025-12-12T12:36:18.074303Z :INFO: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1003 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:20.758242Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:20.758313Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (8-8)
2025-12-12T12:36:20.758352Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-12-12T12:36:20.758462Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] Commit offsets [8, 9). Partition stream id: 1
2025-12-12T12:36:20.758565Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:36:20.761196Z :DEBUG: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:36:20.761366Z :INFO: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Closing read session. Close timeout: 5.000000s
2025-12-12T12:36:20.761393Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:8:9
2025-12-12T12:36:20.761412Z :INFO: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3690 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:36:20.761645Z :NOTICE: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:36:20.761744Z :INFO: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Closing read session. Close timeout: 0.000000s
2025-12-12T12:36:20.761754Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:8:9
2025-12-12T12:36:20.761777Z :INFO: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3691 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:20.761787Z :NOTICE: [local] [local] [f9399d5-82df138a-81d11fb1-fa61373b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:36:20,865 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:36:20,886 - DEBUG - root - control_query: Result: 
2025-12-12 12:36:20,895 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tv1scjd50eu20"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542975
        nanos: 360346000
      }
      modified_at {
        seconds: 1765542980
        nanos: 879578000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542975
      nanos: 572000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tv1scj8pa5mj5-ptqudq7tv1scjd50eu20"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542975
      nanos: 360346000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF((`event` = \"event2\"), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"ZI\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 (If (== $25 (String \'\"event2\")) (AggrNotEquals $25 (Member $24 \'\"data\")) (Bool \'\"false\")))\n    (return (OptionalIf $26 (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:36:21,406 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:21,915 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tv1scjd50eu20"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542975
        nanos: 360346000
      }
      modified_at {
        seconds: 1765542980
        nanos: 879578000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542975
      nanos: 572000000
    }
    finished_at {
      seconds: 1765542981
      nanos: 700000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tv1scj8pa5mj5-ptqudq7tv1scjd50eu20"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542975
      nanos: 360346000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  IF(event = \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF((`event` = \"event2\"), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"81ms\",\"count\":1,\"avg\":\"81ms\",\"max\":\"81ms\",\"min\":\"81ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" $4) \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $8 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $9 \'(\'\"SharedReading\" \'\"1\"))\n(let $10 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $11 \'($8 $9 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $10))\n(let $12 (SecureParam \'\"cluster:default_yds\"))\n(let $13 \'\"ZI\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $14 (DqPqTopicSource $1 $6 $7 $11 $12 $13 $5 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($8 $10) $12))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($9))))\n  (let $20 (DqSourceWideWrap $18 $2 $5 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"data\" $21) \'(\'\"event\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (block \'(\n    (let $25 (Member $24 \'\"event\"))\n    (let $26 (If (== $25 (String \'\"event2\")) (AggrNotEquals $25 (Member $24 \'\"data\")) (Bool \'\"false\")))\n    (return (OptionalIf $26 (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:36:23,032 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:23,034 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "c05085f0-457a-4686-a948-452cd4756933"

2025-12-12 12:36:23,057 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tuqi1c1kn140a"

2025-12-12 12:36:23,067 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tuqi1c1kn140a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542983
        nanos: 39559000
      }
      modified_at {
        seconds: 1765542983
        nanos: 39559000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tuqi1bs3eh2kj-ptqudq7tuqi1c1kn140a"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542983
      nanos: 39559000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
}

2025-12-12 12:36:23,579 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tuqi1c1kn140a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542983
        nanos: 39559000
      }
      modified_at {
        seconds: 1765542983
        nanos: 39559000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542983
      nanos: 187000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tuqi1bs3eh2kj-ptqudq7tuqi1c1kn140a"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542983
      nanos: 39559000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (ToBytes (Member $22 \'\"nested\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200688)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:24,737 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00218*\014shard-000000\032\022\"\00219*\014shard-000000"
  }
}

2025-12-12 12:36:24,737 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:36:24,738 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:36:24,739 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.8
2025-12-12 12:36:24,740 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:36:24,741 - DEBUG - ya.test - execute: Command pid: 1560893
2025-12-12 12:36:28,463 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:36:28,468 - DEBUG - ya.test - _save_outputs: Command (pid 1560893) rc: 0
2025-12-12 12:36:28,471 - DEBUG - ya.test - _save_outputs: Command (pid 1560893) elapsed time (sec): 3.7260046005249023
2025-12-12 12:36:28,471 - DEBUG - ya.test - _save_outputs: Command (pid 1560893) wtime: 3.728
2025-12-12 12:36:28,471 - DEBUG - ya.test - _save_outputs: Command (pid 1560893) output:
None
2025-12-12 12:36:28,473 - DEBUG - ya.test - _save_outputs: Command (pid 1560893) errors:
2025-12-12T12:36:24.759346Z :INFO: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Starting read session
2025-12-12T12:36:24.759946Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Starting session to cluster null (localhost:63390)
2025-12-12T12:36:24.760444Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:24.761056Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:24.761068Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:36:24.768551Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] Successfully connected. Initializing session
2025-12-12T12:36:24.771022Z :INFO: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] Server session id: test_filters_non_optional_field_consumer_1_19_10380307328216860321_v1
2025-12-12T12:36:24.772057Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:24.772914Z :INFO: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:36:25.761297Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:9
2025-12-12T12:36:25.761334Z :INFO: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:28.410794Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:28.411144Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (9-9)
2025-12-12T12:36:28.411196Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (9-9)
2025-12-12T12:36:28.411307Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] Commit offsets [9, 10). Partition stream id: 1
2025-12-12T12:36:28.411413Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:36:28.413932Z :DEBUG: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:36:28.414120Z :INFO: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Closing read session. Close timeout: 5.000000s
2025-12-12T12:36:28.414152Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:9:10
2025-12-12T12:36:28.414163Z :INFO: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3654 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:36:28.414482Z :NOTICE: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:36:28.414579Z :INFO: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Closing read session. Close timeout: 0.000000s
2025-12-12T12:36:28.414590Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:9:10
2025-12-12T12:36:28.414609Z :INFO: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3655 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:28.414618Z :NOTICE: [local] [local] [f56c8abc-bd437687-1065356-50f848fd] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:36:28,474 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:36:28,502 - DEBUG - root - control_query: Result: 
2025-12-12 12:36:28,514 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tuqi1c1kn140a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542983
        nanos: 39559000
      }
      modified_at {
        seconds: 1765542988
        nanos: 492451000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542983
      nanos: 187000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tuqi1bs3eh2kj-ptqudq7tuqi1c1kn140a"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542983
      nanos: 39559000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (ToBytes (Member $22 \'\"nested\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200688)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:29,025 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:29,539 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tuqi1c1kn140a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542983
        nanos: 39559000
      }
      modified_at {
        seconds: 1765542988
        nanos: 492451000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542983
      nanos: 187000000
    }
    finished_at {
      seconds: 1765542989
      nanos: 347000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tuqi1bs3eh2kj-ptqudq7tuqi1c1kn140a"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542983
      nanos: 39559000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"82ms\",\"count\":1,\"avg\":\"82ms\",\"max\":\"82ms\",\"min\":\"82ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (ToBytes (Member $22 \'\"nested\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200688)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:30,673 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:30,674 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "5923e7ec-d391-428e-9641-58aaaa374c42"

2025-12-12 12:36:30,698 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tuj8ql7vicd8a"

2025-12-12 12:36:30,708 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tuj8ql7vicd8a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542990
        nanos: 681354000
      }
      modified_at {
        seconds: 1765542990
        nanos: 681354000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tuj8qju53dtqt-ptqudq7tuj8ql7vicd8a"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542990
      nanos: 681354000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
}

2025-12-12 12:36:31,237 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tuj8ql7vicd8a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542990
        nanos: 681354000
      }
      modified_at {
        seconds: 1765542990
        nanos: 681354000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542991
      nanos: 21000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tuj8qju53dtqt-ptqudq7tuj8ql7vicd8a"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542990
      nanos: 681354000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 120
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 120
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 165
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 165
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 150
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 150
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 155
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 155
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: Map, At function: NarrowMap, At function: WideFilter, At lambda"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 165
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 165
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 150
            }
            message: "At function: Just, At function: SafeCast"
            end_position {
              row: 5
              column: 150
            }
            severity: 2
            issues {
              position {
                row: 4
                column: 13
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 4
                column: 13
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (SafeCast (Member $22 \'\"nested\") $13))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200694)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:32,407 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00220*\014shard-000000\032\022\"\00221*\014shard-000000"
  }
}

2025-12-12 12:36:32,407 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:36:32,408 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:36:32,410 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.9
2025-12-12 12:36:32,410 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:36:32,411 - DEBUG - ya.test - execute: Command pid: 1568809
2025-12-12 12:36:36,336 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:36:36,336 - DEBUG - ya.test - _save_outputs: Command (pid 1568809) rc: 0
2025-12-12 12:36:36,337 - DEBUG - ya.test - _save_outputs: Command (pid 1568809) elapsed time (sec): 3.9247851371765137
2025-12-12 12:36:36,338 - DEBUG - ya.test - _save_outputs: Command (pid 1568809) wtime: 3.926
2025-12-12 12:36:36,338 - DEBUG - ya.test - _save_outputs: Command (pid 1568809) output:
None
2025-12-12 12:36:36,338 - DEBUG - ya.test - _save_outputs: Command (pid 1568809) errors:
2025-12-12T12:36:32.431568Z :INFO: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Starting read session
2025-12-12T12:36:32.431617Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Starting session to cluster null (localhost:63390)
2025-12-12T12:36:32.432219Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:32.432507Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:32.432518Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:36:32.438581Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] Successfully connected. Initializing session
2025-12-12T12:36:32.442929Z :INFO: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] Server session id: test_filters_non_optional_field_consumer_1_21_1643270928933668474_v1
2025-12-12T12:36:32.443589Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:32.447347Z :INFO: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:36:33.432323Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:10
2025-12-12T12:36:33.432365Z :INFO: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:36.230770Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:36.230865Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (10-10)
2025-12-12T12:36:36.230914Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-12-12T12:36:36.231057Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] Commit offsets [10, 11). Partition stream id: 1
2025-12-12T12:36:36.231157Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:36:36.233904Z :DEBUG: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:36:36.234065Z :INFO: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Closing read session. Close timeout: 5.000000s
2025-12-12T12:36:36.234095Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:10:11
2025-12-12T12:36:36.234106Z :INFO: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3802 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:36:36.234401Z :NOTICE: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:36:36.234548Z :INFO: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Closing read session. Close timeout: 0.000000s
2025-12-12T12:36:36.234564Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:10:11
2025-12-12T12:36:36.234586Z :INFO: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3803 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:36.234596Z :NOTICE: [local] [local] [e6cc7a2d-8d199d5a-9fde2842-e1f21d51] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:36:36,338 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:36:36,356 - DEBUG - root - control_query: Result: 
2025-12-12 12:36:36,364 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tuj8ql7vicd8a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542990
        nanos: 681354000
      }
      modified_at {
        seconds: 1765542996
        nanos: 350576000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542991
      nanos: 21000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tuj8qju53dtqt-ptqudq7tuj8ql7vicd8a"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542990
      nanos: 681354000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 120
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 120
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 165
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 165
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 150
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 150
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 155
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 155
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: Map, At function: NarrowMap, At function: WideFilter, At lambda"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 165
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 165
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 150
            }
            message: "At function: Just, At function: SafeCast"
            end_position {
              row: 5
              column: 150
            }
            severity: 2
            issues {
              position {
                row: 4
                column: 13
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 4
                column: 13
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (SafeCast (Member $22 \'\"nested\") $13))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200694)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:36,876 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:37,387 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tuj8ql7vicd8a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542990
        nanos: 681354000
      }
      modified_at {
        seconds: 1765542996
        nanos: 350576000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542991
      nanos: 21000000
    }
    finished_at {
      seconds: 1765542997
      nanos: 149000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tuj8qju53dtqt-ptqudq7tuj8ql7vicd8a"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542990
      nanos: 681354000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 120
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 120
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 165
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 165
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 150
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 150
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 155
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 155
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: Map, At function: NarrowMap, At function: WideFilter, At lambda"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 165
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 165
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 150
            }
            message: "At function: Just, At function: SafeCast"
            end_position {
              row: 5
              column: 150
            }
            severity: 2
            issues {
              position {
                row: 4
                column: 13
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 4
                column: 13
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"97ms\",\"count\":1,\"avg\":\"97ms\",\"max\":\"97ms\",\"min\":\"97ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (DataType \'Json)) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b\'\\n\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (Just (SafeCast (Member $22 \'\"nested\") $13))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200694)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:36:37,429 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:37,430 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "bb9de8bd-bad7-4bc0-9f53-cbd76d296a5d"

2025-12-12 12:36:37,461 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tucqhahnjk7jl"

2025-12-12 12:36:37,484 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tucqhahnjk7jl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542997
        nanos: 441105000
      }
      modified_at {
        seconds: 1765542997
        nanos: 441105000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tucqhabothg44-ptqudq7tucqhahnjk7jl"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765542997
      nanos: 441105000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
}

2025-12-12 12:36:37,997 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tucqhahnjk7jl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542997
        nanos: 441105000
      }
      modified_at {
        seconds: 1765542997
        nanos: 441105000
      }
      revision: 1
    }
    started_at {
      seconds: 1765542997
      nanos: 590000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tucqhabothg44-ptqudq7tucqhahnjk7jl"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542997
      nanos: 441105000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:39,162 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00222*\014shard-000000\032\022\"\00223*\014shard-000000"
  }
}

2025-12-12 12:36:39,162 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:36:39,163 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:36:39,167 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.10
2025-12-12 12:36:39,167 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:36:39,168 - DEBUG - ya.test - execute: Command pid: 1573282
2025-12-12 12:36:42,874 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:36:42,875 - DEBUG - ya.test - _save_outputs: Command (pid 1573282) rc: 0
2025-12-12 12:36:42,875 - DEBUG - ya.test - _save_outputs: Command (pid 1573282) elapsed time (sec): 3.7060577869415283
2025-12-12 12:36:42,875 - DEBUG - ya.test - _save_outputs: Command (pid 1573282) wtime: 3.707
2025-12-12 12:36:42,875 - DEBUG - ya.test - _save_outputs: Command (pid 1573282) output:
None
2025-12-12 12:36:42,875 - DEBUG - ya.test - _save_outputs: Command (pid 1573282) errors:
2025-12-12T12:36:39.186818Z :INFO: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Starting read session
2025-12-12T12:36:39.186854Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Starting session to cluster null (localhost:63390)
2025-12-12T12:36:39.187377Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:39.187392Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:39.187398Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:36:39.192480Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] Successfully connected. Initializing session
2025-12-12T12:36:39.193554Z :INFO: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] Server session id: test_filters_non_optional_field_consumer_1_23_3196935956757574353_v1
2025-12-12T12:36:39.193666Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:39.195100Z :INFO: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:36:40.188305Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:11
2025-12-12T12:36:40.188350Z :INFO: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:42.829445Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:42.829556Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (11-11)
2025-12-12T12:36:42.829606Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (11-11)
2025-12-12T12:36:42.829714Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] Commit offsets [11, 12). Partition stream id: 1
2025-12-12T12:36:42.829820Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:36:42.832268Z :DEBUG: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:36:42.832408Z :INFO: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Closing read session. Close timeout: 5.000000s
2025-12-12T12:36:42.832436Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:11:12
2025-12-12T12:36:42.832447Z :INFO: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3645 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:36:42.832706Z :NOTICE: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:36:42.832802Z :INFO: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Closing read session. Close timeout: 0.000000s
2025-12-12T12:36:42.832812Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:11:12
2025-12-12T12:36:42.832831Z :INFO: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3646 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:42.832841Z :NOTICE: [local] [local] [39428262-5ebfaf71-3a88eab9-82782b2d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:36:42,876 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:36:42,894 - DEBUG - root - control_query: Result: 
2025-12-12 12:36:42,902 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tucqhahnjk7jl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542997
        nanos: 441105000
      }
      modified_at {
        seconds: 1765543002
        nanos: 887296000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542997
      nanos: 590000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tucqhabothg44-ptqudq7tucqhahnjk7jl"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542997
      nanos: 441105000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:43,411 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:43,919 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tucqhahnjk7jl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765542997
        nanos: 441105000
      }
      modified_at {
        seconds: 1765543002
        nanos: 887296000
      }
      revision: 2
    }
    started_at {
      seconds: 1765542997
      nanos: 590000000
    }
    finished_at {
      seconds: 1765543003
      nanos: 754000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tucqhabothg44-ptqudq7tucqhahnjk7jl"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765542997
      nanos: 441105000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"69ms\",\"count\":1,\"avg\":\"69ms\",\"max\":\"69ms\",\"min\":\"69ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:45,103 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:45,104 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "acfb3e17-2e62-4fcb-ba47-a14c879b583d"

2025-12-12 12:36:45,119 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tu5ghrpnq5bul"

2025-12-12 12:36:45,127 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tu5ghrpnq5bul"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543005
        nanos: 108296000
      }
      modified_at {
        seconds: 1765543005
        nanos: 108296000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tu5ghrk3vhjre-ptqudq7tu5ghrpnq5bul"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543005
      nanos: 108296000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
}

2025-12-12 12:36:45,635 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tu5ghrpnq5bul"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543005
        nanos: 108296000
      }
      modified_at {
        seconds: 1765543005
        nanos: 108296000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543005
      nanos: 197000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tu5ghrk3vhjre-ptqudq7tu5ghrpnq5bul"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543005
      nanos: 108296000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:46,791 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00224*\014shard-000000\032\022\"\00225*\014shard-000000"
  }
}

2025-12-12 12:36:46,796 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:36:46,798 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:36:46,799 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.11
2025-12-12 12:36:46,799 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:36:46,800 - DEBUG - ya.test - execute: Command pid: 1579053
2025-12-12 12:36:50,406 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:36:50,406 - DEBUG - ya.test - _save_outputs: Command (pid 1579053) rc: 0
2025-12-12 12:36:50,407 - DEBUG - ya.test - _save_outputs: Command (pid 1579053) elapsed time (sec): 3.6060054302215576
2025-12-12 12:36:50,407 - DEBUG - ya.test - _save_outputs: Command (pid 1579053) wtime: 3.607
2025-12-12 12:36:50,407 - DEBUG - ya.test - _save_outputs: Command (pid 1579053) output:
None
2025-12-12 12:36:50,407 - DEBUG - ya.test - _save_outputs: Command (pid 1579053) errors:
2025-12-12T12:36:46.816340Z :INFO: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Starting read session
2025-12-12T12:36:46.816391Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Starting session to cluster null (localhost:63390)
2025-12-12T12:36:46.816757Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:46.816770Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:46.816775Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:36:46.821932Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] Successfully connected. Initializing session
2025-12-12T12:36:46.823436Z :INFO: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] Server session id: test_filters_non_optional_field_consumer_1_25_14994030605590371539_v1
2025-12-12T12:36:46.825153Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:46.825301Z :INFO: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:36:47.817227Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:12
2025-12-12T12:36:47.818093Z :INFO: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:50.335543Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:50.336981Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (12-12)
2025-12-12T12:36:50.337025Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (12-12)
2025-12-12T12:36:50.337115Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] Commit offsets [12, 13). Partition stream id: 1
2025-12-12T12:36:50.337204Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:36:50.339929Z :DEBUG: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:36:50.340050Z :INFO: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Closing read session. Close timeout: 5.000000s
2025-12-12T12:36:50.340069Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:12:13
2025-12-12T12:36:50.340076Z :INFO: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3523 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:36:50.340271Z :NOTICE: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:36:50.340366Z :INFO: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Closing read session. Close timeout: 0.000000s
2025-12-12T12:36:50.340376Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:12:13
2025-12-12T12:36:50.340394Z :INFO: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3524 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:50.340404Z :NOTICE: [local] [local] [a5c51a87-ccb078a3-a1a027d2-238fa724] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:36:50,407 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:36:50,422 - DEBUG - root - control_query: Result: 
2025-12-12 12:36:50,439 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tu5ghrpnq5bul"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543005
        nanos: 108296000
      }
      modified_at {
        seconds: 1765543010
        nanos: 418180000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543005
      nanos: 197000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tu5ghrk3vhjre-ptqudq7tu5ghrpnq5bul"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543005
      nanos: 108296000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:50,949 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:51,457 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tu5ghrpnq5bul"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543005
        nanos: 108296000
      }
      modified_at {
        seconds: 1765543010
        nanos: 418180000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543005
      nanos: 197000000
    }
    finished_at {
      seconds: 1765543011
      nanos: 293000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tu5ghrk3vhjre-ptqudq7tu5ghrpnq5bul"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543005
      nanos: 108296000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"55ms\",\"count\":1,\"avg\":\"55ms\",\"max\":\"55ms\",\"min\":\"55ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:52,565 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:52,565 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "57068d94-5c73-40a3-83ba-4e05f1d2bcc8"

2025-12-12 12:36:52,579 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7ttucrm05frb8a"

2025-12-12 12:36:52,586 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ttucrm05frb8a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543012
        nanos: 569347000
      }
      modified_at {
        seconds: 1765543012
        nanos: 569347000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7ttucrlrancetd-ptqudq7ttucrm05frb8a"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543012
      nanos: 569347000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
}

2025-12-12 12:36:53,093 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ttucrm05frb8a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543012
        nanos: 569347000
      }
      modified_at {
        seconds: 1765543012
        nanos: 569347000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543013
      nanos: 24000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7ttucrlrancetd-ptqudq7ttucrm05frb8a"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543012
      nanos: 569347000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:53,702 - DEBUG - root - write_stream: Write topic test_filters_non_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00226*\014shard-000000\032\022\"\00227*\014shard-000000"
  }
}

2025-12-12 12:36:53,703 - INFO - root - write_stream: Data was written to test_filters_non_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "nested": ["abc", "key"]}']
2025-12-12 12:36:53,704 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:36:53,705 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.12
2025-12-12 12:36:53,705 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_non_optional_field_output', '--consumer-name', 'test_filters_non_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:36:53,706 - DEBUG - ya.test - execute: Command pid: 1583820
2025-12-12 12:36:58,214 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:36:58,214 - DEBUG - ya.test - _save_outputs: Command (pid 1583820) rc: 0
2025-12-12 12:36:58,215 - DEBUG - ya.test - _save_outputs: Command (pid 1583820) elapsed time (sec): 4.507434129714966
2025-12-12 12:36:58,215 - DEBUG - ya.test - _save_outputs: Command (pid 1583820) wtime: 4.509
2025-12-12 12:36:58,215 - DEBUG - ya.test - _save_outputs: Command (pid 1583820) output:
None
2025-12-12 12:36:58,215 - DEBUG - ya.test - _save_outputs: Command (pid 1583820) errors:
2025-12-12T12:36:53.722459Z :INFO: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Starting read session
2025-12-12T12:36:53.723417Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Starting session to cluster null (localhost:63390)
2025-12-12T12:36:53.723873Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:53.723883Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:53.723887Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:36:53.728684Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] Successfully connected. Initializing session
2025-12-12T12:36:53.731161Z :INFO: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] Server session id: test_filters_non_optional_field_consumer_1_27_2565764814027492684_v1
2025-12-12T12:36:53.731688Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:53.732490Z :INFO: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_non_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:36:54.724246Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:0:13
2025-12-12T12:36:54.724275Z :INFO: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:58.151523Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:36:58.151612Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (13-13)
2025-12-12T12:36:58.151655Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (13-13)
2025-12-12T12:36:58.151764Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] Commit offsets [13, 14). Partition stream id: 1
2025-12-12T12:36:58.151867Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:36:58.154611Z :DEBUG: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:36:58.154756Z :INFO: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Closing read session. Close timeout: 5.000000s
2025-12-12T12:36:58.154789Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:13:14
2025-12-12T12:36:58.154800Z :INFO: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4432 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:36:58.155068Z :NOTICE: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:36:58.155187Z :INFO: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Closing read session. Close timeout: 0.000000s
2025-12-12T12:36:58.155197Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_non_optional_field_output:0:1:13:14
2025-12-12T12:36:58.155214Z :INFO: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4432 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:36:58.155223Z :NOTICE: [local] [local] [f007e14d-3b357335-9990e57e-44597e42] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:36:58,216 - INFO - root - read_stream: Data was read from test_filters_non_optional_field_output: ['102']
2025-12-12 12:36:58,231 - DEBUG - root - control_query: Result: 
2025-12-12 12:36:58,239 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ttucrm05frb8a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543012
        nanos: 569347000
      }
      modified_at {
        seconds: 1765543018
        nanos: 226438000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543013
      nanos: 24000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7ttucrlrancetd-ptqudq7ttucrm05frb8a"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543012
      nanos: 569347000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:58,772 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:59,115 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-12 12:36:59,115 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:36:59,137 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-12 12:36:59,137 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, c3502f00-77bc-4de0-9ccd-3bc35f6a11fd, localhost:63390): creating call state
2025-12-12 12:36:59,138 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, c3502f00-77bc-4de0-9ccd-3bc35f6a11fd, localhost:63390): request = { database: "local" }
2025-12-12 12:36:59,144 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, c3502f00-77bc-4de0-9ccd-3bc35f6a11fd, localhost:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-fhkyrtz6p4.auto.internal" port: 63390 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-12 12:36:59,145 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-fhkyrtz6p4.auto.internal:63390, location 1, ssl: False>]>
2025-12-12 12:36:59,145 - INFO - ydb.connection - close: Closing channel for endpoint localhost:63390
2025-12-12 12:36:59,300 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ttucrm05frb8a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543012
        nanos: 569347000
      }
      modified_at {
        seconds: 1765543018
        nanos: 226438000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543013
      nanos: 24000000
    }
    finished_at {
      seconds: 1765543019
      nanos: 142000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7ttucrlrancetd-ptqudq7ttucrm05frb8a"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543012
      nanos: 569347000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_non_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_non_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String NOT NULL, event String NOT NULL, nested Json NOT NULL)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"47ms\",\"count\":1,\"avg\":\"47ms\",\"max\":\"47ms\",\"min\":\"47ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" $4) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7u0ve02d5e15lp\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_non_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200597)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:36:59,368 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:36:59,370 - INFO - ya.test - pytest_runtest_teardown: Test teardown
2025-12-12 12:37:31,389 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:7286/1
2025-12-12 12:37:31,393 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/9797
2025-12-12 12:37:31,393 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/20950
2025-12-12 12:37:31,393 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/16902
2025-12-12 12:37:31,394 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/7286
2025-12-12 12:37:31,394 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/29505
2025-12-12 12:37:31,394 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/7579
2025-12-12 12:37:34,406 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:1791/1
2025-12-12 12:37:34,411 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:7833/2
2025-12-12 12:37:34,423 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:19680/3
2025-12-12 12:37:34,434 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/21918
2025-12-12 12:37:34,437 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/8356
2025-12-12 12:37:34,437 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/23727
2025-12-12 12:37:34,437 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/19680
2025-12-12 12:37:34,437 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/63373
2025-12-12 12:37:34,438 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/1983
2025-12-12 12:37:34,438 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/1067
2025-12-12 12:37:34,438 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/7833
2025-12-12 12:37:34,438 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/3373
2025-12-12 12:37:34,438 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/18260
2025-12-12 12:37:34,438 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/3804
2025-12-12 12:37:34,439 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/1791
2025-12-12 12:37:34,439 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/15278
2025-12-12 12:37:34,439 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/2006
2025-12-12 12:37:34,439 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/16991
