2025-12-09 03:44:44,910 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-09 03:44:44,910 - INFO - ya.test - pytest_runtest_setup: test_filters_optional_field
2025-12-09 03:44:44,911 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-09 03:44:44,911 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-12-09 03:44:44,912 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/8490
2025-12-09 03:44:44,913 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/21175
2025-12-09 03:44:44,976 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:44:44,977 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/26869
2025-12-09 03:44:45,040 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:44:45,041 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/32259
2025-12-09 03:44:45,042 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/26543
2025-12-09 03:44:45,042 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/1317
2025-12-09 03:44:45,043 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/15992
2025-12-09 03:44:45,044 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/15993
2025-12-09 03:44:45,046 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:44:45,051 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-09 03:44:45,053 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:44:45,059 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-09 03:44:45,060 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 19aaa161-f0c7-4c00-8178-2d864f1627d6, localhost:15610): creating call state
2025-12-09 03:44:45,061 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 19aaa161-f0c7-4c00-8178-2d864f1627d6, localhost:15610): request = { database: "local" }
2025-12-09 03:44:45,064 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 19aaa161-f0c7-4c00-8178-2d864f1627d6, localhost:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-syjwtgwtdu.auto.internal" port: 15610 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-09 03:44:45,064 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-syjwtgwtdu.auto.internal:15610, location 1, ssl: False>]>
2025-12-09 03:44:45,065 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:44:45,071 - INFO - ydb.connection - close: Closing channel for endpoint localhost:15610
2025-12-09 03:44:45,074 - DEBUG - ydb.table.SessionPool - subscribe: Active session queue is empty, subscribe waiter for a session
2025-12-09 03:44:45,074 - DEBUG - ydb.table.SessionPool - subscribe: Subscribe waiter <Future at 0x7f0c68301460 state=pending>
2025-12-09 03:44:45,074 - DEBUG - ydb.table.SessionPool - subscribe: Session pool is not large enough (active_count < size: 0 < 1). will create a new session.
2025-12-09 03:44:45,075 - DEBUG - ydb.table.SessionPool - _create: Created session <ydb.table.Session object at 0x7f0c68334240>
2025-12-09 03:44:45,075 - DEBUG - ydb.table.SessionPool - _prepare: Preparing session <ydb.table.Session object at 0x7f0c68334240>
2025-12-09 03:44:45,076 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateSession, 2cf83bb2-f779-4118-b618-f86ba363fcc4, ghrun-syjwtgwtdu.auto.internal:15610): creating call state
2025-12-09 03:44:45,076 - DEBUG - ydb.connection - _log_request: RpcState(CreateSession, 2cf83bb2-f779-4118-b618-f86ba363fcc4, ghrun-syjwtgwtdu.auto.internal:15610): request = { operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } }
2025-12-09 03:44:45,079 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 2cf83bb2-f779-4118-b618-f86ba363fcc4, ghrun-syjwtgwtdu.auto.internal:15610): on response callback started
2025-12-09 03:44:45,080 - DEBUG - ydb.connection - _log_response: RpcState(CreateSession, 2cf83bb2-f779-4118-b618-f86ba363fcc4, ghrun-syjwtgwtdu.auto.internal:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.CreateSessionResult] { session_id: "ydb://session/3?node_id=1&id=Y2YzNTdhNDItNmRjZGQ5ZjQtNjYxMGFmMzktMjY2M2M4OTY=" } } } }
2025-12-09 03:44:45,080 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f0c68334240>
2025-12-09 03:44:45,081 - DEBUG - ydb.table.SessionPool - put: Replying to waiter with a session <ydb.table.Session object at 0x7f0c68334240>
2025-12-09 03:44:45,082 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, def07d51-7923-4e38-9d27-01f978a94cb9, ghrun-syjwtgwtdu.auto.internal:15610): creating call state
2025-12-09 03:44:45,083 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 2cf83bb2-f779-4118-b618-f86ba363fcc4, ghrun-syjwtgwtdu.auto.internal:15610): on response callback success
2025-12-09 03:44:45,084 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, def07d51-7923-4e38-9d27-01f978a94cb9, ghrun-syjwtgwtdu.auto.internal:15610): request = { session_id: "ydb://session/3?node_id=1&id=Y2YzNTdhNDItNmRjZGQ5ZjQtNjYxMGFmMzktMjY2M2M4OTY=" path: "local/DbPoolStorage_368e694d-420a-4f94-a547-4b84842d9885/tenants" columns { name: "tenant" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "common" type { optional_type { item { type_id: BOOL } } } } columns { name: "state" type { optional_type { item { type_id: UINT32 } } } } columns { name: "state_time" type { optional_type { item { type_id: TIMESTAMP } } } } primary_key: "tenant" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-09 03:44:45,104 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, def07d51-7923-4e38-9d27-01f978a94cb9, ghrun-syjwtgwtdu.auto.internal:15610): response = { operation { ready: true status: SUCCESS } }
2025-12-09 03:44:45,105 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f0c68334240>
2025-12-09 03:44:45,106 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, f088a388-4f92-4119-b462-cd4aee52b317, ghrun-syjwtgwtdu.auto.internal:15610): creating call state
2025-12-09 03:44:45,107 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, f088a388-4f92-4119-b462-cd4aee52b317, ghrun-syjwtgwtdu.auto.internal:15610): request = { session_id: "ydb://session/3?node_id=1&id=Y2YzNTdhNDItNmRjZGQ5ZjQtNjYxMGFmMzktMjY2M2M4OTY=" path: "local/DbPoolStorage_368e694d-420a-4f94-a547-4b84842d9885/mappings" columns { name: "subject_type" type { optional_type { item { type_id: STRING } } } } columns { name: "subject_id" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "node" type { optional_type { item { type_id: STRING } } } } primary_key: "subject_type" primary_key: "subject_id" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-09 03:44:45,124 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, f088a388-4f92-4119-b462-cd4aee52b317, ghrun-syjwtgwtdu.auto.internal:15610): response = { operation { ready: true status: SUCCESS } }
2025-12-09 03:44:45,125 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f0c68334240>
2025-12-09 03:44:45,126 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteDataQuery, 16494c1d-2a44-47d0-93bd-16fb8ab992f4, ghrun-syjwtgwtdu.auto.internal:15610): creating call state
2025-12-09 03:44:45,127 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteDataQuery, 16494c1d-2a44-47d0-93bd-16fb8ab992f4, ghrun-syjwtgwtdu.auto.internal:15610): request = { session_id: "ydb://session/3?node_id=1&id=Y2YzNTdhNDItNmRjZGQ5ZjQtNjYxMGFmMzktMjY2M2M4OTY=" tx_control { begin_tx { serializable_read_write { } } commit_tx: true } query { yql_text: "--!syntax_v1\n            PRAGMA TablePathPrefix(\"local/DbPoolStorage_368e694d-420a-4f94-a547-4b84842d9885\");\n            UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/compute\", \"/compute\", true, 0, CurrentUtcTimestamp());\n                " } operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-09 03:44:45,153 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteDataQuery, 16494c1d-2a44-47d0-93bd-16fb8ab992f4, ghrun-syjwtgwtdu.auto.internal:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.ExecuteQueryResult] { tx_meta { } } } } }
2025-12-09 03:44:45,154 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7f0c68334240>
2025-12-09 03:44:45,217 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:44:45,218 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16454
2025-12-09 03:44:45,219 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/2185
2025-12-09 03:44:45,219 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/61371
2025-12-09 03:44:45,221 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/kikimr_configs"
2025-12-09 03:44:45,221 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/node_1/logfile_nb1qyzzg.log --grpc-port=15993 --mon-port=16454 --ic-port=26869
2025-12-09 03:44:45,222 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/kikimr_configs"
2025-12-09 03:44:45,222 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/node_1/logfile_nb1qyzzg.log --grpc-port=15993 --mon-port=16454 --ic-port=26869
2025-12-09 03:44:45,223 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/kikimr_configs/config.yaml', '--node=1', '--tenant=/cp', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/node_1/logfile_nb1qyzzg.log', '--grpc-port=15993', '--mon-port=16454', '--ic-port=26869')' in '/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/node_1' (no wait)
2025-12-09 03:44:45,225 - DEBUG - ya.test - execute: Command pid: 1671149
2025-12-09 03:44:45,226 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:15993/1
2025-12-09 03:44:45,227 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.3
2025-12-09 03:44:45,227 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.3
2025-12-09 03:44:45,228 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-09 03:44:45,228 - DEBUG - ya.test - execute: Command pid: 1671150
2025-12-09 03:44:46,023 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) rc: 0
2025-12-09 03:44:46,023 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) elapsed time (sec): 0.793384313583374
2025-12-09 03:44:46,023 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) idrss: 0
2025-12-09 03:44:46,024 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) inblock: 0
2025-12-09 03:44:46,024 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) isrss: 0
2025-12-09 03:44:46,024 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) ixrss: 0
2025-12-09 03:44:46,024 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) majflt: 0
2025-12-09 03:44:46,024 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) maxrss: 543848
2025-12-09 03:44:46,024 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) minflt: 18073
2025-12-09 03:44:46,025 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) msgrcv: 0
2025-12-09 03:44:46,025 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) msgsnd: 0
2025-12-09 03:44:46,025 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) nivcsw: 3
2025-12-09 03:44:46,025 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) nsignals: 0
2025-12-09 03:44:46,025 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) nswap: 0
2025-12-09 03:44:46,025 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) nvcsw: 20
2025-12-09 03:44:46,025 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) oublock: 8
2025-12-09 03:44:46,025 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) stime: 0.6375609999999999
2025-12-09 03:44:46,026 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) utime: 0.10758799999999999
2025-12-09 03:44:46,026 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) wtime: 0.794
2025-12-09 03:44:46,026 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) output:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-syjwtgwtdu
    Host information: 
        Linux ghrun-syjwtgwtdu 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-09 03:44:46,026 - DEBUG - ya.test - _save_outputs: Command (pid 1671150) errors:

2025-12-09 03:44:46,026 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6
2025-12-09 03:44:46,026 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-12-09 03:44:46,066 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:44:46,066 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/29504
2025-12-09 03:44:46,067 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/22481
2025-12-09 03:44:46,067 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/17268
2025-12-09 03:44:46,067 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/63604
2025-12-09 03:44:46,068 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-09 03:44:46,068 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_1/logfile_z92xhxi5.log --grpc-port=29504 --mon-port=22481 --ic-port=32259
2025-12-09 03:44:46,068 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:44:46,068 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/29361
2025-12-09 03:44:46,069 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/62203
2025-12-09 03:44:46,069 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/27612
2025-12-09 03:44:46,069 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/25810
2025-12-09 03:44:46,070 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-09 03:44:46,070 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=2 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_2/logfile_fxe3v8eb.log --grpc-port=29361 --mon-port=62203 --ic-port=26543
2025-12-09 03:44:46,071 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd
2025-12-09 03:44:46,071 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/61131
2025-12-09 03:44:46,071 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/17033
2025-12-09 03:44:46,072 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/7546
2025-12-09 03:44:46,072 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/61002
2025-12-09 03:44:46,073 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-09 03:44:46,073 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=3 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_3/logfile_7efp4xkh.log --grpc-port=61131 --mon-port=17033 --ic-port=1317
2025-12-09 03:44:46,073 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-09 03:44:46,074 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_1/logfile_z92xhxi5.log --grpc-port=29504 --mon-port=22481 --ic-port=32259
2025-12-09 03:44:46,075 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs/config.yaml', '--node=1', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_1/logfile_z92xhxi5.log', '--grpc-port=29504', '--mon-port=22481', '--ic-port=32259')' in '/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_1' (no wait)
2025-12-09 03:44:46,076 - DEBUG - ya.test - execute: Command pid: 1671611
2025-12-09 03:44:46,077 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:29504/1
2025-12-09 03:44:46,078 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.4
2025-12-09 03:44:46,078 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.4
2025-12-09 03:44:46,078 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-09 03:44:46,079 - DEBUG - ya.test - execute: Command pid: 1671615
2025-12-09 03:44:47,379 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) rc: 0
2025-12-09 03:44:47,379 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) elapsed time (sec): 1.2987635135650635
2025-12-09 03:44:47,379 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) idrss: 0
2025-12-09 03:44:47,379 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) inblock: 0
2025-12-09 03:44:47,380 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) isrss: 0
2025-12-09 03:44:47,380 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) ixrss: 0
2025-12-09 03:44:47,380 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) majflt: 0
2025-12-09 03:44:47,380 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) maxrss: 543848
2025-12-09 03:44:47,380 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) minflt: 17140
2025-12-09 03:44:47,380 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) msgrcv: 0
2025-12-09 03:44:47,380 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) msgsnd: 0
2025-12-09 03:44:47,381 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) nivcsw: 5
2025-12-09 03:44:47,381 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) nsignals: 0
2025-12-09 03:44:47,381 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) nswap: 0
2025-12-09 03:44:47,381 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) nvcsw: 28
2025-12-09 03:44:47,381 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) oublock: 8
2025-12-09 03:44:47,381 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) stime: 1.154656
2025-12-09 03:44:47,381 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) utime: 0.095889
2025-12-09 03:44:47,382 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) wtime: 1.3
2025-12-09 03:44:47,382 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) output:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-syjwtgwtdu
    Host information: 
        Linux ghrun-syjwtgwtdu 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-09 03:44:47,382 - DEBUG - ya.test - _save_outputs: Command (pid 1671615) errors:

2025-12-09 03:44:47,382 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6
2025-12-09 03:44:47,382 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-09 03:44:47,383 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=2 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_2/logfile_fxe3v8eb.log --grpc-port=29361 --mon-port=62203 --ic-port=26543
2025-12-09 03:44:47,384 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs/config.yaml', '--node=2', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_2/logfile_fxe3v8eb.log', '--grpc-port=29361', '--mon-port=62203', '--ic-port=26543')' in '/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_2' (no wait)
2025-12-09 03:44:47,385 - DEBUG - ya.test - execute: Command pid: 1672009
2025-12-09 03:44:47,386 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:29361/2
2025-12-09 03:44:47,387 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.5
2025-12-09 03:44:47,387 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.5
2025-12-09 03:44:47,388 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-09 03:44:47,388 - DEBUG - ya.test - execute: Command pid: 1672011
2025-12-09 03:44:47,970 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) rc: 0
2025-12-09 03:44:47,970 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) elapsed time (sec): 0.5806455612182617
2025-12-09 03:44:47,971 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) idrss: 0
2025-12-09 03:44:47,971 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) inblock: 0
2025-12-09 03:44:47,971 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) isrss: 0
2025-12-09 03:44:47,971 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) ixrss: 0
2025-12-09 03:44:47,971 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) majflt: 0
2025-12-09 03:44:47,971 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) maxrss: 543848
2025-12-09 03:44:47,972 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) minflt: 16296
2025-12-09 03:44:47,972 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) msgrcv: 0
2025-12-09 03:44:47,972 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) msgsnd: 0
2025-12-09 03:44:47,972 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) nivcsw: 5
2025-12-09 03:44:47,972 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) nsignals: 0
2025-12-09 03:44:47,972 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) nswap: 0
2025-12-09 03:44:47,972 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) nvcsw: 27
2025-12-09 03:44:47,973 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) oublock: 8
2025-12-09 03:44:47,973 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) stime: 0.428228
2025-12-09 03:44:47,973 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) utime: 0.10406399999999999
2025-12-09 03:44:47,973 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) wtime: 0.582
2025-12-09 03:44:47,973 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) output:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-syjwtgwtdu
    Host information: 
        Linux ghrun-syjwtgwtdu 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-09 03:44:47,973 - DEBUG - ya.test - _save_outputs: Command (pid 1672011) errors:

2025-12-09 03:44:47,974 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 2 version:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6
2025-12-09 03:44:47,974 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-09 03:44:47,974 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=3 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_3/logfile_7efp4xkh.log --grpc-port=61131 --mon-port=17033 --ic-port=1317
2025-12-09 03:44:47,975 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs/config.yaml', '--node=3', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_3/logfile_7efp4xkh.log', '--grpc-port=61131', '--mon-port=17033', '--ic-port=1317')' in '/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_3' (no wait)
2025-12-09 03:44:47,976 - DEBUG - ya.test - execute: Command pid: 1672238
2025-12-09 03:44:47,977 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:61131/3
2025-12-09 03:44:47,978 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.6
2025-12-09 03:44:47,978 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.6
2025-12-09 03:44:47,978 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-09 03:44:47,979 - DEBUG - ya.test - execute: Command pid: 1672239
2025-12-09 03:44:49,909 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) rc: 0
2025-12-09 03:44:49,909 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) elapsed time (sec): 1.9290845394134521
2025-12-09 03:44:49,909 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) idrss: 0
2025-12-09 03:44:49,909 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) inblock: 0
2025-12-09 03:44:49,910 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) isrss: 0
2025-12-09 03:44:49,910 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) ixrss: 0
2025-12-09 03:44:49,910 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) majflt: 1
2025-12-09 03:44:49,910 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) maxrss: 543848
2025-12-09 03:44:49,910 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) minflt: 18568
2025-12-09 03:44:49,911 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) msgrcv: 0
2025-12-09 03:44:49,911 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) msgsnd: 0
2025-12-09 03:44:49,911 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) nivcsw: 7
2025-12-09 03:44:49,911 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) nsignals: 0
2025-12-09 03:44:49,911 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) nswap: 0
2025-12-09 03:44:49,911 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) nvcsw: 23
2025-12-09 03:44:49,912 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) oublock: 8
2025-12-09 03:44:49,912 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) stime: 1.780326
2025-12-09 03:44:49,912 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) utime: 0.100018
2025-12-09 03:44:49,912 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) wtime: 1.93
2025-12-09 03:44:49,912 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) output:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-syjwtgwtdu
    Host information: 
        Linux ghrun-syjwtgwtdu 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-09 03:44:49,913 - DEBUG - ya.test - _save_outputs: Command (pid 1672239) errors:

2025-12-09 03:44:49,913 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 3 version:
Git info:
    Commit: 2ad8a0198ac871ab3cd73b3e9d43a8d7c87aa707
    Branch: 
    Author: Alexey Efimov <xeno@prnwatch.com>
    Summary: Merge 59f28a396f698b38a7f7341b2c06d7104ff2cbd4 into 0ab8ad45a21edd60c6548fe63ce9b19ce58e1cd6
2025-12-09 03:44:49,913 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-12-09 03:44:49,920 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_row_dispatcher.py::TestPqRowDispatcher, test_name: test_filters_optional_field)
2025-12-09 03:44:50,345 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/test_filters_optional_field_input"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-12-09 03:44:50,361 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-09 03:44:50,362 - DEBUG - root - _get_and_check_result: Result: 
2025-12-09 03:44:50,363 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/test_filters_optional_field_output"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-12-09 03:44:50,379 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-09 03:44:50,379 - DEBUG - root - _get_and_check_result: Result: 
2025-12-09 03:44:50,395 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-09 03:44:50,395 - DEBUG - root - _get_and_check_result: Result: 
2025-12-09 03:44:50,396 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "7a19f806-0894-4dff-83c2-cfb51146c532"

2025-12-09 03:44:50,595 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd224a3cvgrktg"

2025-12-09 03:44:50,664 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd224a3cvgrktg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251890
        nanos: 403147000
      }
      modified_at {
        seconds: 1765251890
        nanos: 403147000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd224a23e0nfev-ptqudqgd224a3cvgrktg"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251890
      nanos: 403147000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
}

2025-12-09 03:44:51,174 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd224a3cvgrktg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251890
        nanos: 403147000
      }
      modified_at {
        seconds: 1765251890
        nanos: 403147000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251890
      nanos: 768000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd224a23e0nfev-ptqudqgd224a3cvgrktg"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251890
      nanos: 403147000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"data\") (String \'\"hello2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200693)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:44:53,931 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0010*\014shard-000000\032\021\"\0011*\014shard-000000"
  }
}

2025-12-09 03:44:53,932 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:44:53,933 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:44:53,934 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.13
2025-12-09 03:44:53,934 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:44:53,935 - DEBUG - ya.test - execute: Command pid: 1674306
2025-12-09 03:44:57,941 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:44:57,942 - DEBUG - ya.test - _save_outputs: Command (pid 1674306) rc: 0
2025-12-09 03:44:57,942 - DEBUG - ya.test - _save_outputs: Command (pid 1674306) elapsed time (sec): 4.006104946136475
2025-12-09 03:44:57,942 - DEBUG - ya.test - _save_outputs: Command (pid 1674306) wtime: 4.007
2025-12-09 03:44:57,943 - DEBUG - ya.test - _save_outputs: Command (pid 1674306) output:
None
2025-12-09 03:44:57,943 - DEBUG - ya.test - _save_outputs: Command (pid 1674306) errors:
2025-12-09T03:44:53.959826Z :INFO: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Starting read session
2025-12-09T03:44:53.959865Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Starting session to cluster null (localhost:15610)
2025-12-09T03:44:53.960300Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:53.960314Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:53.960320Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:44:53.965423Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] Successfully connected. Initializing session
2025-12-09T03:44:53.966546Z :INFO: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] Server session id: test_filters_optional_field_consumer_1_29_97544273651267671_v1
2025-12-09T03:44:53.966654Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:53.968194Z :INFO: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:44:54.961289Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:0
2025-12-09T03:44:54.961322Z :INFO: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:44:57.834211Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:44:57.834311Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-12-09T03:44:57.834351Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-12-09T03:44:57.838093Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] Commit offsets [0, 1). Partition stream id: 1
2025-12-09T03:44:57.838222Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:44:57.840881Z :DEBUG: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:44:57.841059Z :INFO: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Closing read session. Close timeout: 5.000000s
2025-12-09T03:44:57.841093Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:1
2025-12-09T03:44:57.841106Z :INFO: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3881 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:44:57.841379Z :NOTICE: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:44:57.841481Z :INFO: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Closing read session. Close timeout: 0.000000s
2025-12-09T03:44:57.841491Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:1
2025-12-09T03:44:57.841508Z :INFO: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3881 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:44:57.841518Z :NOTICE: [local] [local] [e8085949-dbefb89e-1656ed75-a6db344c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:44:57,943 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:44:58,140 - DEBUG - root - control_query: Result: 
2025-12-09 03:44:58,148 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd224a3cvgrktg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251890
        nanos: 403147000
      }
      modified_at {
        seconds: 1765251898
        nanos: 134228000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251890
      nanos: 768000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd224a23e0nfev-ptqudqgd224a3cvgrktg"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251890
      nanos: 403147000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"52ms\",\"count\":1,\"avg\":\"52ms\",\"max\":\"52ms\",\"min\":\"52ms\"},\"EgressRows\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"data\") (String \'\"hello2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200693)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:44:58,657 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:44:59,172 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:44:59,686 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd224a3cvgrktg"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251890
        nanos: 403147000
      }
      modified_at {
        seconds: 1765251898
        nanos: 134228000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251890
      nanos: 768000000
    }
    finished_at {
      seconds: 1765251899
      nanos: 39000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd224a23e0nfev-ptqudqgd224a3cvgrktg"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251890
      nanos: 403147000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"52ms\",\"count\":1,\"avg\":\"52ms\",\"max\":\"52ms\",\"min\":\"52ms\"},\"EgressRows\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"data\") (String \'\"hello2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200693)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:00,802 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:00,803 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "c1fc0715-8151-4dfa-90b0-35c8852b42c7"

2025-12-09 03:45:00,820 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd1o6q0icif1os"

2025-12-09 03:45:00,827 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd1o6q0icif1os"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251900
        nanos: 807084000
      }
      modified_at {
        seconds: 1765251900
        nanos: 807084000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd1o6q0e90a3np-ptqudqgd1o6q0icif1os"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251900
      nanos: 807084000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
    syntax: YQL_V1
  }
}

2025-12-09 03:45:01,343 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd1o6q0icif1os"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251900
        nanos: 807084000
      }
      modified_at {
        seconds: 1765251900
        nanos: 807084000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251901
      nanos: 86000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd1o6q0e90a3np-ptqudqgd1o6q0icif1os"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251900
      nanos: 807084000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: `flag`"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"flag\" (OptionalType (DataType \'Bool))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"flag\" \'\"time\") $9 $10 \'\"J\\b\\n\\x06\\x12\\x04flag\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"flag\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (Member $21 \'\"flag\") (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $12)))))))\n))) \'(\'(\'\"_logical_id\" \'200670)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:01,910 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0012*\014shard-000000\032\021\"\0013*\014shard-000000"
  }
}

2025-12-09 03:45:01,911 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:45:01,912 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:45:01,913 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.14
2025-12-09 03:45:01,913 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:45:01,914 - DEBUG - ya.test - execute: Command pid: 1677805
2025-12-09 03:45:04,768 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-09 03:45:04,769 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:45:04,777 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-09 03:45:04,778 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, d178417e-e422-4a47-b4e9-f43da07f4f5c, localhost:15610): creating call state
2025-12-09 03:45:04,778 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, d178417e-e422-4a47-b4e9-f43da07f4f5c, localhost:15610): request = { database: "local" }
2025-12-09 03:45:04,781 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, d178417e-e422-4a47-b4e9-f43da07f4f5c, localhost:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-syjwtgwtdu.auto.internal" port: 15610 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-09 03:45:04,782 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-syjwtgwtdu.auto.internal:15610, location 1, ssl: False>]>
2025-12-09 03:45:04,782 - INFO - ydb.connection - close: Closing channel for endpoint localhost:15610
2025-12-09 03:45:06,427 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:45:06,427 - DEBUG - ya.test - _save_outputs: Command (pid 1677805) rc: 0
2025-12-09 03:45:06,427 - DEBUG - ya.test - _save_outputs: Command (pid 1677805) elapsed time (sec): 4.51213526725769
2025-12-09 03:45:06,427 - DEBUG - ya.test - _save_outputs: Command (pid 1677805) wtime: 4.513
2025-12-09 03:45:06,428 - DEBUG - ya.test - _save_outputs: Command (pid 1677805) output:
None
2025-12-09 03:45:06,428 - DEBUG - ya.test - _save_outputs: Command (pid 1677805) errors:
2025-12-09T03:45:01.934783Z :INFO: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Starting read session
2025-12-09T03:45:01.934828Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Starting session to cluster null (localhost:15610)
2025-12-09T03:45:01.935253Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:01.935267Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:01.935273Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:45:01.940229Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] Successfully connected. Initializing session
2025-12-09T03:45:01.941380Z :INFO: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] Server session id: test_filters_optional_field_consumer_1_31_5585226655309354336_v1
2025-12-09T03:45:01.941435Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:01.943031Z :INFO: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:45:02.936295Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:1
2025-12-09T03:45:02.936329Z :INFO: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:06.332455Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:06.332542Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-12-09T03:45:06.332572Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-12-09T03:45:06.332664Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] Commit offsets [1, 2). Partition stream id: 1
2025-12-09T03:45:06.332815Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:45:06.335368Z :DEBUG: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:45:06.336320Z :INFO: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Closing read session. Close timeout: 5.000000s
2025-12-09T03:45:06.336365Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:1:2
2025-12-09T03:45:06.336387Z :INFO: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4401 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:45:06.336669Z :NOTICE: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:45:06.336796Z :INFO: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Closing read session. Close timeout: 0.000000s
2025-12-09T03:45:06.336809Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:1:2
2025-12-09T03:45:06.336829Z :INFO: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4402 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:06.336837Z :NOTICE: [local] [local] [5f7f25ca-5fa88f8c-94661fe8-e742564b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:45:06,428 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:45:06,446 - DEBUG - root - control_query: Result: 
2025-12-09 03:45:06,455 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd1o6q0icif1os"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251900
        nanos: 807084000
      }
      modified_at {
        seconds: 1765251906
        nanos: 440799000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251901
      nanos: 86000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd1o6q0e90a3np-ptqudqgd1o6q0icif1os"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251900
      nanos: 807084000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: `flag`"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"flag\" (OptionalType (DataType \'Bool))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"flag\" \'\"time\") $9 $10 \'\"J\\b\\n\\x06\\x12\\x04flag\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"flag\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (Member $21 \'\"flag\") (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $12)))))))\n))) \'(\'(\'\"_logical_id\" \'200670)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:06,965 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:07,473 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd1o6q0icif1os"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251900
        nanos: 807084000
      }
      modified_at {
        seconds: 1765251906
        nanos: 440799000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251901
      nanos: 86000000
    }
    finished_at {
      seconds: 1765251907
      nanos: 277000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd1o6q0e90a3np-ptqudqgd1o6q0icif1os"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251900
      nanos: 807084000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: `flag`"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"54ms\",\"count\":1,\"avg\":\"54ms\",\"max\":\"54ms\",\"min\":\"54ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"flag\" (OptionalType (DataType \'Bool))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"flag\" \'\"time\") $9 $10 \'\"J\\b\\n\\x06\\x12\\x04flag\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"flag\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (Member $21 \'\"flag\") (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $12)))))))\n))) \'(\'(\'\"_logical_id\" \'200670)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:08,585 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:08,585 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "4f023e4d-719c-4127-9c85-f1ee7069f782"

2025-12-09 03:45:08,606 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd1gp60pp3n5sm"

2025-12-09 03:45:08,613 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd1gp60pp3n5sm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251908
        nanos: 593579000
      }
      modified_at {
        seconds: 1765251908
        nanos: 593579000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd1gp601vtt7jk-ptqudqgd1gp60pp3n5sm"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251908
      nanos: 593579000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
    syntax: YQL_V1
  }
}

2025-12-09 03:45:09,122 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd1gp60pp3n5sm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251908
        nanos: 593579000
      }
      modified_at {
        seconds: 1765251908
        nanos: 593579000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251908
      nanos: 684000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd1gp601vtt7jk-ptqudqgd1gp60pp3n5sm"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251908
      nanos: 593579000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 186
            }
            message: "At function: !="
            end_position {
              row: 5
              column: 186
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 166
              }
              message: "At function: *"
              end_position {
                row: 5
                column: 166
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 166
                }
                message: "Integral type implicit bitcast: Uint64 and Optional<Int64>"
                end_position {
                  row: 5
                  column: 166
                }
                issue_code: 1107
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` * (`field2` - `field1`)) <> 0)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B9\\b\\x04\\x12&\\x1A$\\b\\x01\\x12\\x06\\x12\\x04time\\x1A\\x18\\x1A\\x16\\b\\x03\\x12\\b\\x12\\x06field2\\x1A\\b\\x12\\x06field1\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x00\\x00\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Coalesce (!= (* $24 (- (Member $23 \'\"field2\") (Member $23 \'\"field1\"))) (Int32 \'\"0\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200773)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:10,251 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0014*\014shard-000000\032\021\"\0015*\014shard-000000"
  }
}

2025-12-09 03:45:10,252 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:45:10,253 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:45:10,254 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.15
2025-12-09 03:45:10,254 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:45:10,255 - DEBUG - ya.test - execute: Command pid: 1681566
2025-12-09 03:45:13,961 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:45:13,962 - DEBUG - ya.test - _save_outputs: Command (pid 1681566) rc: 0
2025-12-09 03:45:13,962 - DEBUG - ya.test - _save_outputs: Command (pid 1681566) elapsed time (sec): 3.705972671508789
2025-12-09 03:45:13,962 - DEBUG - ya.test - _save_outputs: Command (pid 1681566) wtime: 3.707
2025-12-09 03:45:13,962 - DEBUG - ya.test - _save_outputs: Command (pid 1681566) output:
None
2025-12-09 03:45:13,963 - DEBUG - ya.test - _save_outputs: Command (pid 1681566) errors:
2025-12-09T03:45:10.281866Z :INFO: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Starting read session
2025-12-09T03:45:10.281914Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Starting session to cluster null (localhost:15610)
2025-12-09T03:45:10.282391Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:10.282406Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:10.282413Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:45:10.289016Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] Successfully connected. Initializing session
2025-12-09T03:45:10.290358Z :INFO: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] Server session id: test_filters_optional_field_consumer_1_33_9591930541687184_v1
2025-12-09T03:45:10.290444Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:10.294630Z :INFO: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:45:11.283256Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:2
2025-12-09T03:45:11.283285Z :INFO: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:13.859861Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:13.859948Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-12-09T03:45:13.859994Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-12-09T03:45:13.860137Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] Commit offsets [2, 3). Partition stream id: 1
2025-12-09T03:45:13.860253Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:45:13.863817Z :DEBUG: [local] [local] [4031fee0-2da44208-13453452-518adeaa] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:45:13.863948Z :INFO: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Closing read session. Close timeout: 5.000000s
2025-12-09T03:45:13.863973Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:2:3
2025-12-09T03:45:13.863983Z :INFO: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3582 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:45:13.864925Z :NOTICE: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:45:13.865034Z :INFO: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Closing read session. Close timeout: 0.000000s
2025-12-09T03:45:13.865044Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:2:3
2025-12-09T03:45:13.865064Z :INFO: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3583 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:13.865075Z :NOTICE: [local] [local] [4031fee0-2da44208-13453452-518adeaa] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:45:13,963 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:45:13,982 - DEBUG - root - control_query: Result: 
2025-12-09 03:45:13,996 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd1gp60pp3n5sm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251908
        nanos: 593579000
      }
      modified_at {
        seconds: 1765251913
        nanos: 975380000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251908
      nanos: 684000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd1gp601vtt7jk-ptqudqgd1gp60pp3n5sm"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251908
      nanos: 593579000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 186
            }
            message: "At function: !="
            end_position {
              row: 5
              column: 186
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 166
              }
              message: "At function: *"
              end_position {
                row: 5
                column: 166
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 166
                }
                message: "Integral type implicit bitcast: Uint64 and Optional<Int64>"
                end_position {
                  row: 5
                  column: 166
                }
                issue_code: 1107
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` * (`field2` - `field1`)) <> 0)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B9\\b\\x04\\x12&\\x1A$\\b\\x01\\x12\\x06\\x12\\x04time\\x1A\\x18\\x1A\\x16\\b\\x03\\x12\\b\\x12\\x06field2\\x1A\\b\\x12\\x06field1\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x00\\x00\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Coalesce (!= (* $24 (- (Member $23 \'\"field2\") (Member $23 \'\"field1\"))) (Int32 \'\"0\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200773)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:14,508 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:15,016 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd1gp60pp3n5sm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251908
        nanos: 593579000
      }
      modified_at {
        seconds: 1765251913
        nanos: 975380000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251908
      nanos: 684000000
    }
    finished_at {
      seconds: 1765251914
      nanos: 805000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd1gp601vtt7jk-ptqudqgd1gp60pp3n5sm"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251908
      nanos: 593579000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 186
            }
            message: "At function: !="
            end_position {
              row: 5
              column: 186
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 166
              }
              message: "At function: *"
              end_position {
                row: 5
                column: 166
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 166
                }
                message: "Integral type implicit bitcast: Uint64 and Optional<Int64>"
                end_position {
                  row: 5
                  column: 166
                }
                issue_code: 1107
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` * (`field2` - `field1`)) <> 0)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"55ms\",\"count\":1,\"avg\":\"55ms\",\"max\":\"55ms\",\"min\":\"55ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B9\\b\\x04\\x12&\\x1A$\\b\\x01\\x12\\x06\\x12\\x04time\\x1A\\x18\\x1A\\x16\\b\\x03\\x12\\b\\x12\\x06field2\\x1A\\b\\x12\\x06field1\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x00\\x00\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Coalesce (!= (* $24 (- (Member $23 \'\"field2\") (Member $23 \'\"field1\"))) (Int32 \'\"0\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200773)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:16,136 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:16,137 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "f38e3996-8447-4dc8-9461-1e09a791c77f"

2025-12-09 03:45:16,156 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd19io861i9rcs"

2025-12-09 03:45:16,164 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd19io861i9rcs"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251916
        nanos: 144313000
      }
      modified_at {
        seconds: 1765251916
        nanos: 144313000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd19io80q01b27-ptqudqgd19io861i9rcs"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251916
      nanos: 144313000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
    syntax: YQL_V1
  }
}

2025-12-09 03:45:16,676 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:17,187 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd19io861i9rcs"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251916
        nanos: 144313000
      }
      modified_at {
        seconds: 1765251916
        nanos: 144313000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251916
      nanos: 689000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd19io80q01b27-ptqudqgd19io861i9rcs"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251916
      nanos: 144313000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (((`field1` % `field2`) / 5) = 1)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"B@\\b\\x03\\x12-\\x1A+\\b\\a\\x12\\x18\\x1A\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x05\\x00\\x00\\x00\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x01\\x00\\x00\\x00\")\n(let $13 (DqPqTopicSource $1 $5 $6 $10 $11 $12 $4 \'\"\"))\n(let $14 (DataType \'String))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $14))))\n(let $17 (DqPqTopicSink $16 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $20 (DqSourceWideWrap $18 $2 $4 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"field1\" $21) \'(\'\"field2\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (OptionalIf (Coalesce (== (/ (% (Member $24 \'\"field1\") (Member $24 \'\"field2\")) (Int32 \'\"5\")) (Int32 \'\"1\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $14)))))))\n))) \'(\'(\'\"_logical_id\" \'200767)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:45:18,346 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0016*\014shard-000000\032\021\"\0017*\014shard-000000"
  }
}

2025-12-09 03:45:18,346 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:45:18,347 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:45:18,348 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.16
2025-12-09 03:45:18,349 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:45:18,350 - DEBUG - ya.test - execute: Command pid: 1684696
2025-12-09 03:45:21,964 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:45:21,964 - DEBUG - ya.test - _save_outputs: Command (pid 1684696) rc: 0
2025-12-09 03:45:21,964 - DEBUG - ya.test - _save_outputs: Command (pid 1684696) elapsed time (sec): 3.6139252185821533
2025-12-09 03:45:21,965 - DEBUG - ya.test - _save_outputs: Command (pid 1684696) wtime: 3.615
2025-12-09 03:45:21,965 - DEBUG - ya.test - _save_outputs: Command (pid 1684696) output:
None
2025-12-09 03:45:21,965 - DEBUG - ya.test - _save_outputs: Command (pid 1684696) errors:
2025-12-09T03:45:18.368618Z :INFO: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Starting read session
2025-12-09T03:45:18.368661Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Starting session to cluster null (localhost:15610)
2025-12-09T03:45:18.369076Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:18.369091Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:18.369097Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:45:18.373733Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] Successfully connected. Initializing session
2025-12-09T03:45:18.374656Z :INFO: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] Server session id: test_filters_optional_field_consumer_1_35_17353352249689518272_v1
2025-12-09T03:45:18.374707Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:18.376244Z :INFO: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:45:19.369250Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:3
2025-12-09T03:45:19.369284Z :INFO: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:21.867092Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:21.867162Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (3-3)
2025-12-09T03:45:21.867218Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-12-09T03:45:21.867337Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] Commit offsets [3, 4). Partition stream id: 1
2025-12-09T03:45:21.867456Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:45:21.869855Z :DEBUG: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:45:21.870025Z :INFO: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Closing read session. Close timeout: 5.000000s
2025-12-09T03:45:21.870061Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:3:4
2025-12-09T03:45:21.870071Z :INFO: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3501 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:45:21.870274Z :NOTICE: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:45:21.870385Z :INFO: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Closing read session. Close timeout: 0.000000s
2025-12-09T03:45:21.870393Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:3:4
2025-12-09T03:45:21.870408Z :INFO: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3501 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:21.870414Z :NOTICE: [local] [local] [44546230-6b506c95-fbf39a15-3975418a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:45:21,966 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:45:21,982 - DEBUG - root - control_query: Result: 
2025-12-09 03:45:21,991 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd19io861i9rcs"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251916
        nanos: 144313000
      }
      modified_at {
        seconds: 1765251921
        nanos: 977058000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251916
      nanos: 689000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd19io80q01b27-ptqudqgd19io861i9rcs"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251916
      nanos: 144313000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (((`field1` % `field2`) / 5) = 1)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"B@\\b\\x03\\x12-\\x1A+\\b\\a\\x12\\x18\\x1A\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x05\\x00\\x00\\x00\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x01\\x00\\x00\\x00\")\n(let $13 (DqPqTopicSource $1 $5 $6 $10 $11 $12 $4 \'\"\"))\n(let $14 (DataType \'String))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $14))))\n(let $17 (DqPqTopicSink $16 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $20 (DqSourceWideWrap $18 $2 $4 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"field1\" $21) \'(\'\"field2\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (OptionalIf (Coalesce (== (/ (% (Member $24 \'\"field1\") (Member $24 \'\"field2\")) (Int32 \'\"5\")) (Int32 \'\"1\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $14)))))))\n))) \'(\'(\'\"_logical_id\" \'200767)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:45:22,502 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:23,010 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd19io861i9rcs"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251916
        nanos: 144313000
      }
      modified_at {
        seconds: 1765251921
        nanos: 977058000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251916
      nanos: 689000000
    }
    finished_at {
      seconds: 1765251922
      nanos: 807000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd19io80q01b27-ptqudqgd19io861i9rcs"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251916
      nanos: 144313000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (((`field1` % `field2`) / 5) = 1)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"65ms\",\"count\":1,\"avg\":\"65ms\",\"max\":\"65ms\",\"min\":\"65ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"B@\\b\\x03\\x12-\\x1A+\\b\\a\\x12\\x18\\x1A\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x05\\x00\\x00\\x00\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x01\\x00\\x00\\x00\")\n(let $13 (DqPqTopicSource $1 $5 $6 $10 $11 $12 $4 \'\"\"))\n(let $14 (DataType \'String))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $14))))\n(let $17 (DqPqTopicSink $16 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $20 (DqSourceWideWrap $18 $2 $4 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"field1\" $21) \'(\'\"field2\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (OptionalIf (Coalesce (== (/ (% (Member $24 \'\"field1\") (Member $24 \'\"field2\")) (Int32 \'\"5\")) (Int32 \'\"1\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $14)))))))\n))) \'(\'(\'\"_logical_id\" \'200767)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:45:24,141 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:24,142 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "6e6bac40-aef0-4537-b0d0-94b37311a5e3"

2025-12-09 03:45:24,157 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd11uh5gebudlq"

2025-12-09 03:45:24,165 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd11uh5gebudlq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251924
        nanos: 146961000
      }
      modified_at {
        seconds: 1765251924
        nanos: 146961000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd11uh5afiglik-ptqudqgd11uh5gebudlq"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251924
      nanos: 146961000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
}

2025-12-09 03:45:24,680 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:25,193 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd11uh5gebudlq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251924
        nanos: 146961000
      }
      modified_at {
        seconds: 1765251924
        nanos: 146961000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251924
      nanos: 697000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd11uh5afiglik-ptqudqgd11uh5gebudlq"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251924
      nanos: 146961000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsNotDistinctFrom (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:26,345 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0018*\014shard-000000\032\021\"\0019*\014shard-000000"
  }
}

2025-12-09 03:45:26,346 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:45:26,347 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:45:26,348 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.17
2025-12-09 03:45:26,348 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:45:26,349 - DEBUG - ya.test - execute: Command pid: 1689462
2025-12-09 03:45:29,965 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:45:29,965 - DEBUG - ya.test - _save_outputs: Command (pid 1689462) rc: 0
2025-12-09 03:45:29,965 - DEBUG - ya.test - _save_outputs: Command (pid 1689462) elapsed time (sec): 3.615551471710205
2025-12-09 03:45:29,966 - DEBUG - ya.test - _save_outputs: Command (pid 1689462) wtime: 3.617
2025-12-09 03:45:29,966 - DEBUG - ya.test - _save_outputs: Command (pid 1689462) output:
None
2025-12-09 03:45:29,966 - DEBUG - ya.test - _save_outputs: Command (pid 1689462) errors:
2025-12-09T03:45:26.366668Z :INFO: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Starting read session
2025-12-09T03:45:26.366699Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Starting session to cluster null (localhost:15610)
2025-12-09T03:45:26.367029Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:26.367039Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:26.367044Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:45:26.372150Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] Successfully connected. Initializing session
2025-12-09T03:45:26.373162Z :INFO: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] Server session id: test_filters_optional_field_consumer_1_37_11349807790338798546_v1
2025-12-09T03:45:26.373223Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:26.374647Z :INFO: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:45:27.374086Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:4
2025-12-09T03:45:27.378102Z :INFO: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1007 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:29.930692Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:29.930784Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (4-4)
2025-12-09T03:45:29.930820Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-12-09T03:45:29.930918Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] Commit offsets [4, 5). Partition stream id: 1
2025-12-09T03:45:29.931014Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:45:29.933972Z :DEBUG: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:45:29.934160Z :INFO: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Closing read session. Close timeout: 5.000000s
2025-12-09T03:45:29.934187Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:4:5
2025-12-09T03:45:29.934197Z :INFO: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3567 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:45:29.934593Z :NOTICE: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:45:29.934694Z :INFO: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Closing read session. Close timeout: 0.000000s
2025-12-09T03:45:29.934704Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:4:5
2025-12-09T03:45:29.934725Z :INFO: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3568 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:29.934735Z :NOTICE: [local] [local] [1f1e392c-6a32a83c-8d697661-27e0f1a8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:45:29,967 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:45:29,984 - DEBUG - root - control_query: Result: 
2025-12-09 03:45:29,992 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd11uh5gebudlq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251924
        nanos: 146961000
      }
      modified_at {
        seconds: 1765251929
        nanos: 978249000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251924
      nanos: 697000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd11uh5afiglik-ptqudqgd11uh5gebudlq"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251924
      nanos: 146961000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsNotDistinctFrom (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:30,504 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:31,013 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd11uh5gebudlq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251924
        nanos: 146961000
      }
      modified_at {
        seconds: 1765251929
        nanos: 978249000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251924
      nanos: 697000000
    }
    finished_at {
      seconds: 1765251930
      nanos: 872000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd11uh5afiglik-ptqudqgd11uh5gebudlq"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251924
      nanos: 146961000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"76ms\",\"count\":1,\"avg\":\"76ms\",\"max\":\"76ms\",\"min\":\"76ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsNotDistinctFrom (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:32,126 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:32,127 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "b29e1616-efa4-4491-a032-86f6250d0327"

2025-12-09 03:45:32,146 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd0qarjaolj7td"

2025-12-09 03:45:32,154 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0qarjaolj7td"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251932
        nanos: 131637000
      }
      modified_at {
        seconds: 1765251932
        nanos: 131637000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0qarj3v9fe76-ptqudqgd0qarjaolj7td"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251932
      nanos: 131637000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
}

2025-12-09 03:45:32,664 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:33,174 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0qarjaolj7td"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251932
        nanos: 131637000
      }
      modified_at {
        seconds: 1765251932
        nanos: 131637000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251932
      nanos: 698000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0qarj3v9fe76-ptqudqgd0qarjaolj7td"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251932
      nanos: 131637000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsDistinctFrom (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:34,314 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00210*\014shard-000000\032\022\"\00211*\014shard-000000"
  }
}

2025-12-09 03:45:34,314 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:45:34,315 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:45:34,317 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.18
2025-12-09 03:45:34,317 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:45:34,318 - DEBUG - ya.test - execute: Command pid: 1692675
2025-12-09 03:45:37,929 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:45:37,930 - DEBUG - ya.test - _save_outputs: Command (pid 1692675) rc: 0
2025-12-09 03:45:37,930 - DEBUG - ya.test - _save_outputs: Command (pid 1692675) elapsed time (sec): 3.6111927032470703
2025-12-09 03:45:37,930 - DEBUG - ya.test - _save_outputs: Command (pid 1692675) wtime: 3.612
2025-12-09 03:45:37,930 - DEBUG - ya.test - _save_outputs: Command (pid 1692675) output:
None
2025-12-09 03:45:37,931 - DEBUG - ya.test - _save_outputs: Command (pid 1692675) errors:
2025-12-09T03:45:34.346913Z :INFO: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Starting read session
2025-12-09T03:45:34.346954Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Starting session to cluster null (localhost:15610)
2025-12-09T03:45:34.347397Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:34.347408Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:34.347414Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:45:34.351800Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] Successfully connected. Initializing session
2025-12-09T03:45:34.355017Z :INFO: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] Server session id: test_filters_optional_field_consumer_1_39_4235839015134547318_v1
2025-12-09T03:45:34.355071Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:34.356538Z :INFO: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:45:35.348250Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:5
2025-12-09T03:45:35.348284Z :INFO: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:37.861956Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:37.862066Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (5-5)
2025-12-09T03:45:37.862215Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-12-09T03:45:37.862357Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] Commit offsets [5, 6). Partition stream id: 1
2025-12-09T03:45:37.862486Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:45:37.865540Z :DEBUG: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:45:37.865711Z :INFO: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Closing read session. Close timeout: 5.000000s
2025-12-09T03:45:37.865739Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:5:6
2025-12-09T03:45:37.865751Z :INFO: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3518 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:45:37.866022Z :NOTICE: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:45:37.869396Z :INFO: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Closing read session. Close timeout: 0.000000s
2025-12-09T03:45:37.869428Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:5:6
2025-12-09T03:45:37.869460Z :INFO: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3522 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:37.869475Z :NOTICE: [local] [local] [718da25b-baff9518-b38de5d7-2d78aada] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:45:37,931 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:45:37,950 - DEBUG - root - control_query: Result: 
2025-12-09 03:45:37,960 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0qarjaolj7td"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251932
        nanos: 131637000
      }
      modified_at {
        seconds: 1765251937
        nanos: 944567000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251932
      nanos: 698000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0qarj3v9fe76-ptqudqgd0qarjaolj7td"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251932
      nanos: 131637000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsDistinctFrom (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:38,469 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:38,976 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0qarjaolj7td"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251932
        nanos: 131637000
      }
      modified_at {
        seconds: 1765251937
        nanos: 944567000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251932
      nanos: 698000000
    }
    finished_at {
      seconds: 1765251938
      nanos: 814000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0qarj3v9fe76-ptqudqgd0qarjaolj7td"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251932
      nanos: 131637000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"58ms\",\"count\":1,\"avg\":\"58ms\",\"max\":\"58ms\",\"min\":\"58ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsDistinctFrom (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:40,094 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:40,094 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "f7d80ed9-1b33-420d-999c-01d36eb57b1d"

2025-12-09 03:45:40,115 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd0ink7n4e64kn"

2025-12-09 03:45:40,124 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0ink7n4e64kn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251940
        nanos: 101830000
      }
      modified_at {
        seconds: 1765251940
        nanos: 101830000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0ink7hf9lg47-ptqudqgd0ink7n4e64kn"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251940
      nanos: 101830000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
    syntax: YQL_V1
  }
}

2025-12-09 03:45:40,633 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:41,143 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0ink7n4e64kn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251940
        nanos: 101830000
      }
      modified_at {
        seconds: 1765251940
        nanos: 101830000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251940
      nanos: 701000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0ink7hf9lg47-ptqudqgd0ink7n4e64kn"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251940
      nanos: 101830000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`field1` IS DISTINCT FROM `field2`)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (OptionalIf (IsDistinctFrom (Member $23 \'\"field1\") (Member $23 \'\"field2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $13)))))))\n))) \'(\'(\'\"_logical_id\" \'200687)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:42,294 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00212*\014shard-000000\032\022\"\00213*\014shard-000000"
  }
}

2025-12-09 03:45:42,295 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:45:42,296 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:45:42,297 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.19
2025-12-09 03:45:42,297 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:45:42,298 - DEBUG - ya.test - execute: Command pid: 1694754
2025-12-09 03:45:45,908 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:45:45,908 - DEBUG - ya.test - _save_outputs: Command (pid 1694754) rc: 0
2025-12-09 03:45:45,909 - DEBUG - ya.test - _save_outputs: Command (pid 1694754) elapsed time (sec): 3.609508514404297
2025-12-09 03:45:45,909 - DEBUG - ya.test - _save_outputs: Command (pid 1694754) wtime: 3.611
2025-12-09 03:45:45,909 - DEBUG - ya.test - _save_outputs: Command (pid 1694754) output:
None
2025-12-09 03:45:45,909 - DEBUG - ya.test - _save_outputs: Command (pid 1694754) errors:
2025-12-09T03:45:42.317610Z :INFO: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Starting read session
2025-12-09T03:45:42.317645Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Starting session to cluster null (localhost:15610)
2025-12-09T03:45:42.318038Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:42.318050Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:42.318054Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:45:42.323811Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] Successfully connected. Initializing session
2025-12-09T03:45:42.325185Z :INFO: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] Server session id: test_filters_optional_field_consumer_1_41_17342045649769457395_v1
2025-12-09T03:45:42.325270Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:42.326849Z :INFO: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:45:43.318246Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:6
2025-12-09T03:45:43.318285Z :INFO: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:45.880809Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:45.880895Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (6-6)
2025-12-09T03:45:45.880942Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-12-09T03:45:45.881075Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] Commit offsets [6, 7). Partition stream id: 1
2025-12-09T03:45:45.881210Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:45:45.884292Z :DEBUG: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:45:45.884461Z :INFO: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Closing read session. Close timeout: 5.000000s
2025-12-09T03:45:45.884490Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:6:7
2025-12-09T03:45:45.884501Z :INFO: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3566 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:45:45.884758Z :NOTICE: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:45:45.884860Z :INFO: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Closing read session. Close timeout: 0.000000s
2025-12-09T03:45:45.884871Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:6:7
2025-12-09T03:45:45.884892Z :INFO: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3567 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:45.884903Z :NOTICE: [local] [local] [3ce6475b-23f1f13d-33a026de-41f71577] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:45:45,910 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:45:45,925 - DEBUG - root - control_query: Result: 
2025-12-09 03:45:45,933 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0ink7n4e64kn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251940
        nanos: 101830000
      }
      modified_at {
        seconds: 1765251945
        nanos: 920420000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251940
      nanos: 701000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0ink7hf9lg47-ptqudqgd0ink7n4e64kn"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251940
      nanos: 101830000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`field1` IS DISTINCT FROM `field2`)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (OptionalIf (IsDistinctFrom (Member $23 \'\"field1\") (Member $23 \'\"field2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $13)))))))\n))) \'(\'(\'\"_logical_id\" \'200687)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:46,442 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:46,949 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0ink7n4e64kn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251940
        nanos: 101830000
      }
      modified_at {
        seconds: 1765251945
        nanos: 920420000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251940
      nanos: 701000000
    }
    finished_at {
      seconds: 1765251946
      nanos: 824000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0ink7hf9lg47-ptqudqgd0ink7n4e64kn"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251940
      nanos: 101830000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`field1` IS DISTINCT FROM `field2`)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"66ms\",\"count\":1,\"avg\":\"66ms\",\"max\":\"66ms\",\"min\":\"66ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (OptionalIf (IsDistinctFrom (Member $23 \'\"field1\") (Member $23 \'\"field2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $13)))))))\n))) \'(\'(\'\"_logical_id\" \'200687)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:48,063 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:48,064 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "57d8e5bd-7545-453e-aed4-7ca2cf5b05e0"

2025-12-09 03:45:48,082 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd0b4e4041jctt"

2025-12-09 03:45:48,090 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0b4e4041jctt"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251948
        nanos: 70706000
      }
      modified_at {
        seconds: 1765251948
        nanos: 70706000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0b4e3reof18m-ptqudqgd0b4e4041jctt"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251948
      nanos: 70706000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
    syntax: YQL_V1
  }
}

2025-12-09 03:45:48,599 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0b4e4041jctt"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251948
        nanos: 70706000
      }
      modified_at {
        seconds: 1765251948
        nanos: 70706000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251948
      nanos: 111000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0b4e3reof18m-ptqudqgd0b4e4041jctt"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251948
      nanos: 70706000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` = 102) OR (`field2` IS NOT DISTINCT FROM 1005))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"\\x1A<\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\\n\\x1DB\\x1B\\b\\a\\x12\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\xED\\x03\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Or (== $24 (Int32 \'\"102\")) (And (IsNotDistinctFrom (Member $23 \'\"field2\") (Int32 \'\"1005\")) (< (Random (DependsOn (Member $23 \'\"field1\"))) (Double \'\"10.0\")))) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200824)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:49,773 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00214*\014shard-000000\032\022\"\00215*\014shard-000000"
  }
}

2025-12-09 03:45:49,774 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:45:49,774 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:45:49,776 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.20
2025-12-09 03:45:49,776 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:45:49,777 - DEBUG - ya.test - execute: Command pid: 1697442
2025-12-09 03:45:53,290 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:45:53,291 - DEBUG - ya.test - _save_outputs: Command (pid 1697442) rc: 0
2025-12-09 03:45:53,291 - DEBUG - ya.test - _save_outputs: Command (pid 1697442) elapsed time (sec): 3.512705087661743
2025-12-09 03:45:53,291 - DEBUG - ya.test - _save_outputs: Command (pid 1697442) wtime: 3.514
2025-12-09 03:45:53,291 - DEBUG - ya.test - _save_outputs: Command (pid 1697442) output:
None
2025-12-09 03:45:53,291 - DEBUG - ya.test - _save_outputs: Command (pid 1697442) errors:
2025-12-09T03:45:49.795796Z :INFO: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Starting read session
2025-12-09T03:45:49.795844Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Starting session to cluster null (localhost:15610)
2025-12-09T03:45:49.796283Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:49.796296Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:49.796302Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:45:49.801581Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] Successfully connected. Initializing session
2025-12-09T03:45:49.802546Z :INFO: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] Server session id: test_filters_optional_field_consumer_1_43_8400034730467353966_v1
2025-12-09T03:45:49.802631Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:49.803861Z :INFO: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:45:50.797212Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:7
2025-12-09T03:45:50.797265Z :INFO: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:53.269828Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:53.269898Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (7-7)
2025-12-09T03:45:53.269961Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (7-7)
2025-12-09T03:45:53.270086Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] Commit offsets [7, 8). Partition stream id: 1
2025-12-09T03:45:53.270160Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:45:53.272932Z :DEBUG: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:45:53.273071Z :INFO: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Closing read session. Close timeout: 5.000000s
2025-12-09T03:45:53.273106Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:7:8
2025-12-09T03:45:53.273116Z :INFO: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3477 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:45:53.273360Z :NOTICE: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:45:53.273474Z :INFO: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Closing read session. Close timeout: 0.000000s
2025-12-09T03:45:53.273485Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:7:8
2025-12-09T03:45:53.273505Z :INFO: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3477 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:45:53.273515Z :NOTICE: [local] [local] [63165882-2ae9e612-89b8392f-e6e0860d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:45:53,292 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:45:53,316 - DEBUG - root - control_query: Result: 
2025-12-09 03:45:53,328 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0b4e4041jctt"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251948
        nanos: 70706000
      }
      modified_at {
        seconds: 1765251953
        nanos: 309591000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251948
      nanos: 111000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0b4e3reof18m-ptqudqgd0b4e4041jctt"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251948
      nanos: 70706000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` = 102) OR (`field2` IS NOT DISTINCT FROM 1005))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"\\x1A<\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\\n\\x1DB\\x1B\\b\\a\\x12\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\xED\\x03\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Or (== $24 (Int32 \'\"102\")) (And (IsNotDistinctFrom (Member $23 \'\"field2\") (Int32 \'\"1005\")) (< (Random (DependsOn (Member $23 \'\"field1\"))) (Double \'\"10.0\")))) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200824)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:53,836 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:54,345 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd0b4e4041jctt"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251948
        nanos: 70706000
      }
      modified_at {
        seconds: 1765251953
        nanos: 309591000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251948
      nanos: 111000000
    }
    finished_at {
      seconds: 1765251954
      nanos: 224000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd0b4e3reof18m-ptqudqgd0b4e4041jctt"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251948
      nanos: 70706000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` = 102) OR (`field2` IS NOT DISTINCT FROM 1005))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"60ms\",\"count\":1,\"avg\":\"60ms\",\"max\":\"60ms\",\"min\":\"60ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"\\x1A<\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\\n\\x1DB\\x1B\\b\\a\\x12\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\xED\\x03\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Or (== $24 (Int32 \'\"102\")) (And (IsNotDistinctFrom (Member $23 \'\"field2\") (Int32 \'\"1005\")) (< (Random (DependsOn (Member $23 \'\"field1\"))) (Double \'\"10.0\")))) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200824)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:45:55,456 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:45:55,456 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "8682bf4a-4427-43e1-9c6a-f84a378e2338"

2025-12-09 03:45:55,472 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgd042t2pudbetb"

2025-12-09 03:45:55,481 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd042t2pudbetb"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251955
        nanos: 460977000
      }
      modified_at {
        seconds: 1765251955
        nanos: 460977000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd042t2l3ql2g6-ptqudqgd042t2pudbetb"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251955
      nanos: 460977000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
}

2025-12-09 03:45:55,990 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd042t2pudbetb"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251955
        nanos: 460977000
      }
      modified_at {
        seconds: 1765251955
        nanos: 460977000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251955
      nanos: 712000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgd042t2l3ql2g6-ptqudqgd042t2pudbetb"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251955
      nanos: 460977000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $22 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200701)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:45:57,149 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00216*\014shard-000000\032\022\"\00217*\014shard-000000"
  }
}

2025-12-09 03:45:57,149 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:45:57,150 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:45:57,152 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.21
2025-12-09 03:45:57,152 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:45:57,153 - DEBUG - ya.test - execute: Command pid: 1699972
2025-12-09 03:46:00,959 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:46:00,960 - DEBUG - ya.test - _save_outputs: Command (pid 1699972) rc: 0
2025-12-09 03:46:00,960 - DEBUG - ya.test - _save_outputs: Command (pid 1699972) elapsed time (sec): 3.806121826171875
2025-12-09 03:46:00,960 - DEBUG - ya.test - _save_outputs: Command (pid 1699972) wtime: 3.807
2025-12-09 03:46:00,960 - DEBUG - ya.test - _save_outputs: Command (pid 1699972) output:
None
2025-12-09 03:46:00,960 - DEBUG - ya.test - _save_outputs: Command (pid 1699972) errors:
2025-12-09T03:45:57.170065Z :INFO: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Starting read session
2025-12-09T03:45:57.170136Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Starting session to cluster null (localhost:15610)
2025-12-09T03:45:57.170537Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:57.170549Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:57.170555Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:45:57.175807Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] Successfully connected. Initializing session
2025-12-09T03:45:57.176772Z :INFO: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] Server session id: test_filters_optional_field_consumer_1_45_4561997058767519204_v1
2025-12-09T03:45:57.176826Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:45:57.178115Z :INFO: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:45:58.171257Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:8
2025-12-09T03:45:58.171290Z :INFO: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:00.888997Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:00.889091Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (8-8)
2025-12-09T03:46:00.889142Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-12-09T03:46:00.889243Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] Commit offsets [8, 9). Partition stream id: 1
2025-12-09T03:46:00.889358Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:46:00.892120Z :DEBUG: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:46:00.892239Z :INFO: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Closing read session. Close timeout: 5.000000s
2025-12-09T03:46:00.892280Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:8:9
2025-12-09T03:46:00.892290Z :INFO: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3722 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:46:00.892512Z :NOTICE: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:46:00.892612Z :INFO: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Closing read session. Close timeout: 0.000000s
2025-12-09T03:46:00.892622Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:8:9
2025-12-09T03:46:00.892645Z :INFO: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3722 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:00.892654Z :NOTICE: [local] [local] [b15924d8-eca50e58-1ddb3c20-2e8aa305] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:46:00,961 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:46:00,980 - DEBUG - root - control_query: Result: 
2025-12-09 03:46:00,988 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd042t2pudbetb"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251955
        nanos: 460977000
      }
      modified_at {
        seconds: 1765251960
        nanos: 974083000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251955
      nanos: 712000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd042t2l3ql2g6-ptqudqgd042t2pudbetb"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251955
      nanos: 460977000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $22 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200701)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:46:01,497 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:02,005 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgd042t2pudbetb"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251955
        nanos: 460977000
      }
      modified_at {
        seconds: 1765251960
        nanos: 974083000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251955
      nanos: 712000000
    }
    finished_at {
      seconds: 1765251961
      nanos: 838000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgd042t2l3ql2g6-ptqudqgd042t2pudbetb"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251955
      nanos: 460977000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"68ms\",\"count\":1,\"avg\":\"68ms\",\"max\":\"68ms\",\"min\":\"68ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $22 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200701)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:46:03,118 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:03,119 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "ccb80e58-fb1e-433a-aed0-694a1feb974e"

2025-12-09 03:46:03,136 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcvsp2751pbi4d"

2025-12-09 03:46:03,143 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvsp2751pbi4d"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251963
        nanos: 123431000
      }
      modified_at {
        seconds: 1765251963
        nanos: 123431000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvsp26qntr1tm-ptqudqgcvsp2751pbi4d"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251963
      nanos: 123431000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:03,658 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:04,184 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvsp2751pbi4d"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251963
        nanos: 123431000
      }
      modified_at {
        seconds: 1765251963
        nanos: 123431000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251963
      nanos: 735000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvsp26qntr1tm-ptqudqgcvsp2751pbi4d"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251963
      nanos: 123431000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $24 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200729)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:46:05,336 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00218*\014shard-000000\032\022\"\00219*\014shard-000000"
  }
}

2025-12-09 03:46:05,336 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:46:05,337 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:46:05,339 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.22
2025-12-09 03:46:05,339 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:46:05,342 - DEBUG - ya.test - execute: Command pid: 1703266
2025-12-09 03:46:09,054 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:46:09,055 - DEBUG - ya.test - _save_outputs: Command (pid 1703266) rc: 0
2025-12-09 03:46:09,055 - DEBUG - ya.test - _save_outputs: Command (pid 1703266) elapsed time (sec): 3.7118313312530518
2025-12-09 03:46:09,055 - DEBUG - ya.test - _save_outputs: Command (pid 1703266) wtime: 3.715
2025-12-09 03:46:09,055 - DEBUG - ya.test - _save_outputs: Command (pid 1703266) output:
None
2025-12-09 03:46:09,055 - DEBUG - ya.test - _save_outputs: Command (pid 1703266) errors:
2025-12-09T03:46:05.358804Z :INFO: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Starting read session
2025-12-09T03:46:05.358843Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Starting session to cluster null (localhost:15610)
2025-12-09T03:46:05.359425Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:05.359439Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:05.359445Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:46:05.364487Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] Successfully connected. Initializing session
2025-12-09T03:46:05.365486Z :INFO: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] Server session id: test_filters_optional_field_consumer_1_47_1610710450789667044_v1
2025-12-09T03:46:05.365581Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:05.366876Z :INFO: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:46:06.360261Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:9
2025-12-09T03:46:06.360302Z :INFO: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:08.987203Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:08.987281Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (9-9)
2025-12-09T03:46:08.987332Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (9-9)
2025-12-09T03:46:08.987454Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] Commit offsets [9, 10). Partition stream id: 1
2025-12-09T03:46:08.987568Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:46:08.991499Z :DEBUG: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:46:08.991618Z :INFO: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Closing read session. Close timeout: 5.000000s
2025-12-09T03:46:08.991649Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:9:10
2025-12-09T03:46:08.991659Z :INFO: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3632 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:46:08.991862Z :NOTICE: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:46:08.991982Z :INFO: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Closing read session. Close timeout: 0.000000s
2025-12-09T03:46:08.991990Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:9:10
2025-12-09T03:46:08.992011Z :INFO: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3633 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:08.992020Z :NOTICE: [local] [local] [52c2b329-a5faea56-ca1ef9d6-7992902a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:46:09,056 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:46:09,074 - DEBUG - root - control_query: Result: 
2025-12-09 03:46:09,083 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvsp2751pbi4d"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251963
        nanos: 123431000
      }
      modified_at {
        seconds: 1765251969
        nanos: 67935000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251963
      nanos: 735000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvsp26qntr1tm-ptqudqgcvsp2751pbi4d"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251963
      nanos: 123431000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $24 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200729)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:46:09,597 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:10,105 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvsp2751pbi4d"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251963
        nanos: 123431000
      }
      modified_at {
        seconds: 1765251969
        nanos: 67935000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251963
      nanos: 735000000
    }
    finished_at {
      seconds: 1765251969
      nanos: 895000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvsp26qntr1tm-ptqudqgcvsp2751pbi4d"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251963
      nanos: 123431000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.10s\",\"count\":1,\"avg\":\"0.10s\",\"max\":\"0.10s\",\"min\":\"0.10s\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $24 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200729)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:46:11,218 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:11,219 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "cbe7cd04-54d6-48b6-8381-8896b99fdbf2"

2025-12-09 03:46:11,238 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcvl1rpq1btp27"

2025-12-09 03:46:11,246 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvl1rpq1btp27"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251971
        nanos: 223696000
      }
      modified_at {
        seconds: 1765251971
        nanos: 223696000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvl1rpknlvgrh-ptqudqgcvl1rpq1btp27"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251971
      nanos: 223696000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:11,771 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvl1rpq1btp27"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251971
        nanos: 223696000
      }
      modified_at {
        seconds: 1765251971
        nanos: 223696000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251971
      nanos: 722000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvl1rpknlvgrh-ptqudqgcvl1rpq1btp27"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251971
      nanos: 223696000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:13,478 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00220*\014shard-000000\032\022\"\00221*\014shard-000000"
  }
}

2025-12-09 03:46:13,479 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:46:13,480 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:46:13,481 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.23
2025-12-09 03:46:13,481 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:46:13,484 - DEBUG - ya.test - execute: Command pid: 1707830
2025-12-09 03:46:17,106 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:46:17,106 - DEBUG - ya.test - _save_outputs: Command (pid 1707830) rc: 0
2025-12-09 03:46:17,107 - DEBUG - ya.test - _save_outputs: Command (pid 1707830) elapsed time (sec): 3.621690034866333
2025-12-09 03:46:17,107 - DEBUG - ya.test - _save_outputs: Command (pid 1707830) wtime: 3.625
2025-12-09 03:46:17,107 - DEBUG - ya.test - _save_outputs: Command (pid 1707830) output:
None
2025-12-09 03:46:17,107 - DEBUG - ya.test - _save_outputs: Command (pid 1707830) errors:
2025-12-09T03:46:13.504764Z :INFO: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Starting read session
2025-12-09T03:46:13.504811Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Starting session to cluster null (localhost:15610)
2025-12-09T03:46:13.505260Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:13.505272Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:13.505278Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:46:13.510204Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] Successfully connected. Initializing session
2025-12-09T03:46:13.513115Z :INFO: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] Server session id: test_filters_optional_field_consumer_1_49_16537189215837390228_v1
2025-12-09T03:46:13.513182Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:13.514487Z :INFO: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:46:14.506240Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:10
2025-12-09T03:46:14.506286Z :INFO: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:16.974338Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:16.974420Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (10-10)
2025-12-09T03:46:16.974444Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-12-09T03:46:16.974573Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] Commit offsets [10, 11). Partition stream id: 1
2025-12-09T03:46:16.974685Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:46:16.977292Z :DEBUG: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:46:16.977440Z :INFO: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Closing read session. Close timeout: 5.000000s
2025-12-09T03:46:16.977467Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:10:11
2025-12-09T03:46:16.977477Z :INFO: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3472 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:46:16.978010Z :NOTICE: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:46:16.978126Z :INFO: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Closing read session. Close timeout: 0.000000s
2025-12-09T03:46:16.978137Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:10:11
2025-12-09T03:46:16.978157Z :INFO: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3473 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:16.978168Z :NOTICE: [local] [local] [42312173-882737cb-15432a73-c2a2a9f4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:46:17,108 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:46:17,126 - DEBUG - root - control_query: Result: 
2025-12-09 03:46:17,137 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvl1rpq1btp27"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251971
        nanos: 223696000
      }
      modified_at {
        seconds: 1765251977
        nanos: 119619000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251971
      nanos: 722000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvl1rpknlvgrh-ptqudqgcvl1rpq1btp27"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251971
      nanos: 223696000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND COALESCE((`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")), FALSE))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"\\x12\\xB0\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x96\\x01R\\x93\\x01\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $28 (SqlIn $27 $26 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $26 (Member $25 \'\"data\")) (Coalesce $28 (Bool \'false))) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200860)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-09 03:46:17,646 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:18,153 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvl1rpq1btp27"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251971
        nanos: 223696000
      }
      modified_at {
        seconds: 1765251977
        nanos: 119619000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251971
      nanos: 722000000
    }
    finished_at {
      seconds: 1765251977
      nanos: 870000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvl1rpknlvgrh-ptqudqgcvl1rpq1btp27"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251971
      nanos: 223696000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND COALESCE((`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")), FALSE))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.10s\",\"count\":1,\"avg\":\"0.10s\",\"max\":\"0.10s\",\"min\":\"0.10s\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"\\x12\\xB0\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x96\\x01R\\x93\\x01\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $28 (SqlIn $27 $26 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $26 (Member $25 \'\"data\")) (Coalesce $28 (Bool \'false))) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200860)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-09 03:46:19,279 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:19,280 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "528d4c41-3d85-4ac6-9f59-b9a471dc14c8"

2025-12-09 03:46:19,310 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcvdblpi1go2fq"

2025-12-09 03:46:19,326 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvdblpi1go2fq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251979
        nanos: 290734000
      }
      modified_at {
        seconds: 1765251979
        nanos: 290734000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvdblp62jk03h-ptqudqgcvdblpi1go2fq"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251979
      nanos: 290734000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:19,837 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvdblpi1go2fq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251979
        nanos: 290734000
      }
      modified_at {
        seconds: 1765251979
        nanos: 290734000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251979
      nanos: 743000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvdblp62jk03h-ptqudqgcvdblpi1go2fq"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251979
      nanos: 290734000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF(COALESCE((`event` = \"event2\"), FALSE), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"Z]\\n4R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 (Bool \'false))\n    (let $28 (If (Coalesce (== $26 (String \'\"event2\")) $27) (AggrNotEquals $26 (Member $25 \'\"data\")) $27))\n    (return (OptionalIf $28 (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200804)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-09 03:46:21,591 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00222*\014shard-000000\032\022\"\00223*\014shard-000000"
  }
}

2025-12-09 03:46:21,593 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:46:21,595 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:46:21,597 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.24
2025-12-09 03:46:21,598 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:46:21,599 - DEBUG - ya.test - execute: Command pid: 1713371
2025-12-09 03:46:25,083 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:46:25,084 - DEBUG - ya.test - _save_outputs: Command (pid 1713371) rc: 0
2025-12-09 03:46:25,084 - DEBUG - ya.test - _save_outputs: Command (pid 1713371) elapsed time (sec): 3.4836158752441406
2025-12-09 03:46:25,084 - DEBUG - ya.test - _save_outputs: Command (pid 1713371) wtime: 3.486
2025-12-09 03:46:25,084 - DEBUG - ya.test - _save_outputs: Command (pid 1713371) output:
None
2025-12-09 03:46:25,085 - DEBUG - ya.test - _save_outputs: Command (pid 1713371) errors:
2025-12-09T03:46:21.634020Z :INFO: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Starting read session
2025-12-09T03:46:21.634070Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Starting session to cluster null (localhost:15610)
2025-12-09T03:46:21.634555Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:21.634568Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:21.634574Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:46:21.645660Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] Successfully connected. Initializing session
2025-12-09T03:46:21.659623Z :INFO: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] Server session id: test_filters_optional_field_consumer_1_51_6581745665527436048_v1
2025-12-09T03:46:21.659717Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:21.660524Z :INFO: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:46:22.637204Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:11
2025-12-09T03:46:22.637243Z :INFO: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1003 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:24.960906Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:24.962431Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (11-11)
2025-12-09T03:46:24.962468Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (11-11)
2025-12-09T03:46:24.963531Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] Commit offsets [11, 12). Partition stream id: 1
2025-12-09T03:46:24.963626Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:46:24.971449Z :DEBUG: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:46:24.973553Z :INFO: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Closing read session. Close timeout: 5.000000s
2025-12-09T03:46:24.973577Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:11:12
2025-12-09T03:46:24.973587Z :INFO: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3339 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:46:24.973758Z :NOTICE: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:46:24.974097Z :INFO: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Closing read session. Close timeout: 0.000000s
2025-12-09T03:46:24.974107Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:11:12
2025-12-09T03:46:24.974123Z :INFO: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3340 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:24.974132Z :NOTICE: [local] [local] [281a32b6-cd19304-aee5fd69-579e5d1e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:46:25,085 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:46:25,130 - DEBUG - root - control_query: Result: 
2025-12-09 03:46:25,145 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvdblpi1go2fq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251979
        nanos: 290734000
      }
      modified_at {
        seconds: 1765251985
        nanos: 120398000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251979
      nanos: 743000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvdblp62jk03h-ptqudqgcvdblpi1go2fq"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251979
      nanos: 290734000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF(COALESCE((`event` = \"event2\"), FALSE), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"Z]\\n4R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 (Bool \'false))\n    (let $28 (If (Coalesce (== $26 (String \'\"event2\")) $27) (AggrNotEquals $26 (Member $25 \'\"data\")) $27))\n    (return (OptionalIf $28 (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200804)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-09 03:46:25,659 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:26,170 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcvdblpi1go2fq"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251979
        nanos: 290734000
      }
      modified_at {
        seconds: 1765251985
        nanos: 120398000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251979
      nanos: 743000000
    }
    finished_at {
      seconds: 1765251985
      nanos: 866000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcvdblp62jk03h-ptqudqgcvdblpi1go2fq"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251979
      nanos: 290734000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF(COALESCE((`event` = \"event2\"), FALSE), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"89ms\",\"count\":1,\"avg\":\"89ms\",\"max\":\"89ms\",\"min\":\"89ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"Z]\\n4R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 (Bool \'false))\n    (let $28 (If (Coalesce (== $26 (String \'\"event2\")) $27) (AggrNotEquals $26 (Member $25 \'\"data\")) $27))\n    (return (OptionalIf $28 (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200804)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-09 03:46:27,292 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:27,293 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "73be77f7-026d-441f-8466-4075c1d9a656"

2025-12-09 03:46:27,315 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcv5n84c9u98sj"

2025-12-09 03:46:27,326 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcv5n84c9u98sj"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251987
        nanos: 300131000
      }
      modified_at {
        seconds: 1765251987
        nanos: 300131000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcv5n8470nfdrp-ptqudqgcv5n84c9u98sj"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251987
      nanos: 300131000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:27,847 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcv5n84c9u98sj"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251987
        nanos: 300131000
      }
      modified_at {
        seconds: 1765251987
        nanos: 300131000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251987
      nanos: 739000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcv5n8470nfdrp-ptqudqgcv5n84c9u98sj"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251987
      nanos: 300131000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:46:29,562 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00224*\014shard-000000\032\022\"\00225*\014shard-000000"
  }
}

2025-12-09 03:46:29,563 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:46:29,564 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:46:29,565 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.25
2025-12-09 03:46:29,566 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:46:29,567 - DEBUG - ya.test - execute: Command pid: 1719112
2025-12-09 03:46:30,244 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-09 03:46:30,244 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:46:30,252 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-09 03:46:30,252 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 6859265b-cdb0-4d43-b2a3-19fcb098d25d, localhost:15610): creating call state
2025-12-09 03:46:30,253 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 6859265b-cdb0-4d43-b2a3-19fcb098d25d, localhost:15610): request = { database: "local" }
2025-12-09 03:46:30,256 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 6859265b-cdb0-4d43-b2a3-19fcb098d25d, localhost:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-syjwtgwtdu.auto.internal" port: 15610 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-09 03:46:30,257 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-syjwtgwtdu.auto.internal:15610, location 1, ssl: False>]>
2025-12-09 03:46:30,258 - INFO - ydb.connection - close: Closing channel for endpoint localhost:15610
2025-12-09 03:46:32,983 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:46:32,984 - DEBUG - ya.test - _save_outputs: Command (pid 1719112) rc: 0
2025-12-09 03:46:32,984 - DEBUG - ya.test - _save_outputs: Command (pid 1719112) elapsed time (sec): 3.4167704582214355
2025-12-09 03:46:32,985 - DEBUG - ya.test - _save_outputs: Command (pid 1719112) wtime: 3.418
2025-12-09 03:46:32,985 - DEBUG - ya.test - _save_outputs: Command (pid 1719112) output:
None
2025-12-09 03:46:32,985 - DEBUG - ya.test - _save_outputs: Command (pid 1719112) errors:
2025-12-09T03:46:29.587628Z :INFO: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Starting read session
2025-12-09T03:46:29.587673Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Starting session to cluster null (localhost:15610)
2025-12-09T03:46:29.588220Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:29.588235Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:29.588242Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:46:29.593458Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] Successfully connected. Initializing session
2025-12-09T03:46:29.594605Z :INFO: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] Server session id: test_filters_optional_field_consumer_1_53_6934049484506673235_v1
2025-12-09T03:46:29.594687Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:29.597582Z :INFO: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:46:30.588307Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:12
2025-12-09T03:46:30.588363Z :INFO: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:32.962720Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:32.962807Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (12-12)
2025-12-09T03:46:32.962863Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (12-12)
2025-12-09T03:46:32.963003Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] Commit offsets [12, 13). Partition stream id: 1
2025-12-09T03:46:32.963164Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:46:32.965969Z :DEBUG: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:46:32.966155Z :INFO: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Closing read session. Close timeout: 5.000000s
2025-12-09T03:46:32.966187Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:12:13
2025-12-09T03:46:32.966198Z :INFO: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3378 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:46:32.966474Z :NOTICE: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:46:32.966603Z :INFO: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Closing read session. Close timeout: 0.000000s
2025-12-09T03:46:32.966617Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:12:13
2025-12-09T03:46:32.966639Z :INFO: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3379 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:32.966648Z :NOTICE: [local] [local] [e2771877-3ac81f81-5800561f-68878b05] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:46:32,985 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:46:33,003 - DEBUG - root - control_query: Result: 
2025-12-09 03:46:33,011 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcv5n84c9u98sj"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251987
        nanos: 300131000
      }
      modified_at {
        seconds: 1765251992
        nanos: 998006000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251987
      nanos: 739000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcv5n8470nfdrp-ptqudqgcv5n84c9u98sj"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251987
      nanos: 300131000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:46:33,527 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:34,043 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcv5n84c9u98sj"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251987
        nanos: 300131000
      }
      modified_at {
        seconds: 1765251992
        nanos: 998006000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251987
      nanos: 739000000
    }
    finished_at {
      seconds: 1765251993
      nanos: 887000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcv5n8470nfdrp-ptqudqgcv5n84c9u98sj"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251987
      nanos: 300131000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"64ms\",\"count\":1,\"avg\":\"64ms\",\"max\":\"64ms\",\"min\":\"64ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:46:35,313 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:35,314 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "06dbd97d-1fa3-4148-946c-93832aa283d4"

2025-12-09 03:46:35,329 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcuu2ht14ivcnm"

2025-12-09 03:46:35,337 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcuu2ht14ivcnm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251995
        nanos: 318305000
      }
      modified_at {
        seconds: 1765251995
        nanos: 318305000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcuu2hsn6ulibb-ptqudqgcuu2ht14ivcnm"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251995
      nanos: 318305000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:35,847 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcuu2ht14ivcnm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251995
        nanos: 318305000
      }
      modified_at {
        seconds: 1765251995
        nanos: 318305000
      }
      revision: 1
    }
    started_at {
      seconds: 1765251995
      nanos: 742000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcuu2hsn6ulibb-ptqudqgcuu2ht14ivcnm"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765251995
      nanos: 318305000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), (`data` = \"hello2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"RS\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x1FB\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (OptionalIf (Coalesce (Coalesce (== (Member $25 \'\"event\") (String \'\"event2\")) (== (Member $25 \'\"data\") (String \'\"hello2\"))) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200795)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-09 03:46:37,541 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00226*\014shard-000000\032\022\"\00227*\014shard-000000"
  }
}

2025-12-09 03:46:37,541 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:46:37,542 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:46:37,544 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.26
2025-12-09 03:46:37,544 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:46:37,545 - DEBUG - ya.test - execute: Command pid: 1726124
2025-12-09 03:46:40,575 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-09 03:46:40,576 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:46:40,581 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-09 03:46:40,581 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, ef0bcbc3-895e-4671-ab2b-19a8f101d5ab, localhost:15610): creating call state
2025-12-09 03:46:40,582 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, ef0bcbc3-895e-4671-ab2b-19a8f101d5ab, localhost:15610): request = { database: "local" }
2025-12-09 03:46:40,584 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, ef0bcbc3-895e-4671-ab2b-19a8f101d5ab, localhost:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-syjwtgwtdu.auto.internal" port: 15610 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-09 03:46:40,584 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-syjwtgwtdu.auto.internal:15610, location 1, ssl: False>]>
2025-12-09 03:46:40,585 - INFO - ydb.connection - close: Closing channel for endpoint localhost:15610
2025-12-09 03:46:40,954 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:46:40,955 - DEBUG - ya.test - _save_outputs: Command (pid 1726124) rc: 0
2025-12-09 03:46:40,955 - DEBUG - ya.test - _save_outputs: Command (pid 1726124) elapsed time (sec): 3.4092679023742676
2025-12-09 03:46:40,955 - DEBUG - ya.test - _save_outputs: Command (pid 1726124) wtime: 3.41
2025-12-09 03:46:40,955 - DEBUG - ya.test - _save_outputs: Command (pid 1726124) output:
None
2025-12-09 03:46:40,955 - DEBUG - ya.test - _save_outputs: Command (pid 1726124) errors:
2025-12-09T03:46:37.565068Z :INFO: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Starting read session
2025-12-09T03:46:37.565130Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Starting session to cluster null (localhost:15610)
2025-12-09T03:46:37.565561Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:37.565574Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:37.565580Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:46:37.570948Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] Successfully connected. Initializing session
2025-12-09T03:46:37.571964Z :INFO: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] Server session id: test_filters_optional_field_consumer_1_55_12208771480360928579_v1
2025-12-09T03:46:37.572062Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:37.573547Z :INFO: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:46:38.566261Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:13
2025-12-09T03:46:38.566299Z :INFO: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:40.922386Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:40.922474Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (13-13)
2025-12-09T03:46:40.922524Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (13-13)
2025-12-09T03:46:40.922661Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] Commit offsets [13, 14). Partition stream id: 1
2025-12-09T03:46:40.922738Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:46:40.925462Z :DEBUG: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:46:40.925618Z :INFO: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Closing read session. Close timeout: 5.000000s
2025-12-09T03:46:40.925654Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:13:14
2025-12-09T03:46:40.925665Z :INFO: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3360 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:46:40.925904Z :NOTICE: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:46:40.926014Z :INFO: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Closing read session. Close timeout: 0.000000s
2025-12-09T03:46:40.926023Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:13:14
2025-12-09T03:46:40.926041Z :INFO: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3361 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:40.926051Z :NOTICE: [local] [local] [8d4734cf-88e9bd2a-239b2b90-26d5f7f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:46:40,956 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:46:40,972 - DEBUG - root - control_query: Result: 
2025-12-09 03:46:40,980 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcuu2ht14ivcnm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251995
        nanos: 318305000
      }
      modified_at {
        seconds: 1765252000
        nanos: 967704000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251995
      nanos: 742000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcuu2hsn6ulibb-ptqudqgcuu2ht14ivcnm"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251995
      nanos: 318305000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), (`data` = \"hello2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"RS\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x1FB\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (OptionalIf (Coalesce (Coalesce (== (Member $25 \'\"event\") (String \'\"event2\")) (== (Member $25 \'\"data\") (String \'\"hello2\"))) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200795)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-09 03:46:41,491 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:41,998 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcuu2ht14ivcnm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765251995
        nanos: 318305000
      }
      modified_at {
        seconds: 1765252000
        nanos: 967704000
      }
      revision: 2
    }
    started_at {
      seconds: 1765251995
      nanos: 742000000
    }
    finished_at {
      seconds: 1765252001
      nanos: 854000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcuu2hsn6ulibb-ptqudqgcuu2ht14ivcnm"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765251995
      nanos: 318305000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), (`data` = \"hello2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"80ms\",\"count\":1,\"avg\":\"80ms\",\"max\":\"80ms\",\"min\":\"80ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"RS\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x1FB\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (OptionalIf (Coalesce (Coalesce (== (Member $25 \'\"event\") (String \'\"event2\")) (== (Member $25 \'\"data\") (String \'\"hello2\"))) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200795)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-09 03:46:43,112 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:43,113 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "04ba68ec-8727-4234-ac6c-b02f37c06c57"

2025-12-09 03:46:43,128 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcumkhp2c3eeu6"

2025-12-09 03:46:43,137 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcumkhp2c3eeu6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252003
        nanos: 117203000
      }
      modified_at {
        seconds: 1765252003
        nanos: 117203000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcumkhor29mlga-ptqudqgcumkhp2c3eeu6"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252003
      nanos: 117203000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:43,646 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcumkhp2c3eeu6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252003
        nanos: 117203000
      }
      modified_at {
        seconds: 1765252003
        nanos: 117203000
      }
      revision: 1
    }
    started_at {
      seconds: 1765252003
      nanos: 150000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcumkhor29mlga-ptqudqgcumkhp2c3eeu6"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252003
      nanos: 117203000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (COALESCE(`event`, \"\") REGEXP \"e.*e.*t2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t2\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t2@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200775)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:46:44,811 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00228*\014shard-000000\032\022\"\00229*\014shard-000000"
  }
}

2025-12-09 03:46:44,811 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:46:44,812 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:46:44,814 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.27
2025-12-09 03:46:44,814 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:46:44,815 - DEBUG - ya.test - execute: Command pid: 1730649
2025-12-09 03:46:48,423 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:46:48,424 - DEBUG - ya.test - _save_outputs: Command (pid 1730649) rc: 0
2025-12-09 03:46:48,424 - DEBUG - ya.test - _save_outputs: Command (pid 1730649) elapsed time (sec): 3.608182907104492
2025-12-09 03:46:48,424 - DEBUG - ya.test - _save_outputs: Command (pid 1730649) wtime: 3.609
2025-12-09 03:46:48,424 - DEBUG - ya.test - _save_outputs: Command (pid 1730649) output:
None
2025-12-09 03:46:48,425 - DEBUG - ya.test - _save_outputs: Command (pid 1730649) errors:
2025-12-09T03:46:44.834121Z :INFO: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Starting read session
2025-12-09T03:46:44.834178Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Starting session to cluster null (localhost:15610)
2025-12-09T03:46:44.834642Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:44.834656Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:44.834662Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:46:44.840179Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] Successfully connected. Initializing session
2025-12-09T03:46:44.841240Z :INFO: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] Server session id: test_filters_optional_field_consumer_1_57_7212745506630739414_v1
2025-12-09T03:46:44.841291Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:44.842851Z :INFO: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:46:45.838102Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:14
2025-12-09T03:46:45.838146Z :INFO: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1003 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:48.339494Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:48.339626Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (14-14)
2025-12-09T03:46:48.339689Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (14-14)
2025-12-09T03:46:48.339812Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] Commit offsets [14, 15). Partition stream id: 1
2025-12-09T03:46:48.339935Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:46:48.343012Z :DEBUG: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:46:48.343200Z :INFO: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Closing read session. Close timeout: 5.000000s
2025-12-09T03:46:48.343241Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:14:15
2025-12-09T03:46:48.343252Z :INFO: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3509 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:46:48.343551Z :NOTICE: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:46:48.346143Z :INFO: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Closing read session. Close timeout: 0.000000s
2025-12-09T03:46:48.346157Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:14:15
2025-12-09T03:46:48.346194Z :INFO: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3512 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:48.346208Z :NOTICE: [local] [local] [d104c482-bbab9071-c243e735-3a33c017] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:46:48,425 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:46:48,447 - DEBUG - root - control_query: Result: 
2025-12-09 03:46:48,461 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcumkhp2c3eeu6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252003
        nanos: 117203000
      }
      modified_at {
        seconds: 1765252008
        nanos: 441526000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252003
      nanos: 150000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcumkhor29mlga-ptqudqgcumkhp2c3eeu6"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252003
      nanos: 117203000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (COALESCE(`event`, \"\") REGEXP \"e.*e.*t2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t2\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t2@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200775)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:46:48,979 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:49,488 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcumkhp2c3eeu6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252003
        nanos: 117203000
      }
      modified_at {
        seconds: 1765252008
        nanos: 441526000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252003
      nanos: 150000000
    }
    finished_at {
      seconds: 1765252009
      nanos: 265000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcumkhor29mlga-ptqudqgcumkhp2c3eeu6"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252003
      nanos: 117203000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (COALESCE(`event`, \"\") REGEXP \"e.*e.*t2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"87ms\",\"count\":1,\"avg\":\"87ms\",\"max\":\"87ms\",\"min\":\"87ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t2\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t2@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200775)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:46:50,618 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:50,618 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "2891ee9d-515a-4710-9bb9-459ac8794927"

2025-12-09 03:46:50,648 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcuff7m3dibeb1"

2025-12-09 03:46:50,659 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcuff7m3dibeb1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252010
        nanos: 631395000
      }
      modified_at {
        seconds: 1765252010
        nanos: 631395000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcuff7ltondgef-ptqudqgcuff7m3dibeb1"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252010
      nanos: 631395000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:51,172 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcuff7m3dibeb1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252010
        nanos: 631395000
      }
      modified_at {
        seconds: 1765252010
        nanos: 631395000
      }
      revision: 1
    }
    started_at {
      seconds: 1765252010
      nanos: 753000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcuff7ltondgef-ptqudqgcuff7m3dibeb1"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252010
      nanos: 631395000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (COALESCE(`event`, \"\") REGEXP \"e.*e.*t1\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"\\n3\\n1b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t1\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t1@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Not (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\"))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200794)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:46:52,347 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00230*\014shard-000000\032\022\"\00231*\014shard-000000"
  }
}

2025-12-09 03:46:52,347 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:46:52,348 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:46:52,350 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.28
2025-12-09 03:46:52,350 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:46:52,351 - DEBUG - ya.test - execute: Command pid: 1736375
2025-12-09 03:46:56,089 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:46:56,089 - DEBUG - ya.test - _save_outputs: Command (pid 1736375) rc: 0
2025-12-09 03:46:56,089 - DEBUG - ya.test - _save_outputs: Command (pid 1736375) elapsed time (sec): 3.737635612487793
2025-12-09 03:46:56,090 - DEBUG - ya.test - _save_outputs: Command (pid 1736375) wtime: 3.739
2025-12-09 03:46:56,090 - DEBUG - ya.test - _save_outputs: Command (pid 1736375) output:
None
2025-12-09 03:46:56,090 - DEBUG - ya.test - _save_outputs: Command (pid 1736375) errors:
2025-12-09T03:46:52.370921Z :INFO: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Starting read session
2025-12-09T03:46:52.370974Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Starting session to cluster null (localhost:15610)
2025-12-09T03:46:52.371442Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:52.371455Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:52.371461Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:46:52.377261Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] Successfully connected. Initializing session
2025-12-09T03:46:52.378572Z :INFO: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] Server session id: test_filters_optional_field_consumer_1_59_15757337364929620174_v1
2025-12-09T03:46:52.378666Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:52.382945Z :INFO: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:46:53.372351Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:15
2025-12-09T03:46:53.372407Z :INFO: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:55.996738Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:46:55.998219Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (15-15)
2025-12-09T03:46:56.002432Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (15-15)
2025-12-09T03:46:56.002605Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] Commit offsets [15, 16). Partition stream id: 1
2025-12-09T03:46:56.002783Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:46:56.006274Z :DEBUG: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:46:56.006476Z :INFO: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Closing read session. Close timeout: 5.000000s
2025-12-09T03:46:56.006515Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:15:16
2025-12-09T03:46:56.006525Z :INFO: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3635 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:46:56.007537Z :NOTICE: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:46:56.007618Z :INFO: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Closing read session. Close timeout: 0.000000s
2025-12-09T03:46:56.007627Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:15:16
2025-12-09T03:46:56.007665Z :INFO: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3636 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:46:56.007673Z :NOTICE: [local] [local] [ef5c925c-f06a0bc4-d408e62e-3bee088a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:46:56,091 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:46:56,123 - DEBUG - root - control_query: Result: 
2025-12-09 03:46:56,134 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcuff7m3dibeb1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252010
        nanos: 631395000
      }
      modified_at {
        seconds: 1765252016
        nanos: 111414000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252010
      nanos: 753000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcuff7ltondgef-ptqudqgcuff7m3dibeb1"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252010
      nanos: 631395000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (COALESCE(`event`, \"\") REGEXP \"e.*e.*t1\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"\\n3\\n1b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t1\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t1@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Not (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\"))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200794)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:46:56,662 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:57,173 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcuff7m3dibeb1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252010
        nanos: 631395000
      }
      modified_at {
        seconds: 1765252016
        nanos: 111414000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252010
      nanos: 753000000
    }
    finished_at {
      seconds: 1765252016
      nanos: 926000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcuff7ltondgef-ptqudqgcuff7m3dibeb1"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252010
      nanos: 631395000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (COALESCE(`event`, \"\") REGEXP \"e.*e.*t1\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"90ms\",\"count\":1,\"avg\":\"90ms\",\"max\":\"90ms\",\"min\":\"90ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"\\n3\\n1b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t1\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t1@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Not (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\"))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200794)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-09 03:46:58,307 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:46:58,308 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "26d7ecc9-9413-4e79-aeb2-2c3edc50f899"

2025-12-09 03:46:58,329 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcu84pip0j4qc6"

2025-12-09 03:46:58,341 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcu84pip0j4qc6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252018
        nanos: 313568000
      }
      modified_at {
        seconds: 1765252018
        nanos: 313568000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcu84pigauu82p-ptqudqgcu84pip0j4qc6"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252018
      nanos: 313568000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
    syntax: YQL_V1
  }
}

2025-12-09 03:46:58,857 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcu84pip0j4qc6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252018
        nanos: 313568000
      }
      modified_at {
        seconds: 1765252018
        nanos: 313568000
      }
      revision: 1
    }
    started_at {
      seconds: 1765252018
      nanos: 760000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcu84pigauu82p-ptqudqgcu84pip0j4qc6"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252018
      nanos: 313568000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $10 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $11 \'(\'\"SharedReading\" \'\"1\"))\n(let $12 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $13 \'($10 $11 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $12))\n(let $14 (SecureParam \'\"cluster:default_yds\"))\n(let $15 \'\"\\x1AT\\n5b3\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x17*\\x15\\n\\x06\\x12\\x04data\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\")\n(let $16 (DqPqTopicSource $1 $8 $9 $13 $14 $15 $7 \'\"\"))\n(let $17 (DataSink \'\"pq\" \'\"yds\"))\n(let $18 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $19 (DqPqTopicSink $18 \'($10 $12) $14))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $16)) (lambda \'($20) (block \'(\n  (let $21 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($11))))\n  (let $22 (DqSourceWideWrap $20 $2 $7 $21))\n  (return (FlatMap (NarrowMap $22 (lambda \'($23 $24 $25) (AsStruct \'(\'\"data\" $23) \'(\'\"event\" $24) \'(\'\"time\" $25)))) (lambda \'($26) (block \'(\n    (let $27 (String \'\"\"))\n    (let $28 (DataType \'Bool))\n    (let $29 (OptionalType (StructType \'(\'\"CaseSensitive\" $28) \'(\'\"DotNl\" $28) \'(\'\"Literal\" $28) \'(\'\"LogErrors\" $28) \'(\'\"LongestMatch\" $28) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $28) \'(\'\"NeverNl\" $28) \'(\'\"OneLine\" $28) \'(\'\"PerlClasses\" $28) \'(\'\"PosixSyntax\" $28) \'(\'\"Utf8\" $28) \'(\'\"WordBoundary\" $28))))\n    (let $30 (CallableType \'() \'($28) \'($5)))\n    (let $31 (Udf \'\"Re2.Grep\" \'((Coalesce (Member $26 \'\"data\") $27) (Nothing $29)) (VoidType) \'\"\" $30 (TupleType $4 $29) \'\"\" \'()))\n    (let $32 (Member $26 \'\"time\"))\n    (return (OptionalIf (Or (Apply $31 (Just (Coalesce (Member $26 \'\"event\") $27))) (== $32 (Int32 \'\"102\"))) (AsStruct \'(\'\"column0\" (SafeCast $32 $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200926)) \'((DqSink \'\"0\" $17 $19))))) $17))\n)\n"
  }
}

2025-12-09 03:47:00,585 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00232*\014shard-000000\032\022\"\00233*\014shard-000000"
  }
}

2025-12-09 03:47:00,609 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:47:00,610 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:47:00,613 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.29
2025-12-09 03:47:00,615 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:47:00,616 - DEBUG - ya.test - execute: Command pid: 1741821
2025-12-09 03:47:04,032 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:47:04,033 - DEBUG - ya.test - _save_outputs: Command (pid 1741821) rc: 0
2025-12-09 03:47:04,033 - DEBUG - ya.test - _save_outputs: Command (pid 1741821) elapsed time (sec): 3.405531406402588
2025-12-09 03:47:04,033 - DEBUG - ya.test - _save_outputs: Command (pid 1741821) wtime: 3.417
2025-12-09 03:47:04,033 - DEBUG - ya.test - _save_outputs: Command (pid 1741821) output:
None
2025-12-09 03:47:04,033 - DEBUG - ya.test - _save_outputs: Command (pid 1741821) errors:
2025-12-09T03:47:00.644031Z :INFO: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Starting read session
2025-12-09T03:47:00.651731Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Starting session to cluster null (localhost:15610)
2025-12-09T03:47:00.652389Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:00.652403Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:00.652410Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:47:00.659157Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] Successfully connected. Initializing session
2025-12-09T03:47:00.662881Z :INFO: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] Server session id: test_filters_optional_field_consumer_1_61_2364019473003228594_v1
2025-12-09T03:47:00.663194Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:00.667724Z :INFO: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:47:01.653276Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:16
2025-12-09T03:47:01.653321Z :INFO: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1009 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:04.001378Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:04.001471Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (16-16)
2025-12-09T03:47:04.001538Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (16-16)
2025-12-09T03:47:04.002066Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] Commit offsets [16, 17). Partition stream id: 1
2025-12-09T03:47:04.002174Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:47:04.004681Z :DEBUG: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:47:04.004841Z :INFO: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Closing read session. Close timeout: 5.000000s
2025-12-09T03:47:04.004865Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:16:17
2025-12-09T03:47:04.004876Z :INFO: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3360 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:47:04.005123Z :NOTICE: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:47:04.008484Z :INFO: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Closing read session. Close timeout: 0.000000s
2025-12-09T03:47:04.008499Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:16:17
2025-12-09T03:47:04.008526Z :INFO: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3364 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:04.008537Z :NOTICE: [local] [local] [6d90d5f1-8f4802bd-662d18b7-4085d706] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:47:04,034 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:47:04,051 - DEBUG - root - control_query: Result: 
2025-12-09 03:47:04,060 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcu84pip0j4qc6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252018
        nanos: 313568000
      }
      modified_at {
        seconds: 1765252024
        nanos: 46423000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252018
      nanos: 760000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcu84pigauu82p-ptqudqgcu84pip0j4qc6"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252018
      nanos: 313568000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((COALESCE(`event`, \"\") REGEXP COALESCE(`data`, \"\")) OR (`time` = 102))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $10 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $11 \'(\'\"SharedReading\" \'\"1\"))\n(let $12 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $13 \'($10 $11 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $12))\n(let $14 (SecureParam \'\"cluster:default_yds\"))\n(let $15 \'\"\\x1AT\\n5b3\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x17*\\x15\\n\\x06\\x12\\x04data\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\")\n(let $16 (DqPqTopicSource $1 $8 $9 $13 $14 $15 $7 \'\"\"))\n(let $17 (DataSink \'\"pq\" \'\"yds\"))\n(let $18 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $19 (DqPqTopicSink $18 \'($10 $12) $14))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $16)) (lambda \'($20) (block \'(\n  (let $21 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($11))))\n  (let $22 (DqSourceWideWrap $20 $2 $7 $21))\n  (return (FlatMap (NarrowMap $22 (lambda \'($23 $24 $25) (AsStruct \'(\'\"data\" $23) \'(\'\"event\" $24) \'(\'\"time\" $25)))) (lambda \'($26) (block \'(\n    (let $27 (String \'\"\"))\n    (let $28 (DataType \'Bool))\n    (let $29 (OptionalType (StructType \'(\'\"CaseSensitive\" $28) \'(\'\"DotNl\" $28) \'(\'\"Literal\" $28) \'(\'\"LogErrors\" $28) \'(\'\"LongestMatch\" $28) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $28) \'(\'\"NeverNl\" $28) \'(\'\"OneLine\" $28) \'(\'\"PerlClasses\" $28) \'(\'\"PosixSyntax\" $28) \'(\'\"Utf8\" $28) \'(\'\"WordBoundary\" $28))))\n    (let $30 (CallableType \'() \'($28) \'($5)))\n    (let $31 (Udf \'\"Re2.Grep\" \'((Coalesce (Member $26 \'\"data\") $27) (Nothing $29)) (VoidType) \'\"\" $30 (TupleType $4 $29) \'\"\" \'()))\n    (let $32 (Member $26 \'\"time\"))\n    (return (OptionalIf (Or (Apply $31 (Just (Coalesce (Member $26 \'\"event\") $27))) (== $32 (Int32 \'\"102\"))) (AsStruct \'(\'\"column0\" (SafeCast $32 $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200926)) \'((DqSink \'\"0\" $17 $19))))) $17))\n)\n"
  }
}

2025-12-09 03:47:04,568 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:05,076 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcu84pip0j4qc6"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252018
        nanos: 313568000
      }
      modified_at {
        seconds: 1765252024
        nanos: 46423000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252018
      nanos: 760000000
    }
    finished_at {
      seconds: 1765252024
      nanos: 917000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcu84pigauu82p-ptqudqgcu84pip0j4qc6"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252018
      nanos: 313568000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((COALESCE(`event`, \"\") REGEXP COALESCE(`data`, \"\")) OR (`time` = 102))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.10s\",\"count\":1,\"avg\":\"0.10s\",\"max\":\"0.10s\",\"min\":\"0.10s\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $10 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $11 \'(\'\"SharedReading\" \'\"1\"))\n(let $12 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $13 \'($10 $11 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $12))\n(let $14 (SecureParam \'\"cluster:default_yds\"))\n(let $15 \'\"\\x1AT\\n5b3\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x17*\\x15\\n\\x06\\x12\\x04data\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\")\n(let $16 (DqPqTopicSource $1 $8 $9 $13 $14 $15 $7 \'\"\"))\n(let $17 (DataSink \'\"pq\" \'\"yds\"))\n(let $18 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $19 (DqPqTopicSink $18 \'($10 $12) $14))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $16)) (lambda \'($20) (block \'(\n  (let $21 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($11))))\n  (let $22 (DqSourceWideWrap $20 $2 $7 $21))\n  (return (FlatMap (NarrowMap $22 (lambda \'($23 $24 $25) (AsStruct \'(\'\"data\" $23) \'(\'\"event\" $24) \'(\'\"time\" $25)))) (lambda \'($26) (block \'(\n    (let $27 (String \'\"\"))\n    (let $28 (DataType \'Bool))\n    (let $29 (OptionalType (StructType \'(\'\"CaseSensitive\" $28) \'(\'\"DotNl\" $28) \'(\'\"Literal\" $28) \'(\'\"LogErrors\" $28) \'(\'\"LongestMatch\" $28) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $28) \'(\'\"NeverNl\" $28) \'(\'\"OneLine\" $28) \'(\'\"PerlClasses\" $28) \'(\'\"PosixSyntax\" $28) \'(\'\"Utf8\" $28) \'(\'\"WordBoundary\" $28))))\n    (let $30 (CallableType \'() \'($28) \'($5)))\n    (let $31 (Udf \'\"Re2.Grep\" \'((Coalesce (Member $26 \'\"data\") $27) (Nothing $29)) (VoidType) \'\"\" $30 (TupleType $4 $29) \'\"\" \'()))\n    (let $32 (Member $26 \'\"time\"))\n    (return (OptionalIf (Or (Apply $31 (Just (Coalesce (Member $26 \'\"event\") $27))) (== $32 (Int32 \'\"102\"))) (AsStruct \'(\'\"column0\" (SafeCast $32 $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200926)) \'((DqSink \'\"0\" $17 $19))))) $17))\n)\n"
  }
}

2025-12-09 03:47:06,190 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:06,191 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "19df618a-825d-4e4d-9a2d-b6547cce0291"

2025-12-09 03:47:06,207 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcu0k8fg4il4k9"

2025-12-09 03:47:06,215 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcu0k8fg4il4k9"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252026
        nanos: 195416000
      }
      modified_at {
        seconds: 1765252026
        nanos: 195416000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcu0k8f6lkfi1d-ptqudqgcu0k8fg4il4k9"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252026
      nanos: 195416000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
}

2025-12-09 03:47:06,724 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:07,236 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcu0k8fg4il4k9"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252026
        nanos: 195416000
      }
      modified_at {
        seconds: 1765252026
        nanos: 195416000
      }
      revision: 1
    }
    started_at {
      seconds: 1765252026
      nanos: 760000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcu0k8f6lkfi1d-ptqudqgcu0k8fg4il4k9"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252026
      nanos: 195416000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (IF((`nested` IS NOT NULL), CAST(`nested` AS String), NULL) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b=\\n\'2%\\n\\f:\\n\\n\\b\\x12\\x06nested\\x12\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x1A\\x02\\\"\\x00\\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (FlatMap (Member $22 \'\"nested\") (lambda \'($27) (Just (ToBytes $27))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200774)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:47:08,378 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00234*\014shard-000000\032\022\"\00235*\014shard-000000"
  }
}

2025-12-09 03:47:08,378 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:47:08,379 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:47:08,380 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.30
2025-12-09 03:47:08,380 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:47:08,381 - DEBUG - ya.test - execute: Command pid: 1744750
2025-12-09 03:47:11,986 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:47:11,987 - DEBUG - ya.test - _save_outputs: Command (pid 1744750) rc: 0
2025-12-09 03:47:11,987 - DEBUG - ya.test - _save_outputs: Command (pid 1744750) elapsed time (sec): 3.6055169105529785
2025-12-09 03:47:11,987 - DEBUG - ya.test - _save_outputs: Command (pid 1744750) wtime: 3.606
2025-12-09 03:47:11,987 - DEBUG - ya.test - _save_outputs: Command (pid 1744750) output:
None
2025-12-09 03:47:11,988 - DEBUG - ya.test - _save_outputs: Command (pid 1744750) errors:
2025-12-09T03:47:08.396798Z :INFO: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Starting read session
2025-12-09T03:47:08.396830Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Starting session to cluster null (localhost:15610)
2025-12-09T03:47:08.397156Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:08.397168Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:08.397173Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:47:08.401935Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] Successfully connected. Initializing session
2025-12-09T03:47:08.403229Z :INFO: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] Server session id: test_filters_optional_field_consumer_1_63_411020953887022504_v1
2025-12-09T03:47:08.403313Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:08.404747Z :INFO: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:47:09.398183Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:17
2025-12-09T03:47:09.398229Z :INFO: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:11.959203Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:11.959296Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (17-17)
2025-12-09T03:47:11.959381Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (17-17)
2025-12-09T03:47:11.959502Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] Commit offsets [17, 18). Partition stream id: 1
2025-12-09T03:47:11.959661Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:47:11.962454Z :DEBUG: [local] [local] [6783646b-b699a42f-9948d371-249251d8] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:47:11.962624Z :INFO: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Closing read session. Close timeout: 5.000000s
2025-12-09T03:47:11.962654Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:17:18
2025-12-09T03:47:11.962665Z :INFO: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3565 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:47:11.963100Z :NOTICE: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:47:11.963215Z :INFO: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Closing read session. Close timeout: 0.000000s
2025-12-09T03:47:11.963226Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:17:18
2025-12-09T03:47:11.963245Z :INFO: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3566 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:11.963255Z :NOTICE: [local] [local] [6783646b-b699a42f-9948d371-249251d8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:47:11,988 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:47:12,002 - DEBUG - root - control_query: Result: 
2025-12-09 03:47:12,009 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcu0k8fg4il4k9"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252026
        nanos: 195416000
      }
      modified_at {
        seconds: 1765252031
        nanos: 998414000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252026
      nanos: 760000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcu0k8f6lkfi1d-ptqudqgcu0k8fg4il4k9"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252026
      nanos: 195416000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (IF((`nested` IS NOT NULL), CAST(`nested` AS String), NULL) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b=\\n\'2%\\n\\f:\\n\\n\\b\\x12\\x06nested\\x12\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x1A\\x02\\\"\\x00\\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (FlatMap (Member $22 \'\"nested\") (lambda \'($27) (Just (ToBytes $27))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200774)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:47:12,517 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:13,025 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcu0k8fg4il4k9"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252026
        nanos: 195416000
      }
      modified_at {
        seconds: 1765252031
        nanos: 998414000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252026
      nanos: 760000000
    }
    finished_at {
      seconds: 1765252032
      nanos: 874000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcu0k8f6lkfi1d-ptqudqgcu0k8fg4il4k9"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252026
      nanos: 195416000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (IF((`nested` IS NOT NULL), CAST(`nested` AS String), NULL) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"98ms\",\"count\":1,\"avg\":\"98ms\",\"max\":\"98ms\",\"min\":\"98ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b=\\n\'2%\\n\\f:\\n\\n\\b\\x12\\x06nested\\x12\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x1A\\x02\\\"\\x00\\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (FlatMap (Member $22 \'\"nested\") (lambda \'($27) (Just (ToBytes $27))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200774)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:47:14,135 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:14,136 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "e4bafab3-59a7-40f4-9c0a-4681feb056b1"

2025-12-09 03:47:14,152 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgctp1pt380h1kl"

2025-12-09 03:47:14,160 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgctp1pt380h1kl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252034
        nanos: 140192000
      }
      modified_at {
        seconds: 1765252034
        nanos: 140192000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgctp1psu8jgtjh-ptqudqgctp1pt380h1kl"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252034
      nanos: 140192000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
}

2025-12-09 03:47:14,668 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgctp1pt380h1kl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252034
        nanos: 140192000
      }
      modified_at {
        seconds: 1765252034
        nanos: 140192000
      }
      revision: 1
    }
    started_at {
      seconds: 1765252034
      nanos: 164000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgctp1psu8jgtjh-ptqudqgctp1pt380h1kl"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252034
      nanos: 140192000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 177
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 177
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 162
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 167
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 167
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: FlatMap, At lambda, At function: OptionalIf"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 177
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 177
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 162
            }
            message: "At function: Map, At lambda, At function: SafeCast"
            end_position {
              row: 5
              column: 162
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 5
                column: 162
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String?) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b,\\n\\x16:\\x14\\n\\b\\x12\\x06nested\\x12\\b\\xAA\\x06\\x05\\n\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (OptionalType $13))\n    (let $26 (CallableType \'() \'($23) \'($25)))\n    (let $27 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $26 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $27 (SafeCast (Member $22 \'\"nested\") $25)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200742)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:47:15,807 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00236*\014shard-000000\032\022\"\00237*\014shard-000000"
  }
}

2025-12-09 03:47:15,808 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:47:15,809 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:47:15,811 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.31
2025-12-09 03:47:15,811 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:47:15,812 - DEBUG - ya.test - execute: Command pid: 1747276
2025-12-09 03:47:19,426 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:47:19,426 - DEBUG - ya.test - _save_outputs: Command (pid 1747276) rc: 0
2025-12-09 03:47:19,427 - DEBUG - ya.test - _save_outputs: Command (pid 1747276) elapsed time (sec): 3.613891839981079
2025-12-09 03:47:19,427 - DEBUG - ya.test - _save_outputs: Command (pid 1747276) wtime: 3.615
2025-12-09 03:47:19,427 - DEBUG - ya.test - _save_outputs: Command (pid 1747276) output:
None
2025-12-09 03:47:19,427 - DEBUG - ya.test - _save_outputs: Command (pid 1747276) errors:
2025-12-09T03:47:15.831365Z :INFO: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Starting read session
2025-12-09T03:47:15.831414Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Starting session to cluster null (localhost:15610)
2025-12-09T03:47:15.831888Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:15.831903Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:15.831909Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:47:15.837021Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] Successfully connected. Initializing session
2025-12-09T03:47:15.838299Z :INFO: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] Server session id: test_filters_optional_field_consumer_1_65_15501496794924615648_v1
2025-12-09T03:47:15.838395Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:15.839611Z :INFO: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:47:16.832293Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:18
2025-12-09T03:47:16.832329Z :INFO: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:19.362919Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:19.362994Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (18-18)
2025-12-09T03:47:19.363028Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (18-18)
2025-12-09T03:47:19.363117Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] Commit offsets [18, 19). Partition stream id: 1
2025-12-09T03:47:19.363221Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:47:19.368246Z :DEBUG: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:47:19.368422Z :INFO: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Closing read session. Close timeout: 5.000000s
2025-12-09T03:47:19.368460Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:18:19
2025-12-09T03:47:19.368470Z :INFO: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3537 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:47:19.374180Z :NOTICE: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:47:19.374488Z :INFO: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Closing read session. Close timeout: 0.000000s
2025-12-09T03:47:19.374507Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:18:19
2025-12-09T03:47:19.374526Z :INFO: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3543 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:19.374537Z :NOTICE: [local] [local] [885b023-2c3c67ea-45cbb7bd-4e5df750] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:47:19,428 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:47:19,444 - DEBUG - root - control_query: Result: 
2025-12-09 03:47:19,452 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgctp1pt380h1kl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252034
        nanos: 140192000
      }
      modified_at {
        seconds: 1765252039
        nanos: 439499000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252034
      nanos: 164000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgctp1psu8jgtjh-ptqudqgctp1pt380h1kl"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252034
      nanos: 140192000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 177
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 177
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 162
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 167
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 167
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: FlatMap, At lambda, At function: OptionalIf"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 177
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 177
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 162
            }
            message: "At function: Map, At lambda, At function: SafeCast"
            end_position {
              row: 5
              column: 162
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 5
                column: 162
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String?) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b,\\n\\x16:\\x14\\n\\b\\x12\\x06nested\\x12\\b\\xAA\\x06\\x05\\n\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (OptionalType $13))\n    (let $26 (CallableType \'() \'($23) \'($25)))\n    (let $27 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $26 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $27 (SafeCast (Member $22 \'\"nested\") $25)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200742)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:47:19,961 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:20,469 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgctp1pt380h1kl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252034
        nanos: 140192000
      }
      modified_at {
        seconds: 1765252039
        nanos: 439499000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252034
      nanos: 164000000
    }
    finished_at {
      seconds: 1765252040
      nanos: 274000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgctp1psu8jgtjh-ptqudqgctp1pt380h1kl"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252034
      nanos: 140192000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 177
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 177
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 162
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 167
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 167
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: FlatMap, At lambda, At function: OptionalIf"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 177
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 177
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 162
            }
            message: "At function: Map, At lambda, At function: SafeCast"
            end_position {
              row: 5
              column: 162
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 5
                column: 162
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String?) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"98ms\",\"count\":1,\"avg\":\"98ms\",\"max\":\"98ms\",\"min\":\"98ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b,\\n\\x16:\\x14\\n\\b\\x12\\x06nested\\x12\\b\\xAA\\x06\\x05\\n\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (OptionalType $13))\n    (let $26 (CallableType \'() \'($23) \'($25)))\n    (let $27 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $26 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $27 (SafeCast (Member $22 \'\"nested\") $25)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200742)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-09 03:47:21,599 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:21,600 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "30f1c3f9-07f2-40de-872d-0fc908b0fd5a"

2025-12-09 03:47:21,618 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgcthtvjdqmrhdh"

2025-12-09 03:47:21,626 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcthtvjdqmrhdh"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252041
        nanos: 605463000
      }
      modified_at {
        seconds: 1765252041
        nanos: 605463000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcthtvijtinu4j-ptqudqgcthtvjdqmrhdh"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252041
      nanos: 605463000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
}

2025-12-09 03:47:22,135 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcthtvjdqmrhdh"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252041
        nanos: 605463000
      }
      modified_at {
        seconds: 1765252041
        nanos: 605463000
      }
      revision: 1
    }
    started_at {
      seconds: 1765252041
      nanos: 766000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgcthtvijtinu4j-ptqudqgcthtvjdqmrhdh"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252041
      nanos: 605463000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:23,287 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00238*\014shard-000000\032\022\"\00239*\014shard-000000"
  }
}

2025-12-09 03:47:23,287 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:47:23,288 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:47:23,289 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.32
2025-12-09 03:47:23,290 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:47:23,291 - DEBUG - ya.test - execute: Command pid: 1752930
2025-12-09 03:47:27,000 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:47:27,000 - DEBUG - ya.test - _save_outputs: Command (pid 1752930) rc: 0
2025-12-09 03:47:27,000 - DEBUG - ya.test - _save_outputs: Command (pid 1752930) elapsed time (sec): 3.708728790283203
2025-12-09 03:47:27,000 - DEBUG - ya.test - _save_outputs: Command (pid 1752930) wtime: 3.71
2025-12-09 03:47:27,001 - DEBUG - ya.test - _save_outputs: Command (pid 1752930) output:
None
2025-12-09 03:47:27,001 - DEBUG - ya.test - _save_outputs: Command (pid 1752930) errors:
2025-12-09T03:47:23.309092Z :INFO: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Starting read session
2025-12-09T03:47:23.309148Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Starting session to cluster null (localhost:15610)
2025-12-09T03:47:23.309544Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:23.309559Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:23.309565Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:47:23.314271Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] Successfully connected. Initializing session
2025-12-09T03:47:23.317057Z :INFO: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] Server session id: test_filters_optional_field_consumer_1_67_9816249793940535178_v1
2025-12-09T03:47:23.317153Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:23.321140Z :INFO: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:47:24.310215Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:19
2025-12-09T03:47:24.310254Z :INFO: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:26.916305Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:26.916385Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (19-19)
2025-12-09T03:47:26.916433Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (19-19)
2025-12-09T03:47:26.916556Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] Commit offsets [19, 20). Partition stream id: 1
2025-12-09T03:47:26.916664Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:47:26.919439Z :DEBUG: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:47:26.919594Z :INFO: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Closing read session. Close timeout: 5.000000s
2025-12-09T03:47:26.919617Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:19:20
2025-12-09T03:47:26.919627Z :INFO: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3610 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:47:26.919852Z :NOTICE: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:47:26.919963Z :INFO: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Closing read session. Close timeout: 0.000000s
2025-12-09T03:47:26.919973Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:19:20
2025-12-09T03:47:26.919993Z :INFO: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3610 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:26.920002Z :NOTICE: [local] [local] [d550d34a-6aa8343d-8ca2bb2-be755902] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:47:27,001 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:47:27,016 - DEBUG - root - control_query: Result: 
2025-12-09 03:47:27,023 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcthtvjdqmrhdh"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252041
        nanos: 605463000
      }
      modified_at {
        seconds: 1765252047
        nanos: 11499000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252041
      nanos: 766000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcthtvijtinu4j-ptqudqgcthtvjdqmrhdh"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252041
      nanos: 605463000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:27,531 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:28,038 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgcthtvjdqmrhdh"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252041
        nanos: 605463000
      }
      modified_at {
        seconds: 1765252047
        nanos: 11499000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252041
      nanos: 766000000
    }
    finished_at {
      seconds: 1765252047
      nanos: 873000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgcthtvijtinu4j-ptqudqgcthtvjdqmrhdh"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252041
      nanos: 605463000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"57ms\",\"count\":1,\"avg\":\"57ms\",\"max\":\"57ms\",\"min\":\"57ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:29,146 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:29,147 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "64ebdfa5-bcb2-423d-ac8b-0fbff30e5d0b"

2025-12-09 03:47:29,161 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgctanmpcvda08i"

2025-12-09 03:47:29,168 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgctanmpcvda08i"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252049
        nanos: 151124000
      }
      modified_at {
        seconds: 1765252049
        nanos: 151124000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgctanmp38s7vf6-ptqudqgctanmpcvda08i"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252049
      nanos: 151124000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
}

2025-12-09 03:47:29,677 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgctanmpcvda08i"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252049
        nanos: 151124000
      }
      modified_at {
        seconds: 1765252049
        nanos: 151124000
      }
      revision: 1
    }
    started_at {
      seconds: 1765252049
      nanos: 168000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgctanmp38s7vf6-ptqudqgctanmpcvda08i"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252049
      nanos: 151124000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:30,819 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00240*\014shard-000000\032\022\"\00241*\014shard-000000"
  }
}

2025-12-09 03:47:30,820 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:47:30,821 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:47:30,823 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.33
2025-12-09 03:47:30,823 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:47:30,824 - DEBUG - ya.test - execute: Command pid: 1756303
2025-12-09 03:47:34,330 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:47:34,330 - DEBUG - ya.test - _save_outputs: Command (pid 1756303) rc: 0
2025-12-09 03:47:34,332 - DEBUG - ya.test - _save_outputs: Command (pid 1756303) elapsed time (sec): 3.505856513977051
2025-12-09 03:47:34,332 - DEBUG - ya.test - _save_outputs: Command (pid 1756303) wtime: 3.507
2025-12-09 03:47:34,332 - DEBUG - ya.test - _save_outputs: Command (pid 1756303) output:
None
2025-12-09 03:47:34,334 - DEBUG - ya.test - _save_outputs: Command (pid 1756303) errors:
2025-12-09T03:47:30.842612Z :INFO: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Starting read session
2025-12-09T03:47:30.842680Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Starting session to cluster null (localhost:15610)
2025-12-09T03:47:30.843180Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:30.843195Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:30.843201Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:47:30.848180Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] Successfully connected. Initializing session
2025-12-09T03:47:30.849291Z :INFO: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] Server session id: test_filters_optional_field_consumer_1_69_17749410300445989707_v1
2025-12-09T03:47:30.849363Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:30.850796Z :INFO: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:47:31.843233Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:20
2025-12-09T03:47:31.843277Z :INFO: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:34.303304Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:34.304099Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (20-20)
2025-12-09T03:47:34.304151Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (20-20)
2025-12-09T03:47:34.304264Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] Commit offsets [20, 21). Partition stream id: 1
2025-12-09T03:47:34.304385Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:47:34.306983Z :DEBUG: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:47:34.307136Z :INFO: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Closing read session. Close timeout: 5.000000s
2025-12-09T03:47:34.307162Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:20:21
2025-12-09T03:47:34.307172Z :INFO: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3464 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:47:34.307384Z :NOTICE: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:47:34.307504Z :INFO: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Closing read session. Close timeout: 0.000000s
2025-12-09T03:47:34.307514Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:20:21
2025-12-09T03:47:34.307534Z :INFO: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3464 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:34.307544Z :NOTICE: [local] [local] [df8325cd-2429751e-ec66bcd7-3c06bdac] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:47:34,335 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:47:34,356 - DEBUG - root - control_query: Result: 
2025-12-09 03:47:34,368 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgctanmpcvda08i"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252049
        nanos: 151124000
      }
      modified_at {
        seconds: 1765252054
        nanos: 348840000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252049
      nanos: 168000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgctanmp38s7vf6-ptqudqgctanmpcvda08i"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252049
      nanos: 151124000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:34,878 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:35,385 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgctanmpcvda08i"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252049
        nanos: 151124000
      }
      modified_at {
        seconds: 1765252054
        nanos: 348840000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252049
      nanos: 168000000
    }
    finished_at {
      seconds: 1765252055
      nanos: 264000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgctanmp38s7vf6-ptqudqgctanmpcvda08i"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252049
      nanos: 151124000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"52ms\",\"count\":1,\"avg\":\"52ms\",\"max\":\"52ms\",\"min\":\"52ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:36,494 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:36,495 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "ea6c771c-a694-4fa8-ac50-c2711e789176"

2025-12-09 03:47:36,511 - DEBUG - root - create_query_impl: Result: query_id: "ptqudqgct3nej8r8abr3"

2025-12-09 03:47:36,521 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgct3nej8r8abr3"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252056
        nanos: 499546000
      }
      modified_at {
        seconds: 1765252056
        nanos: 499546000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudqgct3nej25rj2d3-ptqudqgct3nej8r8abr3"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765252056
      nanos: 499546000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
}

2025-12-09 03:47:37,030 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgct3nej8r8abr3"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252056
        nanos: 499546000
      }
      modified_at {
        seconds: 1765252056
        nanos: 499546000
      }
      revision: 1
    }
    started_at {
      seconds: 1765252056
      nanos: 774000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudqgct3nej25rj2d3-ptqudqgct3nej8r8abr3"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252056
      nanos: 499546000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:38,183 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00242*\014shard-000000\032\022\"\00243*\014shard-000000"
  }
}

2025-12-09 03:47:38,184 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-09 03:47:38,185 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read
2025-12-09 03:47:38,186 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.34
2025-12-09 03:47:38,187 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/av6y/0029d5/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:15610', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-09 03:47:38,188 - DEBUG - ya.test - execute: Command pid: 1760543
2025-12-09 03:47:40,714 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-09 03:47:40,715 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-09 03:47:40,720 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-09 03:47:40,720 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 07616a4f-26ff-4d6a-b64a-552faa47dc96, localhost:15610): creating call state
2025-12-09 03:47:40,721 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 07616a4f-26ff-4d6a-b64a-552faa47dc96, localhost:15610): request = { database: "local" }
2025-12-09 03:47:40,723 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 07616a4f-26ff-4d6a-b64a-552faa47dc96, localhost:15610): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-syjwtgwtdu.auto.internal" port: 15610 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-09 03:47:40,724 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-syjwtgwtdu.auto.internal:15610, location 1, ssl: False>]>
2025-12-09 03:47:40,724 - INFO - ydb.connection - close: Closing channel for endpoint localhost:15610
2025-12-09 03:47:41,994 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-09 03:47:41,995 - DEBUG - ya.test - _save_outputs: Command (pid 1760543) rc: 0
2025-12-09 03:47:41,995 - DEBUG - ya.test - _save_outputs: Command (pid 1760543) elapsed time (sec): 3.805750846862793
2025-12-09 03:47:41,995 - DEBUG - ya.test - _save_outputs: Command (pid 1760543) wtime: 3.807
2025-12-09 03:47:41,995 - DEBUG - ya.test - _save_outputs: Command (pid 1760543) output:
None
2025-12-09 03:47:41,995 - DEBUG - ya.test - _save_outputs: Command (pid 1760543) errors:
2025-12-09T03:47:38.207801Z :INFO: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Starting read session
2025-12-09T03:47:38.207840Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Starting session to cluster null (localhost:15610)
2025-12-09T03:47:38.208224Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:38.208237Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:38.208244Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] Reconnecting session to cluster null in 0.000000s
2025-12-09T03:47:38.213299Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] Successfully connected. Initializing session
2025-12-09T03:47:38.214423Z :INFO: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] Server session id: test_filters_optional_field_consumer_1_71_10179569815379930968_v1
2025-12-09T03:47:38.214510Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:38.216276Z :INFO: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-09T03:47:39.209262Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:21
2025-12-09T03:47:39.209299Z :INFO: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:41.935048Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-09T03:47:41.935125Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (21-21)
2025-12-09T03:47:41.935176Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (21-21)
2025-12-09T03:47:41.935289Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] Commit offsets [21, 22). Partition stream id: 1
2025-12-09T03:47:41.935399Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-09T03:47:41.938228Z :DEBUG: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-09T03:47:41.938387Z :INFO: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Closing read session. Close timeout: 5.000000s
2025-12-09T03:47:41.938425Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:21:22
2025-12-09T03:47:41.938436Z :INFO: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3730 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-09T03:47:41.938664Z :NOTICE: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-09T03:47:41.938806Z :INFO: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Closing read session. Close timeout: 0.000000s
2025-12-09T03:47:41.938817Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:21:22
2025-12-09T03:47:41.938854Z :INFO: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3731 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-09T03:47:41.938865Z :NOTICE: [local] [local] [e0be045f-869a7711-a8fa5d9a-6ef8dbf4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-09 03:47:41,996 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-09 03:47:42,011 - DEBUG - root - control_query: Result: 
2025-12-09 03:47:42,018 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgct3nej8r8abr3"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252056
        nanos: 499546000
      }
      modified_at {
        seconds: 1765252062
        nanos: 6585000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252056
      nanos: 774000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgct3nej25rj2d3-ptqudqgct3nej8r8abr3"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252056
      nanos: 499546000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:42,527 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:43,035 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudqgct3nej8r8abr3"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765252056
        nanos: 499546000
      }
      modified_at {
        seconds: 1765252062
        nanos: 6585000
      }
      revision: 2
    }
    started_at {
      seconds: 1765252056
      nanos: 774000000
    }
    finished_at {
      seconds: 1765252062
      nanos: 885000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudqgct3nej25rj2d3-ptqudqgct3nej8r8abr3"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765252056
      nanos: 499546000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"63ms\",\"count\":1,\"avg\":\"63ms\",\"max\":\"63ms\",\"min\":\"63ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:15610\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudqgd22g5p1a07lgd\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-09 03:47:44,144 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-09 03:47:44,147 - INFO - ya.test - pytest_runtest_teardown: Test teardown
2025-12-09 03:47:51,149 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:15993/1
2025-12-09 03:47:51,150 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/61371
2025-12-09 03:47:51,150 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/2185
2025-12-09 03:47:51,150 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/16454
2025-12-09 03:47:51,151 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/15993
2025-12-09 03:47:51,151 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/26869
2025-12-09 03:47:51,151 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/21175
2025-12-09 03:47:52,152 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:29504/1
2025-12-09 03:47:52,153 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:29361/2
2025-12-09 03:47:52,153 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:61131/3
2025-12-09 03:47:52,155 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/61002
2025-12-09 03:47:52,155 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/7546
2025-12-09 03:47:52,155 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/17033
2025-12-09 03:47:52,156 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/61131
2025-12-09 03:47:52,156 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/25810
2025-12-09 03:47:52,156 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/27612
2025-12-09 03:47:52,156 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/62203
2025-12-09 03:47:52,156 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/29361
2025-12-09 03:47:52,157 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/63604
2025-12-09 03:47:52,157 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/17268
2025-12-09 03:47:52,157 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/22481
2025-12-09 03:47:52,157 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/29504
2025-12-09 03:47:52,157 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/1317
2025-12-09 03:47:52,157 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/26543
2025-12-09 03:47:52,158 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/32259
