2025-12-12 12:37:34,462 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-12 12:37:34,468 - INFO - ya.test - pytest_runtest_setup: test_filters_optional_field
2025-12-12 12:37:34,475 - INFO - ya.test - pytest_runtest_setup: ####################################################################################################
2025-12-12 12:37:34,475 - INFO - ya.test - pytest_runtest_setup: Test setup
2025-12-12 12:37:34,476 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16797
2025-12-12 12:37:34,478 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/2763
2025-12-12 12:37:34,560 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:37:34,561 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/3637
2025-12-12 12:37:34,628 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:37:34,629 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/25468
2025-12-12 12:37:34,629 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/5913
2025-12-12 12:37:34,629 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/22604
2025-12-12 12:37:34,630 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16122
2025-12-12 12:37:34,634 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:37:34,649 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-12 12:37:34,651 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:37:34,699 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-12 12:37:34,700 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, b168d992-480d-4276-ba93-3d14a15834f3, localhost:63390): creating call state
2025-12-12 12:37:34,700 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, b168d992-480d-4276-ba93-3d14a15834f3, localhost:63390): request = { database: "local" }
2025-12-12 12:37:34,713 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, b168d992-480d-4276-ba93-3d14a15834f3, localhost:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-fhkyrtz6p4.auto.internal" port: 63390 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-12 12:37:34,713 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-fhkyrtz6p4.auto.internal:63390, location 1, ssl: False>]>
2025-12-12 12:37:34,714 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:37:34,727 - INFO - ydb.connection - close: Closing channel for endpoint localhost:63390
2025-12-12 12:37:34,728 - DEBUG - ydb.table.SessionPool - subscribe: Active session queue is empty, subscribe waiter for a session
2025-12-12 12:37:34,743 - DEBUG - ydb.table.SessionPool - subscribe: Subscribe waiter <Future at 0x7fcaa2189e10 state=pending>
2025-12-12 12:37:34,743 - DEBUG - ydb.table.SessionPool - subscribe: Session pool is not large enough (active_count < size: 0 < 1). will create a new session.
2025-12-12 12:37:34,745 - DEBUG - ydb.table.SessionPool - _create: Created session <ydb.table.Session object at 0x7fcaa21886a0>
2025-12-12 12:37:34,763 - DEBUG - ydb.table.SessionPool - _prepare: Preparing session <ydb.table.Session object at 0x7fcaa21886a0>
2025-12-12 12:37:34,764 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateSession, 9e25cc7c-9329-419a-be0c-e2d9fe0abdb4, ghrun-fhkyrtz6p4.auto.internal:63390): creating call state
2025-12-12 12:37:34,771 - DEBUG - ydb.connection - _log_request: RpcState(CreateSession, 9e25cc7c-9329-419a-be0c-e2d9fe0abdb4, ghrun-fhkyrtz6p4.auto.internal:63390): request = { operation_params { operation_timeout { seconds: 3 } cancel_after { seconds: 3 } } }
2025-12-12 12:37:34,789 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 9e25cc7c-9329-419a-be0c-e2d9fe0abdb4, ghrun-fhkyrtz6p4.auto.internal:63390): on response callback started
2025-12-12 12:37:34,790 - DEBUG - ydb.connection - _log_response: RpcState(CreateSession, 9e25cc7c-9329-419a-be0c-e2d9fe0abdb4, ghrun-fhkyrtz6p4.auto.internal:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.CreateSessionResult] { session_id: "ydb://session/3?node_id=1&id=ZjY2MmE1NWQtMzExMDhiMjYtODg3OTI5MjAtYzRiYmRmNmQ=" } } } }
2025-12-12 12:37:34,790 - DEBUG - ydb.connection - _on_response_callback: RpcState(CreateSession, 9e25cc7c-9329-419a-be0c-e2d9fe0abdb4, ghrun-fhkyrtz6p4.auto.internal:63390): on response callback success
2025-12-12 12:37:34,790 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7fcaa21886a0>
2025-12-12 12:37:34,790 - DEBUG - ydb.table.SessionPool - put: Replying to waiter with a session <ydb.table.Session object at 0x7fcaa21886a0>
2025-12-12 12:37:34,791 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 33033f0c-fbe1-44cf-94b9-d7ef285a22dc, ghrun-fhkyrtz6p4.auto.internal:63390): creating call state
2025-12-12 12:37:34,791 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 33033f0c-fbe1-44cf-94b9-d7ef285a22dc, ghrun-fhkyrtz6p4.auto.internal:63390): request = { session_id: "ydb://session/3?node_id=1&id=ZjY2MmE1NWQtMzExMDhiMjYtODg3OTI5MjAtYzRiYmRmNmQ=" path: "local/DbPoolStorage_e3398e4f-97bc-4017-a6d5-261cc4497ee4/tenants" columns { name: "tenant" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "common" type { optional_type { item { type_id: BOOL } } } } columns { name: "state" type { optional_type { item { type_id: UINT32 } } } } columns { name: "state_time" type { optional_type { item { type_id: TIMESTAMP } } } } primary_key: "tenant" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-12 12:37:34,842 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 33033f0c-fbe1-44cf-94b9-d7ef285a22dc, ghrun-fhkyrtz6p4.auto.internal:63390): response = { operation { ready: true status: SUCCESS } }
2025-12-12 12:37:34,856 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7fcaa21886a0>
2025-12-12 12:37:34,857 - DEBUG - ydb.connection - _prepare_call: RpcState(CreateTable, 21fc9f86-8d5d-4c85-8136-66f61e132b2c, ghrun-fhkyrtz6p4.auto.internal:63390): creating call state
2025-12-12 12:37:34,858 - DEBUG - ydb.connection - _log_request: RpcState(CreateTable, 21fc9f86-8d5d-4c85-8136-66f61e132b2c, ghrun-fhkyrtz6p4.auto.internal:63390): request = { session_id: "ydb://session/3?node_id=1&id=ZjY2MmE1NWQtMzExMDhiMjYtODg3OTI5MjAtYzRiYmRmNmQ=" path: "local/DbPoolStorage_e3398e4f-97bc-4017-a6d5-261cc4497ee4/mappings" columns { name: "subject_type" type { optional_type { item { type_id: STRING } } } } columns { name: "subject_id" type { optional_type { item { type_id: STRING } } } } columns { name: "vtenant" type { optional_type { item { type_id: STRING } } } } columns { name: "node" type { optional_type { item { type_id: STRING } } } } primary_key: "subject_type" primary_key: "subject_id" operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-12 12:37:34,896 - DEBUG - ydb.connection - _log_response: RpcState(CreateTable, 21fc9f86-8d5d-4c85-8136-66f61e132b2c, ghrun-fhkyrtz6p4.auto.internal:63390): response = { operation { ready: true status: SUCCESS } }
2025-12-12 12:37:34,906 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7fcaa21886a0>
2025-12-12 12:37:34,907 - DEBUG - ydb.connection - _prepare_call: RpcState(ExecuteDataQuery, 8f3369da-7928-414b-8639-1cf90fe1a80e, ghrun-fhkyrtz6p4.auto.internal:63390): creating call state
2025-12-12 12:37:34,908 - DEBUG - ydb.connection - _log_request: RpcState(ExecuteDataQuery, 8f3369da-7928-414b-8639-1cf90fe1a80e, ghrun-fhkyrtz6p4.auto.internal:63390): request = { session_id: "ydb://session/3?node_id=1&id=ZjY2MmE1NWQtMzExMDhiMjYtODg3OTI5MjAtYzRiYmRmNmQ=" tx_control { begin_tx { serializable_read_write { } } commit_tx: true } query { yql_text: "--!syntax_v1\n            PRAGMA TablePathPrefix(\"local/DbPoolStorage_e3398e4f-97bc-4017-a6d5-261cc4497ee4\");\n            UPSERT INTO tenants (tenant, vtenant, common, state, state_time) values(\"/compute\", \"/compute\", true, 0, CurrentUtcTimestamp());\n                " } operation_params { operation_timeout { seconds: 600 } cancel_after { seconds: 600 } } }
2025-12-12 12:37:34,947 - DEBUG - ydb.connection - _log_response: RpcState(ExecuteDataQuery, 8f3369da-7928-414b-8639-1cf90fe1a80e, ghrun-fhkyrtz6p4.auto.internal:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Table.ExecuteQueryResult] { tx_meta { } } } } }
2025-12-12 12:37:34,950 - DEBUG - ydb.table.SessionPool - put: Put on session <ydb.table.Session object at 0x7fcaa21886a0>
2025-12-12 12:37:35,143 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:37:35,152 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/17320
2025-12-12 12:37:35,152 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/7970
2025-12-12 12:37:35,152 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/19168
2025-12-12 12:37:35,153 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/kikimr_configs"
2025-12-12 12:37:35,153 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/node_1/logfile_q8qt_0_w.log --grpc-port=16122 --mon-port=17320 --ic-port=3637
2025-12-12 12:37:35,154 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/kikimr_configs"
2025-12-12 12:37:35,154 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/cp --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/node_1/logfile_q8qt_0_w.log --grpc-port=16122 --mon-port=17320 --ic-port=3637
2025-12-12 12:37:35,159 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/kikimr_configs/config.yaml', '--node=1', '--tenant=/cp', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/node_1/logfile_q8qt_0_w.log', '--grpc-port=16122', '--mon-port=17320', '--ic-port=3637')' in '/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/cp/node_1' (no wait)
2025-12-12 12:37:35,175 - DEBUG - ya.test - execute: Command pid: 1607297
2025-12-12 12:37:35,177 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:16122/1
2025-12-12 12:37:35,178 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.3
2025-12-12 12:37:35,179 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.3
2025-12-12 12:37:35,181 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-12 12:37:35,184 - DEBUG - ya.test - execute: Command pid: 1607300
2025-12-12 12:37:35,712 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) rc: 0
2025-12-12 12:37:35,712 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) elapsed time (sec): 0.5101470947265625
2025-12-12 12:37:35,713 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) idrss: 0
2025-12-12 12:37:35,713 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) inblock: 0
2025-12-12 12:37:35,713 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) isrss: 0
2025-12-12 12:37:35,713 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) ixrss: 0
2025-12-12 12:37:35,713 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) majflt: 0
2025-12-12 12:37:35,713 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) maxrss: 544132
2025-12-12 12:37:35,713 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) minflt: 16225
2025-12-12 12:37:35,714 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) msgrcv: 0
2025-12-12 12:37:35,714 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) msgsnd: 0
2025-12-12 12:37:35,714 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) nivcsw: 113
2025-12-12 12:37:35,714 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) nsignals: 0
2025-12-12 12:37:35,714 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) nswap: 0
2025-12-12 12:37:35,714 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) nvcsw: 13
2025-12-12 12:37:35,714 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) oublock: 8
2025-12-12 12:37:35,715 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) stime: 0.24475799999999998
2025-12-12 12:37:35,715 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) utime: 0.09777899999999999
2025-12-12 12:37:35,715 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) wtime: 0.514
2025-12-12 12:37:35,715 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) output:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-fhkyrtz6p4
    Host information: 
        Linux ghrun-fhkyrtz6p4 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-12 12:37:35,715 - DEBUG - ya.test - _save_outputs: Command (pid 1607300) errors:

2025-12-12 12:37:35,716 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd
2025-12-12 12:37:35,716 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-12-12 12:37:35,833 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:37:35,833 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/22059
2025-12-12 12:37:35,834 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/25152
2025-12-12 12:37:35,834 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/24339
2025-12-12 12:37:35,834 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/65203
2025-12-12 12:37:35,835 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-12 12:37:35,835 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_1/logfile_tbu3re94.log --grpc-port=22059 --mon-port=25152 --ic-port=25468
2025-12-12 12:37:35,835 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:37:35,836 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/16856
2025-12-12 12:37:35,836 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/2592
2025-12-12 12:37:35,836 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/18555
2025-12-12 12:37:35,837 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/21538
2025-12-12 12:37:35,837 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-12 12:37:35,838 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=2 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_2/logfile_qiuijz9f.log --grpc-port=16856 --mon-port=2592 --ic-port=5913
2025-12-12 12:37:35,838 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd
2025-12-12 12:37:35,838 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/24055
2025-12-12 12:37:35,851 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/22476
2025-12-12 12:37:35,856 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/2624
2025-12-12 12:37:35,857 - DEBUG - library.python.filelock - acquire: Acquiring FileLock (blocking=False): /home/runner/.ya/build/port_sync_dir/7571
2025-12-12 12:37:35,857 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-12 12:37:35,857 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=3 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_3/logfile_lnen14y2.log --grpc-port=24055 --mon-port=22476 --ic-port=22604
2025-12-12 12:37:35,858 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-12 12:37:35,858 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=1 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_1/logfile_tbu3re94.log --grpc-port=22059 --mon-port=25152 --ic-port=25468
2025-12-12 12:37:35,859 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs/config.yaml', '--node=1', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_1/logfile_tbu3re94.log', '--grpc-port=22059', '--mon-port=25152', '--ic-port=25468')' in '/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_1' (no wait)
2025-12-12 12:37:35,877 - DEBUG - ya.test - execute: Command pid: 1608004
2025-12-12 12:37:35,877 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:22059/1
2025-12-12 12:37:35,878 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.4
2025-12-12 12:37:35,879 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.4
2025-12-12 12:37:35,879 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-12 12:37:35,889 - DEBUG - ya.test - execute: Command pid: 1608033
2025-12-12 12:37:36,746 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) rc: 0
2025-12-12 12:37:36,746 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) elapsed time (sec): 0.8554399013519287
2025-12-12 12:37:36,747 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) idrss: 0
2025-12-12 12:37:36,747 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) inblock: 0
2025-12-12 12:37:36,747 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) isrss: 0
2025-12-12 12:37:36,747 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) ixrss: 0
2025-12-12 12:37:36,747 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) majflt: 0
2025-12-12 12:37:36,747 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) maxrss: 544132
2025-12-12 12:37:36,747 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) minflt: 16227
2025-12-12 12:37:36,747 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) msgrcv: 0
2025-12-12 12:37:36,748 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) msgsnd: 0
2025-12-12 12:37:36,748 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) nivcsw: 84
2025-12-12 12:37:36,748 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) nsignals: 0
2025-12-12 12:37:36,748 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) nswap: 0
2025-12-12 12:37:36,748 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) nvcsw: 13
2025-12-12 12:37:36,748 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) oublock: 8
2025-12-12 12:37:36,748 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) stime: 0.22664099999999998
2025-12-12 12:37:36,748 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) utime: 0.11533299999999999
2025-12-12 12:37:36,749 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) wtime: 0.867
2025-12-12 12:37:36,749 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) output:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-fhkyrtz6p4
    Host information: 
        Linux ghrun-fhkyrtz6p4 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-12 12:37:36,749 - DEBUG - ya.test - _save_outputs: Command (pid 1608033) errors:

2025-12-12 12:37:36,749 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 1 version:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd
2025-12-12 12:37:36,756 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-12 12:37:36,763 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=2 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_2/logfile_qiuijz9f.log --grpc-port=16856 --mon-port=2592 --ic-port=5913
2025-12-12 12:37:36,773 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs/config.yaml', '--node=2', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_2/logfile_qiuijz9f.log', '--grpc-port=16856', '--mon-port=2592', '--ic-port=5913')' in '/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_2' (no wait)
2025-12-12 12:37:36,778 - DEBUG - ya.test - execute: Command pid: 1609090
2025-12-12 12:37:36,779 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:16856/2
2025-12-12 12:37:36,779 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.5
2025-12-12 12:37:36,780 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.5
2025-12-12 12:37:36,780 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-12 12:37:36,801 - DEBUG - ya.test - execute: Command pid: 1609098
2025-12-12 12:37:37,663 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) rc: 0
2025-12-12 12:37:37,663 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) elapsed time (sec): 0.855757474899292
2025-12-12 12:37:37,664 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) idrss: 0
2025-12-12 12:37:37,664 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) inblock: 0
2025-12-12 12:37:37,664 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) isrss: 0
2025-12-12 12:37:37,664 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) ixrss: 0
2025-12-12 12:37:37,664 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) majflt: 0
2025-12-12 12:37:37,664 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) maxrss: 544132
2025-12-12 12:37:37,664 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) minflt: 16226
2025-12-12 12:37:37,665 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) msgrcv: 0
2025-12-12 12:37:37,667 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) msgsnd: 0
2025-12-12 12:37:37,673 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) nivcsw: 120
2025-12-12 12:37:37,673 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) nsignals: 0
2025-12-12 12:37:37,673 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) nswap: 0
2025-12-12 12:37:37,674 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) nvcsw: 14
2025-12-12 12:37:37,674 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) oublock: 8
2025-12-12 12:37:37,674 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) stime: 0.245048
2025-12-12 12:37:37,674 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) utime: 0.10042899999999999
2025-12-12 12:37:37,674 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) wtime: 0.883
2025-12-12 12:37:37,675 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) output:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-fhkyrtz6p4
    Host information: 
        Linux ghrun-fhkyrtz6p4 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-12 12:37:37,675 - DEBUG - ya.test - _save_outputs: Command (pid 1609098) errors:

2025-12-12 12:37:37,675 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 2 version:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd
2025-12-12 12:37:37,675 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: CFG_DIR_PATH="/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs"
2025-12-12 12:37:37,676 - INFO - ydb.tests.library.harness.kikimr_runner - __make_run_command: Final command: /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd server --suppress-version-check --yaml-config=$CFG_DIR_PATH/config.yaml --node=3 --tenant=/compute --node-kind=yq --log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_3/logfile_lnen14y2.log --grpc-port=24055 --mon-port=22476 --ic-port=22604
2025-12-12 12:37:37,679 - DEBUG - ya.test - execute: Executing '('/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', 'server', '--suppress-version-check', '--yaml-config=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/kikimr_configs/config.yaml', '--node=3', '--tenant=/compute', '--node-kind=yq', '--log-file-name=/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_3/logfile_lnen14y2.log', '--grpc-port=24055', '--mon-port=22476', '--ic-port=22604')' in '/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/fq/yds/test-results/py3test/testing_out_stuff/chunk19/testing_out_stuff/test_row_dispatcher.py.TestPqRowDispatcher.test_filters_optional_field/compute/node_3' (no wait)
2025-12-12 12:37:37,690 - DEBUG - ya.test - execute: Command pid: 1610014
2025-12-12 12:37:37,691 - INFO - ydb.tests.library.harness.kikimr_runner - start: Started node localhost:24055/3
2025-12-12 12:37:37,708 - DEBUG - ya.test - _get_command_output_file: Command out will be placed to ydbd.out.6
2025-12-12 12:37:37,719 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to ydbd.err.6
2025-12-12 12:37:37,719 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/apps/ydbd/ydbd', '-V']' in 'None' (waiting)
2025-12-12 12:37:37,731 - DEBUG - ya.test - execute: Command pid: 1610052
2025-12-12 12:37:38,299 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) rc: 0
2025-12-12 12:37:38,301 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) elapsed time (sec): 0.5073723793029785
2025-12-12 12:37:38,301 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) idrss: 0
2025-12-12 12:37:38,301 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) inblock: 0
2025-12-12 12:37:38,301 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) isrss: 0
2025-12-12 12:37:38,301 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) ixrss: 0
2025-12-12 12:37:38,301 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) majflt: 0
2025-12-12 12:37:38,302 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) maxrss: 544132
2025-12-12 12:37:38,302 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) minflt: 16228
2025-12-12 12:37:38,302 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) msgrcv: 0
2025-12-12 12:37:38,302 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) msgsnd: 0
2025-12-12 12:37:38,302 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) nivcsw: 146
2025-12-12 12:37:38,302 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) nsignals: 0
2025-12-12 12:37:38,302 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) nswap: 0
2025-12-12 12:37:38,303 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) nvcsw: 13
2025-12-12 12:37:38,303 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) oublock: 8
2025-12-12 12:37:38,303 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) stime: 0.239109
2025-12-12 12:37:38,303 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) utime: 0.107599
2025-12-12 12:37:38,303 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) wtime: 0.512
2025-12-12 12:37:38,303 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) output:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd

Other info:
    Build by: runner
    Top src dir: /home/runner/actions_runner/_work/ydb/ydb
    Top build dir: /home/runner/.ya/build
    Hostname: ghrun-fhkyrtz6p4
    Host information: 
        Linux ghrun-fhkyrtz6p4 5.15.0-157-generic #167-Ubuntu SMP Wed Sep 17 21:35:53 UTC 2025 x86_64

    
Build info:
    Compiler: /home/runner/.ya/tools/v4/9695656278/bin/clang++
    Compiler version: 
        clang version 20.1.2
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /home/runner/.ya/tools/v4/9695656278/bin
    Compile flags: -Xclang -fdebug-compilation-dir -Xclang /tmp -pipe -m64 -O3 -gline-tables-only -fno-common -ffunction-sections -fdata-sections -fsized-deallocation -fexceptions -fuse-init-array -fcolor-diagnostics -faligned-allocation -Werror -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -D__LONG_LONG_SUPPORTED -fno-omit-frame-pointer -Wno-unknown-argument -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -UNDEBUG -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -Wno-deprecated-this-capture -Wno-missing-designated-field-initializers -Wno-format -Wno-vla-cxx-extension -Wno-invalid-offsetof -Wno-deprecated-literal-operator -Wno-unused-but-set-variable -Wno-unused-private-field -Wno-alias-template-in-declaration-name -Wno-cast-function-type-mismatch -Wno-explicit-specialization-storage-class -Wno-extraneous-template-head -Wno-missing-template-arg-list-after-template-kw -Wno-nontrivial-memcall -Wno-strict-primary-template-shadow -std=c++20 -Wimport-preprocessor-directive-pedantic -Woverloaded-virtual -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

2025-12-12 12:37:38,304 - DEBUG - ya.test - _save_outputs: Command (pid 1610052) errors:

2025-12-12 12:37:38,304 - INFO - ydb.tests.library.harness.kikimr_runner - start: Node 3 version:
Git info:
    Commit: 88a034dc314301cb1522a933e690a4c49a7591e8
    Branch: 
    Author: Pisarenko Grigoriy <grigoriypisar@ydb.tech>
    Summary: Merge d62cc36f2a67bf2623cab6896138afad639d0fda into fb388c48b29255ca141e58bbb8dfa4a39842f4bd
2025-12-12 12:37:38,304 - INFO - ydb.tests.library.harness.kikimr_runner - __run: Cluster started and initialized
2025-12-12 12:37:38,442 - INFO - ya.test - pytest_runtest_call: Test call (class_name: test_row_dispatcher.py::TestPqRowDispatcher, test_name: test_filters_optional_field)
2025-12-12 12:37:39,286 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/test_filters_optional_field_input"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-12-12 12:37:39,327 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-12 12:37:39,327 - DEBUG - root - _get_and_check_result: Result: 
2025-12-12 12:37:39,329 - DEBUG - root - create_stream: Requesting CreateStream.
Database: "local".
Request:
stream_name: "/local/test_filters_optional_field_output"
shard_count: 1
write_quota_kb_per_sec: 1024
retention_period_hours: 1

2025-12-12 12:37:39,382 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-12 12:37:39,382 - DEBUG - root - _get_and_check_result: Result: 
2025-12-12 12:37:39,406 - DEBUG - root - _get_and_check_result: Response: operation {
  ready: true
  status: SUCCESS
}

2025-12-12 12:37:39,406 - DEBUG - root - _get_and_check_result: Result: 
2025-12-12 12:37:39,407 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "0bd7af2b-2f25-4444-974f-8c7b365c0f63"

2025-12-12 12:37:39,688 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tshmjkhu0ltqe"

2025-12-12 12:37:39,824 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tshmjkhu0ltqe"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543059
        nanos: 435816000
      }
      modified_at {
        seconds: 1765543059
        nanos: 435816000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tshmjkd59u87g-ptqudq7tshmjkhu0ltqe"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543059
      nanos: 435816000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
}

2025-12-12 12:37:40,369 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tshmjkhu0ltqe"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543059
        nanos: 435816000
      }
      modified_at {
        seconds: 1765543059
        nanos: 435816000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543059
      nanos: 904000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tshmjkd59u87g-ptqudq7tshmjkhu0ltqe"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543059
      nanos: 435816000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
}

2025-12-12 12:37:43,719 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0010*\014shard-000000\032\021\"\0011*\014shard-000000"
  }
}

2025-12-12 12:37:43,720 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:37:43,729 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:37:43,764 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.13
2025-12-12 12:37:43,764 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:37:43,771 - DEBUG - ya.test - execute: Command pid: 1616476
2025-12-12 12:37:48,843 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:37:48,844 - DEBUG - ya.test - _save_outputs: Command (pid 1616476) rc: 0
2025-12-12 12:37:48,844 - DEBUG - ya.test - _save_outputs: Command (pid 1616476) elapsed time (sec): 5.072621583938599
2025-12-12 12:37:48,844 - DEBUG - ya.test - _save_outputs: Command (pid 1616476) wtime: 5.079
2025-12-12 12:37:48,845 - DEBUG - ya.test - _save_outputs: Command (pid 1616476) output:
None
2025-12-12 12:37:48,845 - DEBUG - ya.test - _save_outputs: Command (pid 1616476) errors:
2025-12-12T12:37:43.808286Z :INFO: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Starting read session
2025-12-12T12:37:43.808326Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Starting session to cluster null (localhost:63390)
2025-12-12T12:37:43.808758Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:37:43.808767Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:37:43.808772Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:37:43.817116Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] Successfully connected. Initializing session
2025-12-12T12:37:43.838460Z :INFO: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] Server session id: test_filters_optional_field_consumer_1_29_13660404180471115363_v1
2025-12-12T12:37:43.844356Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:37:43.855125Z :INFO: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:37:44.820795Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:0
2025-12-12T12:37:44.820832Z :INFO: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1012 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:37:48.728250Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:37:48.731035Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-12-12T12:37:48.731085Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-12-12T12:37:48.731222Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] Commit offsets [0, 1). Partition stream id: 1
2025-12-12T12:37:48.731328Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:37:48.750237Z :DEBUG: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:37:48.750402Z :INFO: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Closing read session. Close timeout: 5.000000s
2025-12-12T12:37:48.750455Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:1
2025-12-12T12:37:48.750465Z :INFO: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4942 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:37:48.755049Z :NOTICE: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:37:48.755440Z :INFO: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Closing read session. Close timeout: 0.000000s
2025-12-12T12:37:48.755453Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:1
2025-12-12T12:37:48.755474Z :INFO: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4947 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:37:48.755484Z :NOTICE: [local] [local] [4728ddec-3900a890-cc540fa5-9fb8a981] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:37:48,846 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:37:49,251 - DEBUG - root - control_query: Result: 
2025-12-12 12:37:49,275 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tshmjkhu0ltqe"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543059
        nanos: 435816000
      }
      modified_at {
        seconds: 1765543069
        nanos: 139231000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543059
      nanos: 904000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tshmjkd59u87g-ptqudq7tshmjkhu0ltqe"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543059
      nanos: 435816000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.15s\",\"count\":1,\"avg\":\"0.15s\",\"max\":\"0.15s\",\"min\":\"0.15s\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"data\") (String \'\"hello2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200693)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:37:49,807 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:37:50,332 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tshmjkhu0ltqe"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543059
        nanos: 435816000
      }
      modified_at {
        seconds: 1765543069
        nanos: 139231000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543059
      nanos: 904000000
    }
    finished_at {
      seconds: 1765543069
      nanos: 545000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tshmjkd59u87g-ptqudq7tshmjkhu0ltqe"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543059
      nanos: 435816000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE data = \"hello2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`data` = \"hello2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.15s\",\"count\":1,\"avg\":\"0.15s\",\"max\":\"0.15s\",\"min\":\"0.15s\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"data\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"data\" \'\"time\") $10 $11 \'\"B\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"data\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"data\") (String \'\"hello2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200693)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:37:50,390 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:37:50,398 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "d364af72-252d-450f-ad64-c021675eabe3"

2025-12-12 12:37:50,460 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7ts77dlg6d0h91"

2025-12-12 12:37:50,496 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ts77dlg6d0h91"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543070
        nanos: 419217000
      }
      modified_at {
        seconds: 1765543070
        nanos: 419217000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7ts77dlcs36oad-ptqudq7ts77dlg6d0h91"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543070
      nanos: 419217000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
    syntax: YQL_V1
  }
}

2025-12-12 12:37:51,023 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ts77dlg6d0h91"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543070
        nanos: 419217000
      }
      modified_at {
        seconds: 1765543070
        nanos: 419217000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543070
      nanos: 731000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7ts77dlcs36oad-ptqudq7ts77dlg6d0h91"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543070
      nanos: 419217000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: `flag`"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"flag\" (OptionalType (DataType \'Bool))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"flag\" \'\"time\") $9 $10 \'\"J\\b\\n\\x06\\x12\\x04flag\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"flag\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (Member $21 \'\"flag\") (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $12)))))))\n))) \'(\'(\'\"_logical_id\" \'200670)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:37:52,774 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0012*\014shard-000000\032\021\"\0013*\014shard-000000"
  }
}

2025-12-12 12:37:52,775 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:37:52,775 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:37:52,777 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.14
2025-12-12 12:37:52,777 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:37:52,779 - DEBUG - ya.test - execute: Command pid: 1626373
2025-12-12 12:37:56,927 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:37:56,927 - DEBUG - ya.test - _save_outputs: Command (pid 1626373) rc: 0
2025-12-12 12:37:56,927 - DEBUG - ya.test - _save_outputs: Command (pid 1626373) elapsed time (sec): 4.148041486740112
2025-12-12 12:37:56,928 - DEBUG - ya.test - _save_outputs: Command (pid 1626373) wtime: 4.149
2025-12-12 12:37:56,928 - DEBUG - ya.test - _save_outputs: Command (pid 1626373) output:
None
2025-12-12 12:37:56,928 - DEBUG - ya.test - _save_outputs: Command (pid 1626373) errors:
2025-12-12T12:37:52.796910Z :INFO: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Starting read session
2025-12-12T12:37:52.796957Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Starting session to cluster null (localhost:63390)
2025-12-12T12:37:52.797386Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:37:52.797725Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:37:52.797733Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:37:52.802481Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] Successfully connected. Initializing session
2025-12-12T12:37:52.803376Z :INFO: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] Server session id: test_filters_optional_field_consumer_1_31_6594457484942876474_v1
2025-12-12T12:37:52.803467Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:37:52.804657Z :INFO: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:37:53.799093Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:1
2025-12-12T12:37:53.802498Z :INFO: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1002 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:37:56.801762Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:37:56.810685Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-12-12T12:37:56.810734Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-12-12T12:37:56.810862Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] Commit offsets [1, 2). Partition stream id: 1
2025-12-12T12:37:56.810987Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:37:56.824770Z :DEBUG: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:37:56.824923Z :INFO: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Closing read session. Close timeout: 5.000000s
2025-12-12T12:37:56.824951Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:1:2
2025-12-12T12:37:56.824963Z :INFO: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4028 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:37:56.825186Z :NOTICE: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:37:56.825461Z :INFO: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Closing read session. Close timeout: 0.000000s
2025-12-12T12:37:56.825472Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:1:2
2025-12-12T12:37:56.825494Z :INFO: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4028 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:37:56.825503Z :NOTICE: [local] [local] [707ed550-dd2bdc81-3bbc8232-f01f5f92] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:37:56,928 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:37:57,006 - DEBUG - root - control_query: Result: 
2025-12-12 12:37:57,025 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ts77dlg6d0h91"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543070
        nanos: 419217000
      }
      modified_at {
        seconds: 1765543076
        nanos: 983825000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543070
      nanos: 731000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7ts77dlcs36oad-ptqudq7ts77dlg6d0h91"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543070
      nanos: 419217000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: `flag`"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"flag\" (OptionalType (DataType \'Bool))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"flag\" \'\"time\") $9 $10 \'\"J\\b\\n\\x06\\x12\\x04flag\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"flag\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (Member $21 \'\"flag\") (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $12)))))))\n))) \'(\'(\'\"_logical_id\" \'200670)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:37:57,558 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ts77dlg6d0h91"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543070
        nanos: 419217000
      }
      modified_at {
        seconds: 1765543076
        nanos: 983825000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543070
      nanos: 731000000
    }
    finished_at {
      seconds: 1765543077
      nanos: 43000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7ts77dlcs36oad-ptqudq7ts77dlg6d0h91"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543070
      nanos: 419217000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE flag"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: `flag`"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"56ms\",\"count\":1,\"avg\":\"56ms\",\"max\":\"56ms\",\"min\":\"56ms\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"flag\" (OptionalType (DataType \'Bool))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $7 \'(\'\"SharedReading\" \'\"1\"))\n(let $8 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $9 \'($6 $7 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $8))\n(let $10 (SecureParam \'\"cluster:default_yds\"))\n(let $11 (DqPqTopicSource $1 $5 \'(\'\"flag\" \'\"time\") $9 $10 \'\"J\\b\\n\\x06\\x12\\x04flag\" $4 \'\"\"))\n(let $12 (DataType \'String))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $12))))\n(let $15 (DqPqTopicSink $14 \'($6 $8) $10))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $11)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($7))))\n  (let $18 (DqSourceWideWrap $16 $2 $4 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"flag\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (Member $21 \'\"flag\") (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $12)))))))\n))) \'(\'(\'\"_logical_id\" \'200670)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:37:57,614 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:37:57,615 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "82f9af39-18b0-4d54-825d-21f87708847d"

2025-12-12 12:37:57,648 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7ts0bkojk4lqa1"

2025-12-12 12:37:57,685 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ts0bkojk4lqa1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543077
        nanos: 620932000
      }
      modified_at {
        seconds: 1765543077
        nanos: 620932000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7ts0bkogv2ptsm-ptqudq7ts0bkojk4lqa1"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543077
      nanos: 620932000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
    syntax: YQL_V1
  }
}

2025-12-12 12:37:58,203 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ts0bkojk4lqa1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543077
        nanos: 620932000
      }
      modified_at {
        seconds: 1765543077
        nanos: 620932000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543077
      nanos: 767000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7ts0bkogv2ptsm-ptqudq7ts0bkojk4lqa1"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543077
      nanos: 620932000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 186
            }
            message: "At function: !="
            end_position {
              row: 5
              column: 186
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 166
              }
              message: "At function: *"
              end_position {
                row: 5
                column: 166
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 166
                }
                message: "Integral type implicit bitcast: Uint64 and Optional<Int64>"
                end_position {
                  row: 5
                  column: 166
                }
                issue_code: 1107
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` * (`field2` - `field1`)) <> 0)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B9\\b\\x04\\x12&\\x1A$\\b\\x01\\x12\\x06\\x12\\x04time\\x1A\\x18\\x1A\\x16\\b\\x03\\x12\\b\\x12\\x06field2\\x1A\\b\\x12\\x06field1\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x00\\x00\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Coalesce (!= (* $24 (- (Member $23 \'\"field2\") (Member $23 \'\"field1\"))) (Int32 \'\"0\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200773)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:00,075 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0014*\014shard-000000\032\021\"\0015*\014shard-000000"
  }
}

2025-12-12 12:38:00,076 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:00,076 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:00,078 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.15
2025-12-12 12:38:00,078 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:00,085 - DEBUG - ya.test - execute: Command pid: 1633659
2025-12-12 12:38:03,331 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:03,331 - DEBUG - ya.test - _save_outputs: Command (pid 1633659) rc: 0
2025-12-12 12:38:03,332 - DEBUG - ya.test - _save_outputs: Command (pid 1633659) elapsed time (sec): 3.241795063018799
2025-12-12 12:38:03,332 - DEBUG - ya.test - _save_outputs: Command (pid 1633659) wtime: 3.253
2025-12-12 12:38:03,332 - DEBUG - ya.test - _save_outputs: Command (pid 1633659) output:
None
2025-12-12 12:38:03,332 - DEBUG - ya.test - _save_outputs: Command (pid 1633659) errors:
2025-12-12T12:38:00.135883Z :INFO: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Starting read session
2025-12-12T12:38:00.135948Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:00.136536Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:00.136551Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:00.136559Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:00.159704Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] Successfully connected. Initializing session
2025-12-12T12:38:00.170690Z :INFO: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] Server session id: test_filters_optional_field_consumer_1_33_5018508576763442074_v1
2025-12-12T12:38:00.170788Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:00.199059Z :INFO: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:01.141469Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:2
2025-12-12T12:38:01.141508Z :INFO: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1005 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:03.220071Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:03.220156Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-12-12T12:38:03.220199Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-12-12T12:38:03.223122Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] Commit offsets [2, 3). Partition stream id: 1
2025-12-12T12:38:03.223231Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:03.239198Z :DEBUG: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:03.239393Z :INFO: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:03.239423Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:2:3
2025-12-12T12:38:03.239435Z :INFO: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3103 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:03.239622Z :NOTICE: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:03.239732Z :INFO: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:03.239738Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:2:3
2025-12-12T12:38:03.239763Z :INFO: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3103 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:03.239772Z :NOTICE: [local] [local] [3b8c78e2-eb440a07-7873b258-44064d4a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:03,333 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:03,372 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:03,390 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ts0bkojk4lqa1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543077
        nanos: 620932000
      }
      modified_at {
        seconds: 1765543083
        nanos: 352023000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543077
      nanos: 767000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7ts0bkogv2ptsm-ptqudq7ts0bkojk4lqa1"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543077
      nanos: 620932000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 186
            }
            message: "At function: !="
            end_position {
              row: 5
              column: 186
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 166
              }
              message: "At function: *"
              end_position {
                row: 5
                column: 166
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 166
                }
                message: "Integral type implicit bitcast: Uint64 and Optional<Int64>"
                end_position {
                  row: 5
                  column: 166
                }
                issue_code: 1107
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` * (`field2` - `field1`)) <> 0)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B9\\b\\x04\\x12&\\x1A$\\b\\x01\\x12\\x06\\x12\\x04time\\x1A\\x18\\x1A\\x16\\b\\x03\\x12\\b\\x12\\x06field2\\x1A\\b\\x12\\x06field1\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x00\\x00\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Coalesce (!= (* $24 (- (Member $23 \'\"field2\") (Member $23 \'\"field1\"))) (Int32 \'\"0\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200773)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:03,931 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:04,460 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7ts0bkojk4lqa1"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543077
        nanos: 620932000
      }
      modified_at {
        seconds: 1765543083
        nanos: 352023000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543077
      nanos: 767000000
    }
    finished_at {
      seconds: 1765543084
      nanos: 71000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7ts0bkogv2ptsm-ptqudq7ts0bkojk4lqa1"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543077
      nanos: 620932000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time * (field2 - field1) != 0"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 186
            }
            message: "At function: !="
            end_position {
              row: 5
              column: 186
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 166
              }
              message: "At function: *"
              end_position {
                row: 5
                column: 166
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 166
                }
                message: "Integral type implicit bitcast: Uint64 and Optional<Int64>"
                end_position {
                  row: 5
                  column: 166
                }
                issue_code: 1107
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` * (`field2` - `field1`)) <> 0)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"65ms\",\"count\":1,\"avg\":\"65ms\",\"max\":\"65ms\",\"min\":\"65ms\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B9\\b\\x04\\x12&\\x1A$\\b\\x01\\x12\\x06\\x12\\x04time\\x1A\\x18\\x1A\\x16\\b\\x03\\x12\\b\\x12\\x06field2\\x1A\\b\\x12\\x06field1\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x00\\x00\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Coalesce (!= (* $24 (- (Member $23 \'\"field2\") (Member $23 \'\"field1\"))) (Int32 \'\"0\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200773)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:04,528 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:04,529 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "75643b1c-de5b-488a-9d4d-9074ee7151a3"

2025-12-12 12:38:04,563 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7trpodof324iid"

2025-12-12 12:38:04,605 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trpodof324iid"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543084
        nanos: 542141000
      }
      modified_at {
        seconds: 1765543084
        nanos: 542141000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7trpodoah18mu2-ptqudq7trpodof324iid"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543084
      nanos: 542141000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
    syntax: YQL_V1
  }
}

2025-12-12 12:38:05,134 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trpodof324iid"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543084
        nanos: 542141000
      }
      modified_at {
        seconds: 1765543084
        nanos: 542141000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543084
      nanos: 779000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7trpodoah18mu2-ptqudq7trpodof324iid"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543084
      nanos: 542141000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (((`field1` % `field2`) / 5) = 1)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"B@\\b\\x03\\x12-\\x1A+\\b\\a\\x12\\x18\\x1A\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x05\\x00\\x00\\x00\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x01\\x00\\x00\\x00\")\n(let $13 (DqPqTopicSource $1 $5 $6 $10 $11 $12 $4 \'\"\"))\n(let $14 (DataType \'String))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $14))))\n(let $17 (DqPqTopicSink $16 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $20 (DqSourceWideWrap $18 $2 $4 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"field1\" $21) \'(\'\"field2\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (OptionalIf (Coalesce (== (/ (% (Member $24 \'\"field1\") (Member $24 \'\"field2\")) (Int32 \'\"5\")) (Int32 \'\"1\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $14)))))))\n))) \'(\'(\'\"_logical_id\" \'200767)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:38:06,953 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0016*\014shard-000000\032\021\"\0017*\014shard-000000"
  }
}

2025-12-12 12:38:06,953 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:06,954 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:06,970 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.16
2025-12-12 12:38:06,970 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:06,982 - DEBUG - ya.test - execute: Command pid: 1640426
2025-12-12 12:38:10,359 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:10,431 - DEBUG - ya.test - _save_outputs: Command (pid 1640426) rc: 0
2025-12-12 12:38:10,431 - DEBUG - ya.test - _save_outputs: Command (pid 1640426) elapsed time (sec): 3.447657585144043
2025-12-12 12:38:10,436 - DEBUG - ya.test - _save_outputs: Command (pid 1640426) wtime: 3.456
2025-12-12 12:38:10,438 - DEBUG - ya.test - _save_outputs: Command (pid 1640426) output:
None
2025-12-12 12:38:10,438 - DEBUG - ya.test - _save_outputs: Command (pid 1640426) errors:
2025-12-12T12:38:07.016446Z :INFO: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Starting read session
2025-12-12T12:38:07.016491Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:07.016969Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:07.016979Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:07.016985Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:07.059298Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] Successfully connected. Initializing session
2025-12-12T12:38:07.060803Z :INFO: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] Server session id: test_filters_optional_field_consumer_1_35_5136839128182128924_v1
2025-12-12T12:38:07.060876Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:07.063250Z :INFO: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:08.022407Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:3
2025-12-12T12:38:08.022446Z :INFO: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1005 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:10.227897Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:10.228519Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (3-3)
2025-12-12T12:38:10.228555Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-12-12T12:38:10.229285Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] Commit offsets [3, 4). Partition stream id: 1
2025-12-12T12:38:10.229419Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:10.239929Z :DEBUG: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:10.311514Z :INFO: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:10.311543Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:3:4
2025-12-12T12:38:10.311555Z :INFO: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3295 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:10.314844Z :NOTICE: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:10.319141Z :INFO: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:10.319162Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:3:4
2025-12-12T12:38:10.319184Z :INFO: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3302 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:10.319198Z :NOTICE: [local] [local] [fea15123-1e2b4a0c-14b84de-cf310b49] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:10,438 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:10,492 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:10,512 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trpodof324iid"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543084
        nanos: 542141000
      }
      modified_at {
        seconds: 1765543090
        nanos: 477967000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543084
      nanos: 779000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7trpodoah18mu2-ptqudq7trpodof324iid"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543084
      nanos: 542141000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (((`field1` % `field2`) / 5) = 1)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"B@\\b\\x03\\x12-\\x1A+\\b\\a\\x12\\x18\\x1A\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x05\\x00\\x00\\x00\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x01\\x00\\x00\\x00\")\n(let $13 (DqPqTopicSource $1 $5 $6 $10 $11 $12 $4 \'\"\"))\n(let $14 (DataType \'String))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $14))))\n(let $17 (DqPqTopicSink $16 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $20 (DqSourceWideWrap $18 $2 $4 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"field1\" $21) \'(\'\"field2\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (OptionalIf (Coalesce (== (/ (% (Member $24 \'\"field1\") (Member $24 \'\"field2\")) (Int32 \'\"5\")) (Int32 \'\"1\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $14)))))))\n))) \'(\'(\'\"_logical_id\" \'200767)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:38:11,093 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:11,639 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trpodof324iid"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543084
        nanos: 542141000
      }
      modified_at {
        seconds: 1765543090
        nanos: 477967000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543084
      nanos: 779000000
    }
    finished_at {
      seconds: 1765543091
      nanos: 115000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7trpodoah18mu2-ptqudq7trpodof324iid"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543084
      nanos: 542141000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE (field1 % field2) / 5 = 1"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (((`field1` % `field2`) / 5) = 1)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"69ms\",\"count\":1,\"avg\":\"69ms\",\"max\":\"69ms\",\"min\":\"69ms\"},\"EgressRows\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"B@\\b\\x03\\x12-\\x1A+\\b\\a\\x12\\x18\\x1A\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x05\\x00\\x00\\x00\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\x01\\x00\\x00\\x00\")\n(let $13 (DqPqTopicSource $1 $5 $6 $10 $11 $12 $4 \'\"\"))\n(let $14 (DataType \'String))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $14))))\n(let $17 (DqPqTopicSink $16 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $20 (DqSourceWideWrap $18 $2 $4 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22 $23) (AsStruct \'(\'\"field1\" $21) \'(\'\"field2\" $22) \'(\'\"time\" $23)))) (lambda \'($24) (OptionalIf (Coalesce (== (/ (% (Member $24 \'\"field1\") (Member $24 \'\"field2\")) (Int32 \'\"5\")) (Int32 \'\"1\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $24 \'\"time\") $14)))))))\n))) \'(\'(\'\"_logical_id\" \'200767)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:38:11,737 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:11,738 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "1ccdc47f-da45-42b4-8889-0b95acb02009"

2025-12-12 12:38:11,780 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7trism8cdmtlvo"

2025-12-12 12:38:11,796 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trism8cdmtlvo"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543091
        nanos: 742397000
      }
      modified_at {
        seconds: 1765543091
        nanos: 742397000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7trism88i564d1-ptqudq7trism8cdmtlvo"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543091
      nanos: 742397000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
}

2025-12-12 12:38:12,326 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trism8cdmtlvo"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543091
        nanos: 742397000
      }
      modified_at {
        seconds: 1765543091
        nanos: 742397000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543091
      nanos: 999000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7trism88i564d1-ptqudq7trism8cdmtlvo"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543091
      nanos: 742397000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsNotDistinctFrom (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:14,128 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\021\"\0018*\014shard-000000\032\021\"\0019*\014shard-000000"
  }
}

2025-12-12 12:38:14,129 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:14,131 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:14,133 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.17
2025-12-12 12:38:14,136 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:14,144 - DEBUG - ya.test - execute: Command pid: 1647857
2025-12-12 12:38:17,715 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:17,748 - DEBUG - ya.test - _save_outputs: Command (pid 1647857) rc: 0
2025-12-12 12:38:17,748 - DEBUG - ya.test - _save_outputs: Command (pid 1647857) elapsed time (sec): 3.6023194789886475
2025-12-12 12:38:17,749 - DEBUG - ya.test - _save_outputs: Command (pid 1647857) wtime: 3.61
2025-12-12 12:38:17,749 - DEBUG - ya.test - _save_outputs: Command (pid 1647857) output:
None
2025-12-12 12:38:17,749 - DEBUG - ya.test - _save_outputs: Command (pid 1647857) errors:
2025-12-12T12:38:14.167335Z :INFO: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Starting read session
2025-12-12T12:38:14.167719Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:14.168186Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:14.168198Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:14.168205Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:14.202063Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] Successfully connected. Initializing session
2025-12-12T12:38:14.216009Z :INFO: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] Server session id: test_filters_optional_field_consumer_1_37_13038197801573936413_v1
2025-12-12T12:38:14.260384Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:14.260867Z :INFO: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:15.171121Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:4
2025-12-12T12:38:15.223042Z :INFO: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1003 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:17.377438Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:17.458667Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (4-4)
2025-12-12T12:38:17.508138Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-12-12T12:38:17.508338Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] Commit offsets [4, 5). Partition stream id: 1
2025-12-12T12:38:17.508523Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:17.515246Z :DEBUG: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:17.531352Z :INFO: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:17.531392Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:4:5
2025-12-12T12:38:17.531404Z :INFO: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3364 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:17.532697Z :NOTICE: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:17.612210Z :INFO: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:17.612235Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:4:5
2025-12-12T12:38:17.612256Z :INFO: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3444 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:17.612276Z :NOTICE: [local] [local] [2ec5b361-8d08d34f-fc85365a-1fc87800] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:17,749 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:17,812 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:17,840 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trism8cdmtlvo"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543091
        nanos: 742397000
      }
      modified_at {
        seconds: 1765543097
        nanos: 787605000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543091
      nanos: 999000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7trism88i564d1-ptqudq7trism8cdmtlvo"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543091
      nanos: 742397000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsNotDistinctFrom (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:18,372 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trism8cdmtlvo"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543091
        nanos: 742397000
      }
      modified_at {
        seconds: 1765543097
        nanos: 787605000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543091
      nanos: 999000000
    }
    finished_at {
      seconds: 1765543098
      nanos: 272000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7trism88i564d1-ptqudq7trism8cdmtlvo"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543091
      nanos: 742397000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS NOT DISTINCT FROM \"event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS NOT DISTINCT FROM \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"98ms\",\"count\":1,\"avg\":\"98ms\",\"max\":\"98ms\",\"min\":\"98ms\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\a\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsNotDistinctFrom (Member $21 \'\"event\") (String \'\"event2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:18,423 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:18,442 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "7bb5ff7c-23b7-4094-b836-15114651448c"

2025-12-12 12:38:18,469 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7trcg2in7v5gia"

2025-12-12 12:38:18,507 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trcg2in7v5gia"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543098
        nanos: 447222000
      }
      modified_at {
        seconds: 1765543098
        nanos: 447222000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7trcg2ijm30kvo-ptqudq7trcg2in7v5gia"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543098
      nanos: 447222000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
}

2025-12-12 12:38:19,036 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trcg2in7v5gia"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543098
        nanos: 447222000
      }
      modified_at {
        seconds: 1765543098
        nanos: 447222000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543098
      nanos: 793000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7trcg2ijm30kvo-ptqudq7trcg2in7v5gia"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543098
      nanos: 447222000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsDistinctFrom (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:20,822 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00210*\014shard-000000\032\022\"\00211*\014shard-000000"
  }
}

2025-12-12 12:38:20,823 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:20,824 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:20,826 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.18
2025-12-12 12:38:20,826 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:20,837 - DEBUG - ya.test - execute: Command pid: 1654336
2025-12-12 12:38:24,341 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:24,344 - DEBUG - ya.test - _save_outputs: Command (pid 1654336) rc: 0
2025-12-12 12:38:24,349 - DEBUG - ya.test - _save_outputs: Command (pid 1654336) elapsed time (sec): 3.4499738216400146
2025-12-12 12:38:24,352 - DEBUG - ya.test - _save_outputs: Command (pid 1654336) wtime: 3.517
2025-12-12 12:38:24,410 - DEBUG - ya.test - _save_outputs: Command (pid 1654336) output:
None
2025-12-12 12:38:24,419 - DEBUG - ya.test - _save_outputs: Command (pid 1654336) errors:
2025-12-12T12:38:20.870956Z :INFO: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Starting read session
2025-12-12T12:38:20.871013Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:20.871435Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:20.871447Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:20.871454Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:20.890033Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] Successfully connected. Initializing session
2025-12-12T12:38:20.895289Z :INFO: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] Server session id: test_filters_optional_field_consumer_1_39_14770356380930652929_v1
2025-12-12T12:38:20.895393Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:20.903233Z :INFO: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:21.875087Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:5
2025-12-12T12:38:21.875128Z :INFO: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1004 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:24.181666Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:24.199460Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (5-5)
2025-12-12T12:38:24.199500Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-12-12T12:38:24.199581Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] Commit offsets [5, 6). Partition stream id: 1
2025-12-12T12:38:24.199695Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:24.206153Z :DEBUG: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:24.206393Z :INFO: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:24.206419Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:5:6
2025-12-12T12:38:24.206429Z :INFO: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3335 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:24.206911Z :NOTICE: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:24.207175Z :INFO: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:24.207189Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:5:6
2025-12-12T12:38:24.207211Z :INFO: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3336 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:24.207220Z :NOTICE: [local] [local] [7c76378a-31e574f7-5d3a40c5-ced57962] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:24,420 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:24,512 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:24,544 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trcg2in7v5gia"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543098
        nanos: 447222000
      }
      modified_at {
        seconds: 1765543104
        nanos: 493393000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543098
      nanos: 793000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7trcg2ijm30kvo-ptqudq7trcg2in7v5gia"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543098
      nanos: 447222000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsDistinctFrom (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:25,069 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:25,583 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7trcg2in7v5gia"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543098
        nanos: 447222000
      }
      modified_at {
        seconds: 1765543104
        nanos: 493393000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543098
      nanos: 793000000
    }
    finished_at {
      seconds: 1765543105
      nanos: 127000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7trcg2ijm30kvo-ptqudq7trcg2in7v5gia"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543098
      nanos: 447222000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM \"event1\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IS DISTINCT FROM \"event1\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"64ms\",\"count\":1,\"avg\":\"64ms\",\"max\":\"64ms\",\"min\":\"64ms\"},\"EgressRows\":{\"sum\":5,\"count\":1,\"avg\":5,\"max\":5,\"min\":5},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event1\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (IsDistinctFrom (Member $21 \'\"event\") (String \'\"event1\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200661)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:25,654 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:25,654 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "e7210e0a-37dd-4824-92a0-0d5c996f9128"

2025-12-12 12:38:25,706 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tr5jgu2bo8229"

2025-12-12 12:38:25,752 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tr5jgu2bo8229"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543105
        nanos: 674244000
      }
      modified_at {
        seconds: 1765543105
        nanos: 674244000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tr5jgtfgdrrjt-ptqudq7tr5jgu2bo8229"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543105
      nanos: 674244000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
    syntax: YQL_V1
  }
}

2025-12-12 12:38:26,302 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tr5jgu2bo8229"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543105
        nanos: 674244000
      }
      modified_at {
        seconds: 1765543105
        nanos: 674244000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543105
      nanos: 817000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tr5jgtfgdrrjt-ptqudq7tr5jgu2bo8229"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543105
      nanos: 674244000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`field1` IS DISTINCT FROM `field2`)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (OptionalIf (IsDistinctFrom (Member $23 \'\"field1\") (Member $23 \'\"field2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $13)))))))\n))) \'(\'(\'\"_logical_id\" \'200687)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:27,559 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00212*\014shard-000000\032\022\"\00213*\014shard-000000"
  }
}

2025-12-12 12:38:27,560 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:27,561 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:27,562 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.19
2025-12-12 12:38:27,563 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:27,564 - DEBUG - ya.test - execute: Command pid: 1660653
2025-12-12 12:38:31,269 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:31,270 - DEBUG - ya.test - _save_outputs: Command (pid 1660653) rc: 0
2025-12-12 12:38:31,270 - DEBUG - ya.test - _save_outputs: Command (pid 1660653) elapsed time (sec): 3.705724000930786
2025-12-12 12:38:31,270 - DEBUG - ya.test - _save_outputs: Command (pid 1660653) wtime: 3.707
2025-12-12 12:38:31,270 - DEBUG - ya.test - _save_outputs: Command (pid 1660653) output:
None
2025-12-12 12:38:31,270 - DEBUG - ya.test - _save_outputs: Command (pid 1660653) errors:
2025-12-12T12:38:27.580027Z :INFO: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Starting read session
2025-12-12T12:38:27.580075Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:27.580433Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:27.580447Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:27.580452Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:27.584775Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] Successfully connected. Initializing session
2025-12-12T12:38:27.585715Z :INFO: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] Server session id: test_filters_optional_field_consumer_1_41_752737270504178656_v1
2025-12-12T12:38:27.585778Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:27.587331Z :INFO: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:28.581262Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:6
2025-12-12T12:38:28.581313Z :INFO: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:31.158346Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:31.158445Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (6-6)
2025-12-12T12:38:31.158488Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-12-12T12:38:31.158611Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] Commit offsets [6, 7). Partition stream id: 1
2025-12-12T12:38:31.158712Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:31.161014Z :DEBUG: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:31.161141Z :INFO: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:31.161168Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:6:7
2025-12-12T12:38:31.161180Z :INFO: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3581 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:31.161426Z :NOTICE: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:31.164768Z :INFO: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:31.164778Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:6:7
2025-12-12T12:38:31.164801Z :INFO: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3584 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:31.164813Z :NOTICE: [local] [local] [321bef82-a63475f9-38d5b82d-cf5bd8c4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:31,271 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:31,285 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:31,292 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tr5jgu2bo8229"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543105
        nanos: 674244000
      }
      modified_at {
        seconds: 1765543111
        nanos: 280877000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543105
      nanos: 817000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tr5jgtfgdrrjt-ptqudq7tr5jgu2bo8229"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543105
      nanos: 674244000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`field1` IS DISTINCT FROM `field2`)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (OptionalIf (IsDistinctFrom (Member $23 \'\"field1\") (Member $23 \'\"field2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $13)))))))\n))) \'(\'(\'\"_logical_id\" \'200687)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:31,800 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:32,308 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tr5jgu2bo8229"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543105
        nanos: 674244000
      }
      modified_at {
        seconds: 1765543111
        nanos: 280877000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543105
      nanos: 817000000
    }
    finished_at {
      seconds: 1765543112
      nanos: 39000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tr5jgtfgdrrjt-ptqudq7tr5jgu2bo8229"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543105
      nanos: 674244000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  field1 IS DISTINCT FROM field2"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`field1` IS DISTINCT FROM `field2`)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"68ms\",\"count\":1,\"avg\":\"68ms\",\"max\":\"68ms\",\"min\":\"68ms\"},\"EgressRows\":{\"sum\":6,\"count\":1,\"avg\":6,\"max\":6,\"min\":6},\"MaxMemoryUsage\":{\"sum\":131072,\"count\":1,\"avg\":131072,\"max\":131072,\"min\":131072},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"B\\x16\\b\\b\\x12\\b\\x12\\x06field1\\x1A\\b\\x12\\x06field2\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (OptionalIf (IsDistinctFrom (Member $23 \'\"field1\") (Member $23 \'\"field2\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $13)))))))\n))) \'(\'(\'\"_logical_id\" \'200687)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:32,340 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:32,341 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "328fed14-a2c2-4086-98ee-93418a5e69b6"

2025-12-12 12:38:32,354 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tqv7un3joped9"

2025-12-12 12:38:32,367 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqv7un3joped9"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543112
        nanos: 344810000
      }
      modified_at {
        seconds: 1765543112
        nanos: 344810000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqv7um70nrac7-ptqudq7tqv7un3joped9"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543112
      nanos: 344810000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
    syntax: YQL_V1
  }
}

2025-12-12 12:38:32,877 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqv7un3joped9"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543112
        nanos: 344810000
      }
      modified_at {
        seconds: 1765543112
        nanos: 344810000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543112
      nanos: 788000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqv7um70nrac7-ptqudq7tqv7un3joped9"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543112
      nanos: 344810000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` = 102) OR (`field2` IS NOT DISTINCT FROM 1005))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"\\x1A<\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\\n\\x1DB\\x1B\\b\\a\\x12\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\xED\\x03\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Or (== $24 (Int32 \'\"102\")) (And (IsNotDistinctFrom (Member $23 \'\"field2\") (Int32 \'\"1005\")) (< (Random (DependsOn (Member $23 \'\"field1\"))) (Double \'\"10.0\")))) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200824)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:33,482 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00214*\014shard-000000\032\022\"\00215*\014shard-000000"
  }
}

2025-12-12 12:38:33,483 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:33,483 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:33,485 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.20
2025-12-12 12:38:33,485 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:33,486 - DEBUG - ya.test - execute: Command pid: 1667580
2025-12-12 12:38:34,941 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-12 12:38:34,942 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:38:34,948 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-12 12:38:34,952 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 35be6ad0-0d42-4660-95df-7e698aac4989, localhost:63390): creating call state
2025-12-12 12:38:34,952 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 35be6ad0-0d42-4660-95df-7e698aac4989, localhost:63390): request = { database: "local" }
2025-12-12 12:38:34,957 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 35be6ad0-0d42-4660-95df-7e698aac4989, localhost:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-fhkyrtz6p4.auto.internal" port: 63390 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-12 12:38:34,957 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-fhkyrtz6p4.auto.internal:63390, location 1, ssl: False>]>
2025-12-12 12:38:34,958 - INFO - ydb.connection - close: Closing channel for endpoint localhost:63390
2025-12-12 12:38:37,993 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:37,993 - DEBUG - ya.test - _save_outputs: Command (pid 1667580) rc: 0
2025-12-12 12:38:37,993 - DEBUG - ya.test - _save_outputs: Command (pid 1667580) elapsed time (sec): 4.506836652755737
2025-12-12 12:38:37,994 - DEBUG - ya.test - _save_outputs: Command (pid 1667580) wtime: 4.508
2025-12-12 12:38:37,994 - DEBUG - ya.test - _save_outputs: Command (pid 1667580) output:
None
2025-12-12 12:38:37,994 - DEBUG - ya.test - _save_outputs: Command (pid 1667580) errors:
2025-12-12T12:38:33.501876Z :INFO: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Starting read session
2025-12-12T12:38:33.501912Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:33.502334Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:33.503200Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:33.503210Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:33.507516Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] Successfully connected. Initializing session
2025-12-12T12:38:33.508382Z :INFO: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] Server session id: test_filters_optional_field_consumer_1_43_7363236340192840589_v1
2025-12-12T12:38:33.508458Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:33.509699Z :INFO: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:34.503206Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:7
2025-12-12T12:38:34.503255Z :INFO: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:37.921037Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:37.921113Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (7-7)
2025-12-12T12:38:37.921169Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (7-7)
2025-12-12T12:38:37.921308Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] Commit offsets [7, 8). Partition stream id: 1
2025-12-12T12:38:37.921414Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:37.923713Z :DEBUG: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:37.923871Z :INFO: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:37.923895Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:7:8
2025-12-12T12:38:37.923905Z :INFO: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4422 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:37.924148Z :NOTICE: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:37.927446Z :INFO: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:37.927459Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:7:8
2025-12-12T12:38:37.927489Z :INFO: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4425 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:37.927503Z :NOTICE: [local] [local] [ca818190-5900faea-a347f51a-ab10b6e9] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:37,994 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:38,008 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:38,014 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqv7un3joped9"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543112
        nanos: 344810000
      }
      modified_at {
        seconds: 1765543118
        nanos: 3371000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543112
      nanos: 788000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqv7um70nrac7-ptqudq7tqv7un3joped9"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543112
      nanos: 344810000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` = 102) OR (`field2` IS NOT DISTINCT FROM 1005))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"\\x1A<\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\\n\\x1DB\\x1B\\b\\a\\x12\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\xED\\x03\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Or (== $24 (Int32 \'\"102\")) (And (IsNotDistinctFrom (Member $23 \'\"field2\") (Int32 \'\"1005\")) (< (Random (DependsOn (Member $23 \'\"field1\"))) (Double \'\"10.0\")))) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200824)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:38,524 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:38,592 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-12 12:38:38,593 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:38:38,597 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-12 12:38:38,598 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, fe9be2d2-9b30-4987-a268-289e94a31997, localhost:63390): creating call state
2025-12-12 12:38:38,598 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, fe9be2d2-9b30-4987-a268-289e94a31997, localhost:63390): request = { database: "local" }
2025-12-12 12:38:38,600 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, fe9be2d2-9b30-4987-a268-289e94a31997, localhost:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-fhkyrtz6p4.auto.internal" port: 63390 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-12 12:38:38,601 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-fhkyrtz6p4.auto.internal:63390, location 1, ssl: False>]>
2025-12-12 12:38:38,601 - INFO - ydb.connection - close: Closing channel for endpoint localhost:63390
2025-12-12 12:38:39,031 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqv7un3joped9"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543112
        nanos: 344810000
      }
      modified_at {
        seconds: 1765543118
        nanos: 3371000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543112
      nanos: 788000000
    }
    finished_at {
      seconds: 1765543118
      nanos: 881000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqv7um70nrac7-ptqudq7tqv7un3joped9"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543112
      nanos: 344810000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE time == 102 OR (field2 IS NOT DISTINCT FROM 1005 AND Random(field1) < 10.0)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`time` = 102) OR (`field2` IS NOT DISTINCT FROM 1005))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"53ms\",\"count\":1,\"avg\":\"53ms\",\"max\":\"53ms\",\"min\":\"53ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (StructType \'(\'\"field1\" (OptionalType (DataType \'Uint8))) \'(\'\"field2\" (OptionalType (DataType \'Int64))) \'(\'\"time\" (DataType \'Uint64))))\n(let $5 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $4))\n(let $6 \'(\'\"field1\" \'\"field2\" \'\"time\"))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $5 $6 $10 $11 \'\"\\x1A<\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\\n\\x1DB\\x1B\\b\\a\\x12\\b\\x12\\x06field2\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15\\xED\\x03\\x00\\x00\" $4 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $4 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21 $22) (AsStruct \'(\'\"field1\" $20) \'(\'\"field2\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 (Member $23 \'\"time\"))\n    (return (OptionalIf (Or (== $24 (Int32 \'\"102\")) (And (IsNotDistinctFrom (Member $23 \'\"field2\") (Int32 \'\"1005\")) (< (Random (DependsOn (Member $23 \'\"field1\"))) (Double \'\"10.0\")))) (AsStruct \'(\'\"column0\" (SafeCast $24 $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200824)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:39,065 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:39,066 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "fa3755d6-85af-46d2-9df5-829499c910bf"

2025-12-12 12:38:39,080 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tqoqmraamvcdl"

2025-12-12 12:38:39,087 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqoqmraamvcdl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543119
        nanos: 70300000
      }
      modified_at {
        seconds: 1765543119
        nanos: 70300000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqoqmr61dvgdv-ptqudq7tqoqmraamvcdl"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543119
      nanos: 70300000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
}

2025-12-12 12:38:39,597 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqoqmraamvcdl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543119
        nanos: 70300000
      }
      modified_at {
        seconds: 1765543119
        nanos: 70300000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543119
      nanos: 298000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqoqmr61dvgdv-ptqudq7tqoqmraamvcdl"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543119
      nanos: 70300000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $22 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200701)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:40,727 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00216*\014shard-000000\032\022\"\00217*\014shard-000000"
  }
}

2025-12-12 12:38:40,727 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:40,728 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:40,730 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.21
2025-12-12 12:38:40,731 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:40,732 - DEBUG - ya.test - execute: Command pid: 1674748
2025-12-12 12:38:44,538 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:44,539 - DEBUG - ya.test - _save_outputs: Command (pid 1674748) rc: 0
2025-12-12 12:38:44,539 - DEBUG - ya.test - _save_outputs: Command (pid 1674748) elapsed time (sec): 3.8061068058013916
2025-12-12 12:38:44,539 - DEBUG - ya.test - _save_outputs: Command (pid 1674748) wtime: 3.807
2025-12-12 12:38:44,539 - DEBUG - ya.test - _save_outputs: Command (pid 1674748) output:
None
2025-12-12 12:38:44,539 - DEBUG - ya.test - _save_outputs: Command (pid 1674748) errors:
2025-12-12T12:38:40.749556Z :INFO: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Starting read session
2025-12-12T12:38:40.749599Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:40.750075Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:40.750090Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:40.750097Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:40.754418Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] Successfully connected. Initializing session
2025-12-12T12:38:40.755253Z :INFO: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] Server session id: test_filters_optional_field_consumer_1_45_15237627914123967991_v1
2025-12-12T12:38:40.755309Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:40.756453Z :INFO: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:41.750266Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:8
2025-12-12T12:38:41.750294Z :INFO: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:44.438012Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:44.438092Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (8-8)
2025-12-12T12:38:44.438149Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-12-12T12:38:44.438255Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] Commit offsets [8, 9). Partition stream id: 1
2025-12-12T12:38:44.438368Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:44.440948Z :DEBUG: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:44.441093Z :INFO: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:44.441132Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:8:9
2025-12-12T12:38:44.441144Z :INFO: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3691 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:44.441390Z :NOTICE: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:44.441504Z :INFO: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:44.441516Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:8:9
2025-12-12T12:38:44.441535Z :INFO: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3692 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:44.441544Z :NOTICE: [local] [local] [32c36df5-5a21d897-b16d0ffd-10a719dc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:44,540 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:44,556 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:44,564 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqoqmraamvcdl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543119
        nanos: 70300000
      }
      modified_at {
        seconds: 1765543124
        nanos: 551652000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543119
      nanos: 298000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqoqmr61dvgdv-ptqudq7tqoqmraamvcdl"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543119
      nanos: 70300000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $22 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200701)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:45,072 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:45,579 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqoqmraamvcdl"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543119
        nanos: 70300000
      }
      modified_at {
        seconds: 1765543124
        nanos: 551652000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543119
      nanos: 298000000
    }
    finished_at {
      seconds: 1765543125
      nanos: 390000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqoqmr61dvgdv-ptqudq7tqoqmraamvcdl"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543119
      nanos: 70300000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"60ms\",\"count\":1,\"avg\":\"60ms\",\"max\":\"60ms\",\"min\":\"60ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"*\\x1C\\n\\a\\x12\\x05event\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (block \'(\n    (let $22 (SqlIn \'((String \'\"event2\")) (Member $21 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $22 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200701)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:38:45,613 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:45,614 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "3b5b2d8d-0b2c-4739-a516-84b5a3e6a7d7"

2025-12-12 12:38:45,628 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tqiishaaujrdf"

2025-12-12 12:38:45,635 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqiishaaujrdf"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543125
        nanos: 618091000
      }
      modified_at {
        seconds: 1765543125
        nanos: 618091000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqiish7g5alkp-ptqudq7tqiishaaujrdf"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543125
      nanos: 618091000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-12 12:38:46,143 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqiishaaujrdf"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543125
        nanos: 618091000
      }
      modified_at {
        seconds: 1765543125
        nanos: 618091000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543125
      nanos: 794000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqiish7g5alkp-ptqudq7tqiishaaujrdf"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543125
      nanos: 618091000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $24 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200729)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:46,216 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00218*\014shard-000000\032\022\"\00219*\014shard-000000"
  }
}

2025-12-12 12:38:46,216 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:46,217 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:46,218 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.22
2025-12-12 12:38:46,218 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:46,219 - DEBUG - ya.test - execute: Command pid: 1678633
2025-12-12 12:38:51,026 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:51,027 - DEBUG - ya.test - _save_outputs: Command (pid 1678633) rc: 0
2025-12-12 12:38:51,027 - DEBUG - ya.test - _save_outputs: Command (pid 1678633) elapsed time (sec): 4.807480573654175
2025-12-12 12:38:51,027 - DEBUG - ya.test - _save_outputs: Command (pid 1678633) wtime: 4.808
2025-12-12 12:38:51,027 - DEBUG - ya.test - _save_outputs: Command (pid 1678633) output:
None
2025-12-12 12:38:51,027 - DEBUG - ya.test - _save_outputs: Command (pid 1678633) errors:
2025-12-12T12:38:46.234277Z :INFO: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Starting read session
2025-12-12T12:38:46.234321Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:46.234726Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:46.234739Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:46.234744Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:46.240008Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] Successfully connected. Initializing session
2025-12-12T12:38:46.241110Z :INFO: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] Server session id: test_filters_optional_field_consumer_1_47_14110440188188973868_v1
2025-12-12T12:38:46.241164Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:46.242510Z :INFO: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:47.235282Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:9
2025-12-12T12:38:47.235317Z :INFO: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:50.956953Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:50.958079Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (9-9)
2025-12-12T12:38:50.958144Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (9-9)
2025-12-12T12:38:50.958280Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] Commit offsets [9, 10). Partition stream id: 1
2025-12-12T12:38:50.958436Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:50.961066Z :DEBUG: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:50.962027Z :INFO: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:50.962060Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:9:10
2025-12-12T12:38:50.962071Z :INFO: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4727 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:50.962545Z :NOTICE: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:50.967150Z :INFO: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:50.967169Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:9:10
2025-12-12T12:38:50.967197Z :INFO: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4732 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:50.967211Z :NOTICE: [local] [local] [c4ca35fe-b8656ad6-55c314ce-c240d2c7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:51,028 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:51,045 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:51,052 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqiishaaujrdf"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543125
        nanos: 618091000
      }
      modified_at {
        seconds: 1765543131
        nanos: 39767000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543125
      nanos: 794000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqiish7g5alkp-ptqudq7tqiishaaujrdf"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543125
      nanos: 618091000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $24 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200729)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:51,562 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:52,069 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqiishaaujrdf"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543125
        nanos: 618091000
      }
      modified_at {
        seconds: 1765543131
        nanos: 39767000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543125
      nanos: 794000000
    }
    finished_at {
      seconds: 1765543131
      nanos: 892000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqiish7g5alkp-ptqudq7tqiishaaujrdf"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543125
      nanos: 618091000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"88ms\",\"count\":1,\"avg\":\"88ms\",\"max\":\"88ms\",\"min\":\"88ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 \'\"*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\")\n(let $13 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 $12 $5 \'\"\"))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $13)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"event\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $24 (SqlIn $23 (Member $22 \'\"event\") \'(\'(\'ansi))))\n    (return (OptionalIf (Coalesce $24 (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200729)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:38:52,104 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:52,105 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "8266105a-6b7c-4eb6-a2b2-2e57bf868bc2"

2025-12-12 12:38:52,123 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tqcckvf6itl12"

2025-12-12 12:38:52,130 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqcckvf6itl12"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543132
        nanos: 113884000
      }
      modified_at {
        seconds: 1765543132
        nanos: 113884000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqcckvbghjs9u-ptqudq7tqcckvf6itl12"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543132
      nanos: 113884000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
}

2025-12-12 12:38:52,639 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqcckvf6itl12"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543132
        nanos: 113884000
      }
      modified_at {
        seconds: 1765543132
        nanos: 113884000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543132
      nanos: 306000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqcckvbghjs9u-ptqudq7tqcckvf6itl12"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543132
      nanos: 113884000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND COALESCE((`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")), FALSE))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"\\x12\\xB0\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x96\\x01R\\x93\\x01\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $28 (SqlIn $27 $26 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $26 (Member $25 \'\"data\")) (Coalesce $28 (Bool \'false))) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200860)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:38:53,819 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00220*\014shard-000000\032\022\"\00221*\014shard-000000"
  }
}

2025-12-12 12:38:53,819 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:53,820 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:53,821 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.23
2025-12-12 12:38:53,822 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:53,823 - DEBUG - ya.test - execute: Command pid: 1684730
2025-12-12 12:38:57,528 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:38:57,529 - DEBUG - ya.test - _save_outputs: Command (pid 1684730) rc: 0
2025-12-12 12:38:57,529 - DEBUG - ya.test - _save_outputs: Command (pid 1684730) elapsed time (sec): 3.7060203552246094
2025-12-12 12:38:57,529 - DEBUG - ya.test - _save_outputs: Command (pid 1684730) wtime: 3.707
2025-12-12 12:38:57,530 - DEBUG - ya.test - _save_outputs: Command (pid 1684730) output:
None
2025-12-12 12:38:57,530 - DEBUG - ya.test - _save_outputs: Command (pid 1684730) errors:
2025-12-12T12:38:53.841931Z :INFO: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Starting read session
2025-12-12T12:38:53.841972Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:53.842427Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:53.842439Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:53.842447Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:53.847127Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] Successfully connected. Initializing session
2025-12-12T12:38:53.848156Z :INFO: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] Server session id: test_filters_optional_field_consumer_1_49_11069487594296041689_v1
2025-12-12T12:38:53.848198Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:53.849817Z :INFO: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:38:54.843332Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:10
2025-12-12T12:38:54.843385Z :INFO: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:57.509268Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:57.509351Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (10-10)
2025-12-12T12:38:57.509395Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-12-12T12:38:57.509514Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] Commit offsets [10, 11). Partition stream id: 1
2025-12-12T12:38:57.509600Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:38:57.512104Z :DEBUG: [local] [local] [b327f00b-339eded8-a8a83628-42379722] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:38:57.512268Z :INFO: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Closing read session. Close timeout: 5.000000s
2025-12-12T12:38:57.512328Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:10:11
2025-12-12T12:38:57.512350Z :INFO: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3670 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:38:57.512616Z :NOTICE: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:38:57.512748Z :INFO: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Closing read session. Close timeout: 0.000000s
2025-12-12T12:38:57.512758Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:10:11
2025-12-12T12:38:57.512786Z :INFO: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3670 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:38:57.512798Z :NOTICE: [local] [local] [b327f00b-339eded8-a8a83628-42379722] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:38:57,530 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:38:57,548 - DEBUG - root - control_query: Result: 
2025-12-12 12:38:57,557 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqcckvf6itl12"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543132
        nanos: 113884000
      }
      modified_at {
        seconds: 1765543137
        nanos: 542240000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543132
      nanos: 306000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqcckvbghjs9u-ptqudq7tqcckvf6itl12"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543132
      nanos: 113884000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND COALESCE((`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")), FALSE))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"\\x12\\xB0\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x96\\x01R\\x93\\x01\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $28 (SqlIn $27 $26 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $26 (Member $25 \'\"data\")) (Coalesce $28 (Bool \'false))) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200860)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:38:58,066 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:58,574 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tqcckvf6itl12"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543132
        nanos: 113884000
      }
      modified_at {
        seconds: 1765543137
        nanos: 542240000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543132
      nanos: 306000000
    }
    finished_at {
      seconds: 1765543138
      nanos: 424000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tqcckvbghjs9u-ptqudq7tqcckvf6itl12"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543132
      nanos: 113884000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event IS DISTINCT FROM data AND event IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((`event` IS DISTINCT FROM `data`) AND COALESCE((`event` IN (\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"event2\")), FALSE))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.10s\",\"count\":1,\"avg\":\"0.10s\",\"max\":\"0.10s\",\"min\":\"0.10s\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"\\x12\\xB0\\x01\\n\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\n\\x96\\x01R\\x93\\x01\\n\\x80\\x01*~\\n\\a\\x12\\x05event\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x011\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x012\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x013\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x014\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x015\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x016\\x12\\f\\n\\n\\n\\x03\\b\\x81 \\x12\\x03B\\x017\\x12\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 \'((String \'\"1\") (String \'\"2\") (String \'\"3\") (String \'\"4\") (String \'\"5\") (String \'\"6\") (String \'\"7\") (String \'\"event2\")))\n    (let $28 (SqlIn $27 $26 \'(\'(\'ansi))))\n    (return (OptionalIf (And (AggrNotEquals $26 (Member $25 \'\"data\")) (Coalesce $28 (Bool \'false))) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200860)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:38:58,608 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:38:58,608 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "d869c5bd-b3f4-4915-a6bc-8d303d59ed11"

2025-12-12 12:38:58,624 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tq66ajvfp401n"

2025-12-12 12:38:58,632 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tq66ajvfp401n"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543138
        nanos: 612558000
      }
      modified_at {
        seconds: 1765543138
        nanos: 612558000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tq66ajr96mjqj-ptqudq7tq66ajvfp401n"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543138
      nanos: 612558000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
}

2025-12-12 12:38:59,140 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tq66ajvfp401n"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543138
        nanos: 612558000
      }
      modified_at {
        seconds: 1765543138
        nanos: 612558000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543138
      nanos: 800000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tq66ajr96mjqj-ptqudq7tq66ajvfp401n"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543138
      nanos: 612558000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF(COALESCE((`event` = \"event2\"), FALSE), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"Z]\\n4R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 (Bool \'false))\n    (let $28 (If (Coalesce (== $26 (String \'\"event2\")) $27) (AggrNotEquals $26 (Member $25 \'\"data\")) $27))\n    (return (OptionalIf $28 (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200804)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:38:59,243 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00222*\014shard-000000\032\022\"\00223*\014shard-000000"
  }
}

2025-12-12 12:38:59,244 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:38:59,244 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:38:59,246 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.24
2025-12-12 12:38:59,246 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:38:59,247 - DEBUG - ya.test - execute: Command pid: 1687807
2025-12-12 12:39:04,056 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:04,056 - DEBUG - ya.test - _save_outputs: Command (pid 1687807) rc: 0
2025-12-12 12:39:04,056 - DEBUG - ya.test - _save_outputs: Command (pid 1687807) elapsed time (sec): 4.808179140090942
2025-12-12 12:39:04,057 - DEBUG - ya.test - _save_outputs: Command (pid 1687807) wtime: 4.81
2025-12-12 12:39:04,057 - DEBUG - ya.test - _save_outputs: Command (pid 1687807) output:
None
2025-12-12 12:39:04,057 - DEBUG - ya.test - _save_outputs: Command (pid 1687807) errors:
2025-12-12T12:38:59.264904Z :INFO: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Starting read session
2025-12-12T12:38:59.264951Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Starting session to cluster null (localhost:63390)
2025-12-12T12:38:59.265422Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:59.265436Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:59.265442Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:38:59.270154Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] Successfully connected. Initializing session
2025-12-12T12:38:59.271080Z :INFO: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] Server session id: test_filters_optional_field_consumer_1_51_16703021648155401161_v1
2025-12-12T12:38:59.271188Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:38:59.272320Z :INFO: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:00.266303Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:11
2025-12-12T12:39:00.268181Z :INFO: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:03.971530Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:03.971643Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (11-11)
2025-12-12T12:39:03.971688Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (11-11)
2025-12-12T12:39:03.971796Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] Commit offsets [11, 12). Partition stream id: 1
2025-12-12T12:39:03.971891Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:03.974705Z :DEBUG: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:03.974871Z :INFO: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:03.974904Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:11:12
2025-12-12T12:39:03.974918Z :INFO: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4710 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:03.975362Z :NOTICE: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:03.975516Z :INFO: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:03.975528Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:11:12
2025-12-12T12:39:03.975550Z :INFO: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4710 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:03.975561Z :NOTICE: [local] [local] [b9971e92-e7886629-ed8f85d4-ba81d28] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:04,057 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:04,073 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:04,081 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tq66ajvfp401n"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543138
        nanos: 612558000
      }
      modified_at {
        seconds: 1765543144
        nanos: 67870000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543138
      nanos: 800000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tq66ajr96mjqj-ptqudq7tq66ajvfp401n"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543138
      nanos: 612558000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF(COALESCE((`event` = \"event2\"), FALSE), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"Z]\\n4R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 (Bool \'false))\n    (let $28 (If (Coalesce (== $26 (String \'\"event2\")) $27) (AggrNotEquals $26 (Member $25 \'\"data\")) $27))\n    (return (OptionalIf $28 (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200804)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:39:04,589 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:05,097 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tq66ajvfp401n"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543138
        nanos: 612558000
      }
      modified_at {
        seconds: 1765543144
        nanos: 67870000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543138
      nanos: 800000000
    }
    finished_at {
      seconds: 1765543144
      nanos: 902000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tq66ajr96mjqj-ptqudq7tq66ajvfp401n"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543138
      nanos: 612558000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  IF(event == \"event2\", event IS DISTINCT FROM data, FALSE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: IF(COALESCE((`event` = \"event2\"), FALSE), (`event` IS DISTINCT FROM `data`), FALSE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"84ms\",\"count\":1,\"avg\":\"84ms\",\"max\":\"84ms\",\"min\":\"84ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"Z]\\n4R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\\x12\\x15B\\x13\\b\\b\\x12\\a\\x12\\x05event\\x1A\\x06\\x12\\x04data\\x1A\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x00\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (block \'(\n    (let $26 (Member $25 \'\"event\"))\n    (let $27 (Bool \'false))\n    (let $28 (If (Coalesce (== $26 (String \'\"event2\")) $27) (AggrNotEquals $26 (Member $25 \'\"data\")) $27))\n    (return (OptionalIf $28 (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200804)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:39:05,143 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:05,144 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "e29c8778-b3ff-4fdf-83f0-66a5ecd249ff"

2025-12-12 12:39:05,162 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tpvuq5gs2ikid"

2025-12-12 12:39:05,170 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpvuq5gs2ikid"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543145
        nanos: 150226000
      }
      modified_at {
        seconds: 1765543145
        nanos: 150226000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpvuq5c3dv1gp-ptqudq7tpvuq5gs2ikid"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543145
      nanos: 150226000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
    syntax: YQL_V1
  }
}

2025-12-12 12:39:05,685 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpvuq5gs2ikid"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543145
        nanos: 150226000
      }
      modified_at {
        seconds: 1765543145
        nanos: 150226000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543145
      nanos: 311000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpvuq5c3dv1gp-ptqudq7tpvuq5gs2ikid"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543145
      nanos: 150226000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:39:06,856 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00224*\014shard-000000\032\022\"\00225*\014shard-000000"
  }
}

2025-12-12 12:39:06,857 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:06,857 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:06,859 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.25
2025-12-12 12:39:06,859 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:06,860 - DEBUG - ya.test - execute: Command pid: 1692452
2025-12-12 12:39:10,566 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:10,567 - DEBUG - ya.test - _save_outputs: Command (pid 1692452) rc: 0
2025-12-12 12:39:10,567 - DEBUG - ya.test - _save_outputs: Command (pid 1692452) elapsed time (sec): 3.706348180770874
2025-12-12 12:39:10,567 - DEBUG - ya.test - _save_outputs: Command (pid 1692452) wtime: 3.707
2025-12-12 12:39:10,568 - DEBUG - ya.test - _save_outputs: Command (pid 1692452) output:
None
2025-12-12 12:39:10,568 - DEBUG - ya.test - _save_outputs: Command (pid 1692452) errors:
2025-12-12T12:39:06.879120Z :INFO: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Starting read session
2025-12-12T12:39:06.879178Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:06.880032Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:06.880050Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:06.880056Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:06.884543Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] Successfully connected. Initializing session
2025-12-12T12:39:06.885556Z :INFO: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] Server session id: test_filters_optional_field_consumer_1_53_12012752194730866664_v1
2025-12-12T12:39:06.885677Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:06.887124Z :INFO: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:07.880337Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:12
2025-12-12T12:39:07.880387Z :INFO: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:10.471965Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:10.472051Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (12-12)
2025-12-12T12:39:10.472096Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (12-12)
2025-12-12T12:39:10.472218Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] Commit offsets [12, 13). Partition stream id: 1
2025-12-12T12:39:10.472300Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:10.474919Z :DEBUG: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:10.475109Z :INFO: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:10.475135Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:12:13
2025-12-12T12:39:10.475149Z :INFO: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3596 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:10.475450Z :NOTICE: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:10.478837Z :INFO: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:10.478854Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:12:13
2025-12-12T12:39:10.478896Z :INFO: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3599 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:10.478922Z :NOTICE: [local] [local] [6ae56955-ab7a246f-327134da-7a6a911d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:10,568 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:10,588 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:10,597 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpvuq5gs2ikid"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543145
        nanos: 150226000
      }
      modified_at {
        seconds: 1765543150
        nanos: 581833000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543145
      nanos: 311000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpvuq5c3dv1gp-ptqudq7tpvuq5gs2ikid"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543145
      nanos: 150226000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:39:11,107 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:11,614 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpvuq5gs2ikid"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543145
        nanos: 150226000
      }
      modified_at {
        seconds: 1765543150
        nanos: 581833000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543145
      nanos: 311000000
    }
    finished_at {
      seconds: 1765543151
      nanos: 415000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpvuq5c3dv1gp-ptqudq7tpvuq5gs2ikid"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543145
      nanos: 150226000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"66ms\",\"count\":1,\"avg\":\"66ms\",\"max\":\"66ms\",\"min\":\"66ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"R2\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (== (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200700)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:39:11,648 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:11,649 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "d9b75b25-f1b3-450a-b506-ba249151c789"

2025-12-12 12:39:11,664 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tppobnjqc50q4"

2025-12-12 12:39:11,673 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tppobnjqc50q4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543151
        nanos: 653078000
      }
      modified_at {
        seconds: 1765543151
        nanos: 653078000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tppobndjub23d-ptqudq7tppobnjqc50q4"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543151
      nanos: 653078000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
    syntax: YQL_V1
  }
}

2025-12-12 12:39:12,184 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tppobnjqc50q4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543151
        nanos: 653078000
      }
      modified_at {
        seconds: 1765543151
        nanos: 653078000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543151
      nanos: 809000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tppobndjub23d-ptqudq7tppobnjqc50q4"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543151
      nanos: 653078000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), (`data` = \"hello2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"RS\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x1FB\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (OptionalIf (Coalesce (Coalesce (== (Member $25 \'\"event\") (String \'\"event2\")) (== (Member $25 \'\"data\") (String \'\"hello2\"))) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200795)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:39:12,296 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00226*\014shard-000000\032\022\"\00227*\014shard-000000"
  }
}

2025-12-12 12:39:12,296 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:12,297 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:12,299 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.26
2025-12-12 12:39:12,300 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:12,301 - DEBUG - ya.test - execute: Command pid: 1695727
2025-12-12 12:39:17,009 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:17,010 - DEBUG - ya.test - _save_outputs: Command (pid 1695727) rc: 0
2025-12-12 12:39:17,010 - DEBUG - ya.test - _save_outputs: Command (pid 1695727) elapsed time (sec): 4.708698511123657
2025-12-12 12:39:17,011 - DEBUG - ya.test - _save_outputs: Command (pid 1695727) wtime: 4.71
2025-12-12 12:39:17,011 - DEBUG - ya.test - _save_outputs: Command (pid 1695727) output:
None
2025-12-12 12:39:17,012 - DEBUG - ya.test - _save_outputs: Command (pid 1695727) errors:
2025-12-12T12:39:12.319138Z :INFO: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Starting read session
2025-12-12T12:39:12.319197Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:12.319667Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:12.319683Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:12.319689Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:12.324750Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] Successfully connected. Initializing session
2025-12-12T12:39:12.325761Z :INFO: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] Server session id: test_filters_optional_field_consumer_1_55_12785568627638923704_v1
2025-12-12T12:39:12.325852Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:12.327274Z :INFO: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:13.320279Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:13
2025-12-12T12:39:13.320310Z :INFO: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:16.992083Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:16.992159Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (13-13)
2025-12-12T12:39:16.992203Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (13-13)
2025-12-12T12:39:16.992315Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] Commit offsets [13, 14). Partition stream id: 1
2025-12-12T12:39:16.992421Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:16.994753Z :DEBUG: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:16.994903Z :INFO: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:16.994934Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:13:14
2025-12-12T12:39:16.994945Z :INFO: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4675 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:16.995361Z :NOTICE: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:16.995488Z :INFO: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:16.995499Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:13:14
2025-12-12T12:39:16.995523Z :INFO: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4676 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:16.995533Z :NOTICE: [local] [local] [a3b4fe45-58be0bd2-64178a55-acad1a1d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:17,012 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:17,031 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:17,039 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tppobnjqc50q4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543151
        nanos: 653078000
      }
      modified_at {
        seconds: 1765543157
        nanos: 25117000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543151
      nanos: 809000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tppobndjub23d-ptqudq7tppobnjqc50q4"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543151
      nanos: 653078000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), (`data` = \"hello2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"RS\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x1FB\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (OptionalIf (Coalesce (Coalesce (== (Member $25 \'\"event\") (String \'\"event2\")) (== (Member $25 \'\"data\") (String \'\"hello2\"))) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200795)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:39:17,552 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:18,061 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tppobnjqc50q4"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543151
        nanos: 653078000
      }
      modified_at {
        seconds: 1765543157
        nanos: 25117000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543151
      nanos: 809000000
    }
    finished_at {
      seconds: 1765543157
      nanos: 922000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tppobndjub23d-ptqudq7tppobnjqc50q4"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543151
      nanos: 653078000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  COALESCE(event = \"event2\", data = \"hello2\", TRUE)"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: COALESCE((`event` = \"event2\"), (`data` = \"hello2\"), TRUE)"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"89ms\",\"count\":1,\"avg\":\"89ms\",\"max\":\"89ms\",\"min\":\"89ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" (DataType \'Uint64))))\n(let $7 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $6))\n(let $8 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 \'\"RS\\n B\\x1E\\b\\x03\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\\n\\x1FB\\x1D\\b\\x03\\x12\\x06\\x12\\x04data\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06hello2\\n\\x0EJ\\f\\n\\n\\n\\b\\n\\x02\\b\\x06\\x12\\x02\\b\\x01\")\n(let $15 (DqPqTopicSource $1 $7 $8 $12 $13 $14 $6 \'\"\"))\n(let $16 (DataSink \'\"pq\" \'\"yds\"))\n(let $17 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $18 (DqPqTopicSink $17 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $15)) (lambda \'($19) (block \'(\n  (let $20 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $21 (DqSourceWideWrap $19 $2 $6 $20))\n  (return (FlatMap (NarrowMap $21 (lambda \'($22 $23 $24) (AsStruct \'(\'\"data\" $22) \'(\'\"event\" $23) \'(\'\"time\" $24)))) (lambda \'($25) (OptionalIf (Coalesce (Coalesce (== (Member $25 \'\"event\") (String \'\"event2\")) (== (Member $25 \'\"data\") (String \'\"hello2\"))) (Bool \'\"true\")) (AsStruct \'(\'\"column0\" (SafeCast (Member $25 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200795)) \'((DqSink \'\"0\" $16 $18))))) $16))\n)\n"
  }
}

2025-12-12 12:39:18,093 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:18,094 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "4f806e48-6fe5-4cba-be1f-6fc2cbc9ad34"

2025-12-12 12:39:18,108 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tpjjm1tlvd0qm"

2025-12-12 12:39:18,116 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpjjm1tlvd0qm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543158
        nanos: 97811000
      }
      modified_at {
        seconds: 1765543158
        nanos: 97811000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpjjm1ptf435c-ptqudq7tpjjm1tlvd0qm"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543158
      nanos: 97811000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
    syntax: YQL_V1
  }
}

2025-12-12 12:39:18,634 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpjjm1tlvd0qm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543158
        nanos: 97811000
      }
      modified_at {
        seconds: 1765543158
        nanos: 97811000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543158
      nanos: 323000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpjjm1ptf435c-ptqudq7tpjjm1tlvd0qm"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543158
      nanos: 97811000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (COALESCE(`event`, \"\") REGEXP \"e.*e.*t2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t2\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t2@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200775)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:39:19,817 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00228*\014shard-000000\032\022\"\00229*\014shard-000000"
  }
}

2025-12-12 12:39:19,818 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:19,818 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:19,820 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.27
2025-12-12 12:39:19,820 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:19,821 - DEBUG - ya.test - execute: Command pid: 1701306
2025-12-12 12:39:23,628 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:23,629 - DEBUG - ya.test - _save_outputs: Command (pid 1701306) rc: 0
2025-12-12 12:39:23,629 - DEBUG - ya.test - _save_outputs: Command (pid 1701306) elapsed time (sec): 3.806819438934326
2025-12-12 12:39:23,629 - DEBUG - ya.test - _save_outputs: Command (pid 1701306) wtime: 3.808
2025-12-12 12:39:23,629 - DEBUG - ya.test - _save_outputs: Command (pid 1701306) output:
None
2025-12-12 12:39:23,629 - DEBUG - ya.test - _save_outputs: Command (pid 1701306) errors:
2025-12-12T12:39:19.840816Z :INFO: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Starting read session
2025-12-12T12:39:19.840877Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:19.841354Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:19.841368Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:19.841374Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:19.846814Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] Successfully connected. Initializing session
2025-12-12T12:39:19.847967Z :INFO: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] Server session id: test_filters_optional_field_consumer_1_57_4831044020351542512_v1
2025-12-12T12:39:19.848076Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:19.849275Z :INFO: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:20.842262Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:14
2025-12-12T12:39:20.842301Z :INFO: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:23.528503Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:23.528585Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (14-14)
2025-12-12T12:39:23.528638Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (14-14)
2025-12-12T12:39:23.528767Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] Commit offsets [14, 15). Partition stream id: 1
2025-12-12T12:39:23.528888Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:23.530982Z :DEBUG: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:23.531173Z :INFO: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:23.531222Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:14:15
2025-12-12T12:39:23.531236Z :INFO: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3690 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:23.531481Z :NOTICE: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:23.531726Z :INFO: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:23.531748Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:14:15
2025-12-12T12:39:23.531772Z :INFO: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3690 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:23.531780Z :NOTICE: [local] [local] [8281ed48-8930e0db-f42e7739-b6bcba83] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:23,630 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:23,648 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:23,657 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpjjm1tlvd0qm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543158
        nanos: 97811000
      }
      modified_at {
        seconds: 1765543163
        nanos: 642612000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543158
      nanos: 323000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpjjm1ptf435c-ptqudq7tpjjm1tlvd0qm"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543158
      nanos: 97811000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (COALESCE(`event`, \"\") REGEXP \"e.*e.*t2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t2\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t2@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200775)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:39:24,167 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:24,676 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpjjm1tlvd0qm"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543158
        nanos: 97811000
      }
      modified_at {
        seconds: 1765543163
        nanos: 642612000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543158
      nanos: 323000000
    }
    finished_at {
      seconds: 1765543164
      nanos: 454000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpjjm1ptf435c-ptqudq7tpjjm1tlvd0qm"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543158
      nanos: 97811000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP @@e.*e.*t2@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (COALESCE(`event`, \"\") REGEXP \"e.*e.*t2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"86ms\",\"count\":1,\"avg\":\"86ms\",\"max\":\"86ms\",\"min\":\"86ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t2\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t2@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\")))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200775)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:39:24,711 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:24,711 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "8e50f6d6-d425-4d77-95ac-d2a456043a27"

2025-12-12 12:39:24,726 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tpd9n2dk9jrg8"

2025-12-12 12:39:24,734 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpd9n2dk9jrg8"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543164
        nanos: 715893000
      }
      modified_at {
        seconds: 1765543164
        nanos: 715893000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpd9n28p4mi3s-ptqudq7tpd9n2dk9jrg8"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543164
      nanos: 715893000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
    syntax: YQL_V1
  }
}

2025-12-12 12:39:25,243 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpd9n2dk9jrg8"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543164
        nanos: 715893000
      }
      modified_at {
        seconds: 1765543164
        nanos: 715893000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543164
      nanos: 813000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpd9n28p4mi3s-ptqudq7tpd9n2dk9jrg8"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543164
      nanos: 715893000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (COALESCE(`event`, \"\") REGEXP \"e.*e.*t1\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"\\n3\\n1b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t1\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t1@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Not (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\"))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200794)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:39:25,350 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00230*\014shard-000000\032\022\"\00231*\014shard-000000"
  }
}

2025-12-12 12:39:25,350 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:25,351 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:25,352 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.28
2025-12-12 12:39:25,352 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:25,353 - DEBUG - ya.test - execute: Command pid: 1705256
2025-12-12 12:39:30,071 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:30,083 - DEBUG - ya.test - _save_outputs: Command (pid 1705256) rc: 0
2025-12-12 12:39:30,083 - DEBUG - ya.test - _save_outputs: Command (pid 1705256) elapsed time (sec): 4.729860305786133
2025-12-12 12:39:30,084 - DEBUG - ya.test - _save_outputs: Command (pid 1705256) wtime: 4.731
2025-12-12 12:39:30,084 - DEBUG - ya.test - _save_outputs: Command (pid 1705256) output:
None
2025-12-12 12:39:30,084 - DEBUG - ya.test - _save_outputs: Command (pid 1705256) errors:
2025-12-12T12:39:25.372833Z :INFO: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Starting read session
2025-12-12T12:39:25.372874Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:25.373341Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:25.373352Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:25.373359Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:25.378681Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] Successfully connected. Initializing session
2025-12-12T12:39:25.380034Z :INFO: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] Server session id: test_filters_optional_field_consumer_1_59_7022885786786124465_v1
2025-12-12T12:39:25.380132Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:25.381528Z :INFO: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:26.374274Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:15
2025-12-12T12:39:26.374321Z :INFO: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:29.996325Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:29.996415Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (15-15)
2025-12-12T12:39:29.996474Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (15-15)
2025-12-12T12:39:29.996586Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] Commit offsets [15, 16). Partition stream id: 1
2025-12-12T12:39:29.996688Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:29.999806Z :DEBUG: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:30.000080Z :INFO: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:30.000101Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:15:16
2025-12-12T12:39:30.000110Z :INFO: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4627 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:30.000626Z :NOTICE: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:30.003130Z :INFO: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:30.003146Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:15:16
2025-12-12T12:39:30.003178Z :INFO: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4630 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:30.003191Z :NOTICE: [local] [local] [e81340-1c4c2a55-2def5f7e-c3eaa23c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:30,084 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:30,104 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:30,113 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpd9n2dk9jrg8"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543164
        nanos: 715893000
      }
      modified_at {
        seconds: 1765543170
        nanos: 98630000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543164
      nanos: 813000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpd9n28p4mi3s-ptqudq7tpd9n2dk9jrg8"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543164
      nanos: 715893000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (COALESCE(`event`, \"\") REGEXP \"e.*e.*t1\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"\\n3\\n1b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t1\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t1@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Not (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\"))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200794)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:39:30,631 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:31,144 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tpd9n2dk9jrg8"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543164
        nanos: 715893000
      }
      modified_at {
        seconds: 1765543170
        nanos: 98630000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543164
      nanos: 813000000
    }
    finished_at {
      seconds: 1765543170
      nanos: 914000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tpd9n28p4mi3s-ptqudq7tpd9n2dk9jrg8"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543164
      nanos: 715893000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' NOT REGEXP @@e.*e.*t1@@"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (NOT (COALESCE(`event`, \"\") REGEXP \"e.*e.*t1\"))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"84ms\",\"count\":1,\"avg\":\"84ms\",\"max\":\"84ms\",\"min\":\"84ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $10 \'(\'\"SharedReading\" \'\"1\"))\n(let $11 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $12 \'($9 $10 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $11))\n(let $13 (SecureParam \'\"cluster:default_yds\"))\n(let $14 (DqPqTopicSource $1 $8 \'(\'\"event\" \'\"time\") $12 $13 \'\"\\n3\\n1b/\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x13\\n\\x11\\n\\x03\\b\\x81 \\x12\\nB\\be.*e.*t1\" $7 \'\"\"))\n(let $15 (DataSink \'\"pq\" \'\"yds\"))\n(let $16 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $17 (DqPqTopicSink $16 \'($9 $11) $13))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $14)) (lambda \'($18) (block \'(\n  (let $19 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($10))))\n  (let $20 (DqSourceWideWrap $18 $2 $7 $19))\n  (return (FlatMap (NarrowMap $20 (lambda \'($21 $22) (AsStruct \'(\'\"event\" $21) \'(\'\"time\" $22)))) (lambda \'($23) (block \'(\n    (let $24 \'@@e.*e.*t1@@)\n    (let $25 (DataType \'Bool))\n    (let $26 (OptionalType (StructType \'(\'\"CaseSensitive\" $25) \'(\'\"DotNl\" $25) \'(\'\"Literal\" $25) \'(\'\"LogErrors\" $25) \'(\'\"LongestMatch\" $25) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $25) \'(\'\"NeverNl\" $25) \'(\'\"OneLine\" $25) \'(\'\"PerlClasses\" $25) \'(\'\"PosixSyntax\" $25) \'(\'\"Utf8\" $25) \'(\'\"WordBoundary\" $25))))\n    (let $27 (CallableType \'() \'($25) \'($5)))\n    (let $28 (Udf \'\"Re2.Grep\" \'((String $24) (Nothing $26)) (VoidType) \'\"\" $27 (TupleType $4 $26) \'\"\" \'()))\n    (return (OptionalIf (Not (Apply $28 (Just (Coalesce (Member $23 \'\"event\") (String \'\"\"))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $23 \'\"time\") $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200794)) \'((DqSink \'\"0\" $15 $17))))) $15))\n)\n"
  }
}

2025-12-12 12:39:31,183 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:31,184 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "f69a8a92-e54a-42d7-b781-3b53b53ae90d"

2025-12-12 12:39:31,207 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tp742rjjq9ap3"

2025-12-12 12:39:31,217 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tp742rjjq9ap3"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543171
        nanos: 191861000
      }
      modified_at {
        seconds: 1765543171
        nanos: 191861000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tp742rdb0qiqe-ptqudq7tp742rjjq9ap3"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543171
      nanos: 191861000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
    syntax: YQL_V1
  }
}

2025-12-12 12:39:31,728 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tp742rjjq9ap3"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543171
        nanos: 191861000
      }
      modified_at {
        seconds: 1765543171
        nanos: 191861000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543171
      nanos: 325000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tp742rdb0qiqe-ptqudq7tp742rjjq9ap3"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543171
      nanos: 191861000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((COALESCE(`event`, \"\") REGEXP COALESCE(`data`, \"\")) OR (`time` = 102))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $10 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $11 \'(\'\"SharedReading\" \'\"1\"))\n(let $12 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $13 \'($10 $11 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $12))\n(let $14 (SecureParam \'\"cluster:default_yds\"))\n(let $15 \'\"\\x1AT\\n5b3\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x17*\\x15\\n\\x06\\x12\\x04data\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\")\n(let $16 (DqPqTopicSource $1 $8 $9 $13 $14 $15 $7 \'\"\"))\n(let $17 (DataSink \'\"pq\" \'\"yds\"))\n(let $18 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $19 (DqPqTopicSink $18 \'($10 $12) $14))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $16)) (lambda \'($20) (block \'(\n  (let $21 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($11))))\n  (let $22 (DqSourceWideWrap $20 $2 $7 $21))\n  (return (FlatMap (NarrowMap $22 (lambda \'($23 $24 $25) (AsStruct \'(\'\"data\" $23) \'(\'\"event\" $24) \'(\'\"time\" $25)))) (lambda \'($26) (block \'(\n    (let $27 (String \'\"\"))\n    (let $28 (DataType \'Bool))\n    (let $29 (OptionalType (StructType \'(\'\"CaseSensitive\" $28) \'(\'\"DotNl\" $28) \'(\'\"Literal\" $28) \'(\'\"LogErrors\" $28) \'(\'\"LongestMatch\" $28) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $28) \'(\'\"NeverNl\" $28) \'(\'\"OneLine\" $28) \'(\'\"PerlClasses\" $28) \'(\'\"PosixSyntax\" $28) \'(\'\"Utf8\" $28) \'(\'\"WordBoundary\" $28))))\n    (let $30 (CallableType \'() \'($28) \'($5)))\n    (let $31 (Udf \'\"Re2.Grep\" \'((Coalesce (Member $26 \'\"data\") $27) (Nothing $29)) (VoidType) \'\"\" $30 (TupleType $4 $29) \'\"\" \'()))\n    (let $32 (Member $26 \'\"time\"))\n    (return (OptionalIf (Or (Apply $31 (Just (Coalesce (Member $26 \'\"event\") $27))) (== $32 (Int32 \'\"102\"))) (AsStruct \'(\'\"column0\" (SafeCast $32 $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200926)) \'((DqSink \'\"0\" $17 $19))))) $17))\n)\n"
  }
}

2025-12-12 12:39:32,949 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00232*\014shard-000000\032\022\"\00233*\014shard-000000"
  }
}

2025-12-12 12:39:32,949 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:32,950 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:32,953 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.29
2025-12-12 12:39:32,953 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:32,956 - DEBUG - ya.test - execute: Command pid: 1710758
2025-12-12 12:39:36,672 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:36,673 - DEBUG - ya.test - _save_outputs: Command (pid 1710758) rc: 0
2025-12-12 12:39:36,673 - DEBUG - ya.test - _save_outputs: Command (pid 1710758) elapsed time (sec): 3.7108027935028076
2025-12-12 12:39:36,673 - DEBUG - ya.test - _save_outputs: Command (pid 1710758) wtime: 3.717
2025-12-12 12:39:36,675 - DEBUG - ya.test - _save_outputs: Command (pid 1710758) output:
None
2025-12-12 12:39:36,675 - DEBUG - ya.test - _save_outputs: Command (pid 1710758) errors:
2025-12-12T12:39:32.975066Z :INFO: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Starting read session
2025-12-12T12:39:32.976123Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:32.976750Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:32.979872Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:32.979894Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:32.985264Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] Successfully connected. Initializing session
2025-12-12T12:39:32.986446Z :INFO: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] Server session id: test_filters_optional_field_consumer_1_61_13282101570203714169_v1
2025-12-12T12:39:32.987574Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:32.988091Z :INFO: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:33.977299Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:16
2025-12-12T12:39:33.977334Z :INFO: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1002 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:36.562615Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:36.563447Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (16-16)
2025-12-12T12:39:36.563499Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (16-16)
2025-12-12T12:39:36.563642Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] Commit offsets [16, 17). Partition stream id: 1
2025-12-12T12:39:36.563759Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:36.566439Z :DEBUG: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:36.567135Z :INFO: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:36.567166Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:16:17
2025-12-12T12:39:36.567178Z :INFO: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3592 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:36.567430Z :NOTICE: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:36.570793Z :INFO: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:36.570810Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:16:17
2025-12-12T12:39:36.570831Z :INFO: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3595 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:36.570845Z :NOTICE: [local] [local] [6aa981c6-f66d771-54e9601-70fc6cb8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:36,679 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:36,708 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:36,716 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tp742rjjq9ap3"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543171
        nanos: 191861000
      }
      modified_at {
        seconds: 1765543176
        nanos: 702304000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543171
      nanos: 325000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tp742rdb0qiqe-ptqudq7tp742rjjq9ap3"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543171
      nanos: 191861000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((COALESCE(`event`, \"\") REGEXP COALESCE(`data`, \"\")) OR (`time` = 102))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $10 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $11 \'(\'\"SharedReading\" \'\"1\"))\n(let $12 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $13 \'($10 $11 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $12))\n(let $14 (SecureParam \'\"cluster:default_yds\"))\n(let $15 \'\"\\x1AT\\n5b3\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x17*\\x15\\n\\x06\\x12\\x04data\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\")\n(let $16 (DqPqTopicSource $1 $8 $9 $13 $14 $15 $7 \'\"\"))\n(let $17 (DataSink \'\"pq\" \'\"yds\"))\n(let $18 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $19 (DqPqTopicSink $18 \'($10 $12) $14))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $16)) (lambda \'($20) (block \'(\n  (let $21 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($11))))\n  (let $22 (DqSourceWideWrap $20 $2 $7 $21))\n  (return (FlatMap (NarrowMap $22 (lambda \'($23 $24 $25) (AsStruct \'(\'\"data\" $23) \'(\'\"event\" $24) \'(\'\"time\" $25)))) (lambda \'($26) (block \'(\n    (let $27 (String \'\"\"))\n    (let $28 (DataType \'Bool))\n    (let $29 (OptionalType (StructType \'(\'\"CaseSensitive\" $28) \'(\'\"DotNl\" $28) \'(\'\"Literal\" $28) \'(\'\"LogErrors\" $28) \'(\'\"LongestMatch\" $28) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $28) \'(\'\"NeverNl\" $28) \'(\'\"OneLine\" $28) \'(\'\"PerlClasses\" $28) \'(\'\"PosixSyntax\" $28) \'(\'\"Utf8\" $28) \'(\'\"WordBoundary\" $28))))\n    (let $30 (CallableType \'() \'($28) \'($5)))\n    (let $31 (Udf \'\"Re2.Grep\" \'((Coalesce (Member $26 \'\"data\") $27) (Nothing $29)) (VoidType) \'\"\" $30 (TupleType $4 $29) \'\"\" \'()))\n    (let $32 (Member $26 \'\"time\"))\n    (return (OptionalIf (Or (Apply $31 (Just (Coalesce (Member $26 \'\"event\") $27))) (== $32 (Int32 \'\"102\"))) (AsStruct \'(\'\"column0\" (SafeCast $32 $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200926)) \'((DqSink \'\"0\" $17 $19))))) $17))\n)\n"
  }
}

2025-12-12 12:39:37,227 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:37,738 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tp742rjjq9ap3"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543171
        nanos: 191861000
      }
      modified_at {
        seconds: 1765543176
        nanos: 702304000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543171
      nanos: 325000000
    }
    finished_at {
      seconds: 1765543177
      nanos: 473000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tp742rdb0qiqe-ptqudq7tp742rjjq9ap3"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543171
      nanos: 191861000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  event ?? \'\' REGEXP data ?? \'\' OR time = 102"
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: ((COALESCE(`event`, \"\") REGEXP COALESCE(`data`, \"\")) OR (`time` = 102))"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.10s\",\"count\":1,\"avg\":\"0.10s\",\"max\":\"0.10s\",\"min\":\"0.10s\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (OptionalType $4))\n(let $6 (DataType \'Uint64))\n(let $7 (StructType \'(\'\"data\" $5) \'(\'\"event\" $5) \'(\'\"time\" $6)))\n(let $8 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $7))\n(let $9 \'(\'\"data\" \'\"event\" \'\"time\"))\n(let $10 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $11 \'(\'\"SharedReading\" \'\"1\"))\n(let $12 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $13 \'($10 $11 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $12))\n(let $14 (SecureParam \'\"cluster:default_yds\"))\n(let $15 \'\"\\x1AT\\n5b3\\n\\x18*\\x16\\n\\a\\x12\\x05event\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\x12\\x17*\\x15\\n\\x06\\x12\\x04data\\n\\v\\n\\t\\n\\x03\\b\\x81 \\x12\\x02B\\x00\\n\\x1BB\\x19\\b\\x03\\x12\\x06\\x12\\x04time\\x1A\\r\\n\\v\\n\\x02\\b\\x01\\x12\\x05\\x15f\\x00\\x00\\x00\")\n(let $16 (DqPqTopicSource $1 $8 $9 $13 $14 $15 $7 \'\"\"))\n(let $17 (DataSink \'\"pq\" \'\"yds\"))\n(let $18 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $19 (DqPqTopicSink $18 \'($10 $12) $14))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $16)) (lambda \'($20) (block \'(\n  (let $21 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($11))))\n  (let $22 (DqSourceWideWrap $20 $2 $7 $21))\n  (return (FlatMap (NarrowMap $22 (lambda \'($23 $24 $25) (AsStruct \'(\'\"data\" $23) \'(\'\"event\" $24) \'(\'\"time\" $25)))) (lambda \'($26) (block \'(\n    (let $27 (String \'\"\"))\n    (let $28 (DataType \'Bool))\n    (let $29 (OptionalType (StructType \'(\'\"CaseSensitive\" $28) \'(\'\"DotNl\" $28) \'(\'\"Literal\" $28) \'(\'\"LogErrors\" $28) \'(\'\"LongestMatch\" $28) \'(\'\"MaxMem\" $6) \'(\'\"NeverCapture\" $28) \'(\'\"NeverNl\" $28) \'(\'\"OneLine\" $28) \'(\'\"PerlClasses\" $28) \'(\'\"PosixSyntax\" $28) \'(\'\"Utf8\" $28) \'(\'\"WordBoundary\" $28))))\n    (let $30 (CallableType \'() \'($28) \'($5)))\n    (let $31 (Udf \'\"Re2.Grep\" \'((Coalesce (Member $26 \'\"data\") $27) (Nothing $29)) (VoidType) \'\"\" $30 (TupleType $4 $29) \'\"\" \'()))\n    (let $32 (Member $26 \'\"time\"))\n    (return (OptionalIf (Or (Apply $31 (Just (Coalesce (Member $26 \'\"event\") $27))) (== $32 (Int32 \'\"102\"))) (AsStruct \'(\'\"column0\" (SafeCast $32 $4)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200926)) \'((DqSink \'\"0\" $17 $19))))) $17))\n)\n"
  }
}

2025-12-12 12:39:37,772 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:37,772 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "c9c22036-9c87-4dc2-af3e-a992e960247b"

2025-12-12 12:39:37,786 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tp0r4cvvdahju"

2025-12-12 12:39:37,796 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tp0r4cvvdahju"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543177
        nanos: 776680000
      }
      modified_at {
        seconds: 1765543177
        nanos: 776680000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tp0r4cnttcap3-ptqudq7tp0r4cvvdahju"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543177
      nanos: 776680000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
}

2025-12-12 12:39:38,308 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tp0r4cvvdahju"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543177
        nanos: 776680000
      }
      modified_at {
        seconds: 1765543177
        nanos: 776680000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543177
      nanos: 820000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tp0r4cnttcap3-ptqudq7tp0r4cvvdahju"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543177
      nanos: 776680000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (IF((`nested` IS NOT NULL), CAST(`nested` AS String), NULL) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b=\\n\'2%\\n\\f:\\n\\n\\b\\x12\\x06nested\\x12\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x1A\\x02\\\"\\x00\\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (FlatMap (Member $22 \'\"nested\") (lambda \'($27) (Just (ToBytes $27))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200774)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:39:38,428 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00234*\014shard-000000\032\022\"\00235*\014shard-000000"
  }
}

2025-12-12 12:39:38,428 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:38,431 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:38,436 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.30
2025-12-12 12:39:38,436 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:38,437 - DEBUG - ya.test - execute: Command pid: 1714286
2025-12-12 12:39:43,148 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:43,148 - DEBUG - ya.test - _save_outputs: Command (pid 1714286) rc: 0
2025-12-12 12:39:43,149 - DEBUG - ya.test - _save_outputs: Command (pid 1714286) elapsed time (sec): 4.7088401317596436
2025-12-12 12:39:43,149 - DEBUG - ya.test - _save_outputs: Command (pid 1714286) wtime: 4.712
2025-12-12 12:39:43,149 - DEBUG - ya.test - _save_outputs: Command (pid 1714286) output:
None
2025-12-12 12:39:43,149 - DEBUG - ya.test - _save_outputs: Command (pid 1714286) errors:
2025-12-12T12:39:38.456301Z :INFO: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Starting read session
2025-12-12T12:39:38.456345Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:38.456776Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:38.456790Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:38.456797Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:38.462568Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] Successfully connected. Initializing session
2025-12-12T12:39:38.465668Z :INFO: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] Server session id: test_filters_optional_field_consumer_1_63_11117614085126768138_v1
2025-12-12T12:39:38.465776Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:38.469257Z :INFO: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:39.457232Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:17
2025-12-12T12:39:39.457269Z :INFO: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:43.019602Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:43.019694Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (17-17)
2025-12-12T12:39:43.019743Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (17-17)
2025-12-12T12:39:43.019847Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] Commit offsets [17, 18). Partition stream id: 1
2025-12-12T12:39:43.019960Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:43.022940Z :DEBUG: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:43.023111Z :INFO: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:43.023138Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:17:18
2025-12-12T12:39:43.023151Z :INFO: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4566 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:43.023419Z :NOTICE: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:43.023536Z :INFO: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:43.023548Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:17:18
2025-12-12T12:39:43.023576Z :INFO: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4567 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:43.023585Z :NOTICE: [local] [local] [5e4b46cf-dbac332f-7155006a-544c524d] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:43,150 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:43,169 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:43,178 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tp0r4cvvdahju"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543177
        nanos: 776680000
      }
      modified_at {
        seconds: 1765543183
        nanos: 164305000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543177
      nanos: 820000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tp0r4cnttcap3-ptqudq7tp0r4cvvdahju"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543177
      nanos: 776680000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (IF((`nested` IS NOT NULL), CAST(`nested` AS String), NULL) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b=\\n\'2%\\n\\f:\\n\\n\\b\\x12\\x06nested\\x12\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x1A\\x02\\\"\\x00\\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (FlatMap (Member $22 \'\"nested\") (lambda \'($27) (Just (ToBytes $27))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200774)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:39:43,607 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-12 12:39:43,607 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:39:43,612 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-12 12:39:43,613 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, d59f31d6-aaa3-4a0f-93c2-ca23d187bc3b, localhost:63390): creating call state
2025-12-12 12:39:43,615 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, d59f31d6-aaa3-4a0f-93c2-ca23d187bc3b, localhost:63390): request = { database: "local" }
2025-12-12 12:39:43,618 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, d59f31d6-aaa3-4a0f-93c2-ca23d187bc3b, localhost:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-fhkyrtz6p4.auto.internal" port: 63390 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-12 12:39:43,618 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-fhkyrtz6p4.auto.internal:63390, location 1, ssl: False>]>
2025-12-12 12:39:43,618 - INFO - ydb.connection - close: Closing channel for endpoint localhost:63390
2025-12-12 12:39:43,689 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:44,200 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tp0r4cvvdahju"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543177
        nanos: 776680000
      }
      modified_at {
        seconds: 1765543183
        nanos: 164305000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543177
      nanos: 820000000
    }
    finished_at {
      seconds: 1765543183
      nanos: 937000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tp0r4cnttcap3-ptqudq7tp0r4cvvdahju"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543177
      nanos: 776680000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  nested REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (IF((`nested` IS NOT NULL), CAST(`nested` AS String), NULL) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"98ms\",\"count\":1,\"avg\":\"98ms\",\"max\":\"98ms\",\"min\":\"98ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b=\\n\'2%\\n\\f:\\n\\n\\b\\x12\\x06nested\\x12\\x11:\\x0F\\n\\b\\x12\\x06nested\\x12\\x03\\b\\x81 \\x1A\\x02\\\"\\x00\\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (CallableType \'() \'($23) \'((OptionalType $13))))\n    (let $26 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $25 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $26 (FlatMap (Member $22 \'\"nested\") (lambda \'($27) (Just (ToBytes $27))))) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200774)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:39:44,241 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:44,243 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "dbe14a45-a515-4adc-8e64-559ab8df3a32"

2025-12-12 12:39:44,267 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7toqlh5rggjn1a"

2025-12-12 12:39:44,277 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7toqlh5rggjn1a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543184
        nanos: 251670000
      }
      modified_at {
        seconds: 1765543184
        nanos: 251670000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7toqlh5l62g99h-ptqudq7toqlh5rggjn1a"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543184
      nanos: 251670000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
}

2025-12-12 12:39:44,793 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7toqlh5rggjn1a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543184
        nanos: 251670000
      }
      modified_at {
        seconds: 1765543184
        nanos: 251670000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543184
      nanos: 340000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7toqlh5l62g99h-ptqudq7toqlh5rggjn1a"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543184
      nanos: 251670000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 177
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 177
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 162
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 167
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 167
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: FlatMap, At lambda, At function: OptionalIf"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 177
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 177
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 162
            }
            message: "At function: Map, At lambda, At function: SafeCast"
            end_position {
              row: 5
              column: 162
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 5
                column: 162
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String?) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b,\\n\\x16:\\x14\\n\\b\\x12\\x06nested\\x12\\b\\xAA\\x06\\x05\\n\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (OptionalType $13))\n    (let $26 (CallableType \'() \'($23) \'($25)))\n    (let $27 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $26 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $27 (SafeCast (Member $22 \'\"nested\") $25)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200742)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:39:45,994 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00236*\014shard-000000\032\022\"\00237*\014shard-000000"
  }
}

2025-12-12 12:39:45,995 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:45,995 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:45,997 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.31
2025-12-12 12:39:45,997 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:45,998 - DEBUG - ya.test - execute: Command pid: 1718274
2025-12-12 12:39:49,605 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:49,605 - DEBUG - ya.test - _save_outputs: Command (pid 1718274) rc: 0
2025-12-12 12:39:49,605 - DEBUG - ya.test - _save_outputs: Command (pid 1718274) elapsed time (sec): 3.6067347526550293
2025-12-12 12:39:49,606 - DEBUG - ya.test - _save_outputs: Command (pid 1718274) wtime: 3.608
2025-12-12 12:39:49,606 - DEBUG - ya.test - _save_outputs: Command (pid 1718274) output:
None
2025-12-12 12:39:49,606 - DEBUG - ya.test - _save_outputs: Command (pid 1718274) errors:
2025-12-12T12:39:46.018854Z :INFO: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Starting read session
2025-12-12T12:39:46.018904Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:46.019436Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:46.019452Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:46.019459Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:46.028617Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] Successfully connected. Initializing session
2025-12-12T12:39:46.030291Z :INFO: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] Server session id: test_filters_optional_field_consumer_1_65_9602791033711815509_v1
2025-12-12T12:39:46.030402Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:46.035818Z :INFO: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:47.020260Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:18
2025-12-12T12:39:47.021035Z :INFO: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:49.571105Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:49.571199Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (18-18)
2025-12-12T12:39:49.571247Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (18-18)
2025-12-12T12:39:49.571360Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] Commit offsets [18, 19). Partition stream id: 1
2025-12-12T12:39:49.571458Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:49.574245Z :DEBUG: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:49.574415Z :INFO: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:49.574457Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:18:19
2025-12-12T12:39:49.574469Z :INFO: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3555 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:49.574698Z :NOTICE: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:49.574812Z :INFO: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:49.574824Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:18:19
2025-12-12T12:39:49.574843Z :INFO: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3556 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:49.574853Z :NOTICE: [local] [local] [777b5bc1-a8b614ba-83977b47-e49afe7f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:49,607 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:49,627 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:49,637 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7toqlh5rggjn1a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543184
        nanos: 251670000
      }
      modified_at {
        seconds: 1765543189
        nanos: 621392000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543184
      nanos: 340000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7toqlh5l62g99h-ptqudq7toqlh5rggjn1a"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543184
      nanos: 251670000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 177
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 177
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 162
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 167
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 167
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: FlatMap, At lambda, At function: OptionalIf"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 177
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 177
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 162
            }
            message: "At function: Map, At lambda, At function: SafeCast"
            end_position {
              row: 5
              column: 162
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 5
                column: 162
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String?) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b,\\n\\x16:\\x14\\n\\b\\x12\\x06nested\\x12\\b\\xAA\\x06\\x05\\n\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (OptionalType $13))\n    (let $26 (CallableType \'() \'($23) \'($25)))\n    (let $27 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $26 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $27 (SafeCast (Member $22 \'\"nested\") $25)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200742)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:39:50,155 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:50,665 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7toqlh5rggjn1a"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543184
        nanos: 251670000
      }
      modified_at {
        seconds: 1765543189
        nanos: 621392000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543184
      nanos: 340000000
    }
    finished_at {
      seconds: 1765543190
      nanos: 476000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7toqlh5l62g99h-ptqudq7toqlh5rggjn1a"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543184
      nanos: 251670000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE  CAST(nested AS String) REGEXP \".*abc.*\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Type annotation"
    issue_code: 1030
    severity: 2
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At function: RemoveSystemMembers"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: PersistableRepr, At function: SqlProject"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 141
          }
          message: "At function: Filter, At lambda, At function: Coalesce"
          end_position {
            row: 5
            column: 141
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 177
            }
            message: "At function: Apply"
            end_position {
              row: 5
              column: 177
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "At function: SafeCast"
              end_position {
                row: 5
                column: 162
              }
              severity: 2
              issues {
                position {
                  row: 5
                  column: 167
                }
                message: "Consider using ToBytes to get internal representation of Json type"
                end_position {
                  row: 5
                  column: 167
                }
                issue_code: 1100
                severity: 2
              }
            }
          }
        }
      }
    }
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 3
        column: 29
      }
      message: "At tuple"
      end_position {
        row: 3
        column: 29
      }
      severity: 2
      issues {
        position {
          row: 4
          column: 13
        }
        message: "At function: DqPhyStage, At lambda, At function: FromFlow, At function: FlatMap, At lambda, At function: OptionalIf"
        end_position {
          row: 4
          column: 13
        }
        severity: 2
        issues {
          position {
            row: 5
            column: 177
          }
          message: "At function: Apply"
          end_position {
            row: 5
            column: 177
          }
          severity: 2
          issues {
            position {
              row: 5
              column: 162
            }
            message: "At function: Map, At lambda, At function: SafeCast"
            end_position {
              row: 5
              column: 162
            }
            severity: 2
            issues {
              position {
                row: 5
                column: 162
              }
              message: "Consider using ToBytes to get internal representation of Json type"
              end_position {
                row: 5
                column: 162
              }
              issue_code: 1100
              severity: 2
            }
          }
        }
      }
    }
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: (CAST(`nested` AS String?) REGEXP \".*abc.*\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.10s\",\"count\":1,\"avg\":\"0.10s\",\"max\":\"0.10s\",\"min\":\"0.10s\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'Uint64))\n(let $5 (StructType \'(\'\"nested\" (OptionalType (DataType \'Json))) \'(\'\"time\" $4)))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"nested\" \'\"time\") $10 $11 \'\"b,\\n\\x16:\\x14\\n\\b\\x12\\x06nested\\x12\\b\\xAA\\x06\\x05\\n\\x03\\b\\x81 \\x12\\x12\\n\\x10\\n\\x03\\b\\x81 \\x12\\tB\\a.*abc.*\" $5 \'\"\"))\n(let $13 (DataType \'String))\n(let $14 (DataSink \'\"pq\" \'\"yds\"))\n(let $15 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $13))))\n(let $16 (DqPqTopicSink $15 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($17) (block \'(\n  (let $18 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $19 (DqSourceWideWrap $17 $2 $5 $18))\n  (return (FlatMap (NarrowMap $19 (lambda \'($20 $21) (AsStruct \'(\'\"nested\" $20) \'(\'\"time\" $21)))) (lambda \'($22) (block \'(\n    (let $23 (DataType \'Bool))\n    (let $24 (OptionalType (StructType \'(\'\"CaseSensitive\" $23) \'(\'\"DotNl\" $23) \'(\'\"Literal\" $23) \'(\'\"LogErrors\" $23) \'(\'\"LongestMatch\" $23) \'(\'\"MaxMem\" $4) \'(\'\"NeverCapture\" $23) \'(\'\"NeverNl\" $23) \'(\'\"OneLine\" $23) \'(\'\"PerlClasses\" $23) \'(\'\"PosixSyntax\" $23) \'(\'\"Utf8\" $23) \'(\'\"WordBoundary\" $23))))\n    (let $25 (OptionalType $13))\n    (let $26 (CallableType \'() \'($23) \'($25)))\n    (let $27 (Udf \'\"Re2.Grep\" \'((String \'\".*abc.*\") (Nothing $24)) (VoidType) \'\"\" $26 (TupleType $13 $24) \'\"\" \'()))\n    (return (OptionalIf (Apply $27 (SafeCast (Member $22 \'\"nested\") $25)) (AsStruct \'(\'\"column0\" (SafeCast (Member $22 \'\"time\") $13)))))\n  )))))\n))) \'(\'(\'\"_logical_id\" \'200742)) \'((DqSink \'\"0\" $14 $16))))) $14))\n)\n"
  }
}

2025-12-12 12:39:50,705 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:50,706 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "7fff2bb6-3659-430a-aded-168945cba5ef"

2025-12-12 12:39:50,723 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7tokgcik1n7hc7"

2025-12-12 12:39:50,733 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tokgcik1n7hc7"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543190
        nanos: 711672000
      }
      modified_at {
        seconds: 1765543190
        nanos: 711672000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tokgciglhjhau-ptqudq7tokgcik1n7hc7"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543190
      nanos: 711672000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
}

2025-12-12 12:39:51,245 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tokgcik1n7hc7"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543190
        nanos: 711672000
      }
      modified_at {
        seconds: 1765543190
        nanos: 711672000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543190
      nanos: 829000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7tokgciglhjhau-ptqudq7tokgcik1n7hc7"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543190
      nanos: 711672000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:39:51,363 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00238*\014shard-000000\032\022\"\00239*\014shard-000000"
  }
}

2025-12-12 12:39:51,364 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:51,364 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:51,367 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.32
2025-12-12 12:39:51,367 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:51,368 - DEBUG - ya.test - execute: Command pid: 1721553
2025-12-12 12:39:56,092 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:39:56,093 - DEBUG - ya.test - _save_outputs: Command (pid 1721553) rc: 0
2025-12-12 12:39:56,094 - DEBUG - ya.test - _save_outputs: Command (pid 1721553) elapsed time (sec): 4.722935199737549
2025-12-12 12:39:56,094 - DEBUG - ya.test - _save_outputs: Command (pid 1721553) wtime: 4.726
2025-12-12 12:39:56,099 - DEBUG - ya.test - _save_outputs: Command (pid 1721553) output:
None
2025-12-12 12:39:56,100 - DEBUG - ya.test - _save_outputs: Command (pid 1721553) errors:
2025-12-12T12:39:51.386063Z :INFO: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Starting read session
2025-12-12T12:39:51.386101Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:51.386541Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:51.386554Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:51.386560Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:51.392133Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] Successfully connected. Initializing session
2025-12-12T12:39:51.393843Z :INFO: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] Server session id: test_filters_optional_field_consumer_1_67_13675637166391585888_v1
2025-12-12T12:39:51.393884Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:51.395295Z :INFO: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:52.387311Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:19
2025-12-12T12:39:52.387364Z :INFO: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:55.987554Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:55.987638Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (19-19)
2025-12-12T12:39:55.987683Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (19-19)
2025-12-12T12:39:55.987809Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] Commit offsets [19, 20). Partition stream id: 1
2025-12-12T12:39:55.987902Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:39:55.990871Z :DEBUG: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:39:55.991079Z :INFO: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Closing read session. Close timeout: 5.000000s
2025-12-12T12:39:55.991525Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:19:20
2025-12-12T12:39:55.991549Z :INFO: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4605 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:39:55.991829Z :NOTICE: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:39:55.991955Z :INFO: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Closing read session. Close timeout: 0.000000s
2025-12-12T12:39:55.991967Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:19:20
2025-12-12T12:39:55.991986Z :INFO: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4605 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:39:55.991996Z :NOTICE: [local] [local] [5fede291-f65e4026-70193a45-fa4367cb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:39:56,100 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:39:56,122 - DEBUG - root - control_query: Result: 
2025-12-12 12:39:56,130 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tokgcik1n7hc7"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543190
        nanos: 711672000
      }
      modified_at {
        seconds: 1765543196
        nanos: 116204000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543190
      nanos: 829000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tokgciglhjhau-ptqudq7tokgcik1n7hc7"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543190
      nanos: 711672000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:39:56,642 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:57,152 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7tokgcik1n7hc7"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543190
        nanos: 711672000
      }
      modified_at {
        seconds: 1765543196
        nanos: 116204000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543190
      nanos: 829000000
    }
    finished_at {
      seconds: 1765543196
      nanos: 935000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7tokgciglhjhau-ptqudq7tokgcik1n7hc7"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543190
      nanos: 711672000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: StartsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"62ms\",\"count\":1,\"avg\":\"62ms\",\"max\":\"62ms\",\"min\":\"62ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\t\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StartsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:39:57,186 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:39:57,191 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "ee315a80-1d4c-4d20-8192-440e8b87bfdc"

2025-12-12 12:39:57,206 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7toeagk14hsurn"

2025-12-12 12:39:57,217 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7toeagk14hsurn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543197
        nanos: 195602000
      }
      modified_at {
        seconds: 1765543197
        nanos: 195602000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7toeagjt4g1412-ptqudq7toeagk14hsurn"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543197
      nanos: 195602000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
}

2025-12-12 12:39:57,732 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7toeagk14hsurn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543197
        nanos: 195602000
      }
      modified_at {
        seconds: 1765543197
        nanos: 195602000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543197
      nanos: 335000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7toeagjt4g1412-ptqudq7toeagk14hsurn"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543197
      nanos: 195602000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:39:58,925 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00240*\014shard-000000\032\022\"\00241*\014shard-000000"
  }
}

2025-12-12 12:39:58,926 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:39:58,927 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:39:58,929 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.33
2025-12-12 12:39:58,929 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:39:58,930 - DEBUG - ya.test - execute: Command pid: 1725766
2025-12-12 12:40:02,536 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:40:02,537 - DEBUG - ya.test - _save_outputs: Command (pid 1725766) rc: 0
2025-12-12 12:40:02,537 - DEBUG - ya.test - _save_outputs: Command (pid 1725766) elapsed time (sec): 3.6065502166748047
2025-12-12 12:40:02,538 - DEBUG - ya.test - _save_outputs: Command (pid 1725766) wtime: 3.608
2025-12-12 12:40:02,538 - DEBUG - ya.test - _save_outputs: Command (pid 1725766) output:
None
2025-12-12 12:40:02,538 - DEBUG - ya.test - _save_outputs: Command (pid 1725766) errors:
2025-12-12T12:39:58.950107Z :INFO: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Starting read session
2025-12-12T12:39:58.950166Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Starting session to cluster null (localhost:63390)
2025-12-12T12:39:58.950814Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:58.950831Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:58.950839Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:39:58.960254Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] Successfully connected. Initializing session
2025-12-12T12:39:58.961451Z :INFO: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] Server session id: test_filters_optional_field_consumer_1_69_13984182579779349425_v1
2025-12-12T12:39:58.963799Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:39:58.963963Z :INFO: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:39:59.955107Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:20
2025-12-12T12:39:59.956962Z :INFO: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1005 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:40:02.509641Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:40:02.509747Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (20-20)
2025-12-12T12:40:02.509806Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (20-20)
2025-12-12T12:40:02.509931Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] Commit offsets [20, 21). Partition stream id: 1
2025-12-12T12:40:02.510062Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:40:02.512545Z :DEBUG: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:40:02.512683Z :INFO: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Closing read session. Close timeout: 5.000000s
2025-12-12T12:40:02.512716Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:20:21
2025-12-12T12:40:02.512727Z :INFO: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3562 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:40:02.513007Z :NOTICE: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:40:02.513111Z :INFO: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Closing read session. Close timeout: 0.000000s
2025-12-12T12:40:02.513120Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:20:21
2025-12-12T12:40:02.513141Z :INFO: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3563 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:40:02.513150Z :NOTICE: [local] [local] [d21c1576-e23bd6f9-9f27280a-c4b07a0e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:40:02,538 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:40:02,561 - DEBUG - root - control_query: Result: 
2025-12-12 12:40:02,572 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7toeagk14hsurn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543197
        nanos: 195602000
      }
      modified_at {
        seconds: 1765543202
        nanos: 555731000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543197
      nanos: 335000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7toeagjt4g1412-ptqudq7toeagk14hsurn"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543197
      nanos: 195602000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:40:03,083 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:40:03,596 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7toeagk14hsurn"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543197
        nanos: 195602000
      }
      modified_at {
        seconds: 1765543202
        nanos: 555731000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543197
      nanos: 335000000
    }
    finished_at {
      seconds: 1765543203
      nanos: 452000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7toeagjt4g1412-ptqudq7toeagk14hsurn"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543197
      nanos: 195602000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: EndsWith(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"79ms\",\"count\":1,\"avg\":\"79ms\",\"max\":\"79ms\",\"min\":\"79ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\n\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (EndsWith (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:40:03,632 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:40:03,632 - DEBUG - root - create_query_impl: Request: content {
  type: STREAMING
  name: "simple"
  acl {
    visibility: PRIVATE
  }
  limits {
    execution_timeout {
    }
  }
  text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
  syntax: YQL_V1
}
execute_mode: RUN
idempotency_key: "ec68d887-73fa-4df6-b515-b279d0f2825a"

2025-12-12 12:40:03,648 - DEBUG - root - create_query_impl: Result: query_id: "ptqudq7to85u5j117r84"

2025-12-12 12:40:03,655 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7to85u5j117r84"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543203
        nanos: 637022000
      }
      modified_at {
        seconds: 1765543203
        nanos: 637022000
      }
      revision: 1
    }
    execute_mode: RUN
    status: STARTING
    last_job_query_revision: 1
    last_job_id: "ptjudq7to85u5fugcrst-ptqudq7to85u5j117r84"
    started_by: "root@builtin"
    submitted_at {
      seconds: 1765543203
      nanos: 637022000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
}

2025-12-12 12:40:04,167 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7to85u5j117r84"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543203
        nanos: 637022000
      }
      modified_at {
        seconds: 1765543203
        nanos: 637022000
      }
      revision: 1
    }
    started_at {
      seconds: 1765543203
      nanos: 833000000
    }
    execute_mode: RUN
    status: RUNNING
    last_job_query_revision: 1
    last_job_id: "ptjudq7to85u5fugcrst-ptqudq7to85u5j117r84"
    started_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543203
      nanos: 637022000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:40:04,280 - DEBUG - root - write_stream: Write topic test_filters_optional_field_input. Response: operation {
  ready: true
  status: SUCCESS
  result {
    type_url: "type.googleapis.com/Ydb.DataStreams.V1.PutRecordsResult"
    value: "\010\001\032\022\"\00242*\014shard-000000\032\022\"\00243*\014shard-000000"
  }
}

2025-12-12 12:40:04,282 - INFO - root - write_stream: Data was written to test_filters_optional_field_input: ['{"time": 101, "data": "hello1", "event": "event1", "flag": false, "field1": 5, "field2": 5, "nested": {"xyz": "key"}}', '{"time": 102, "data": "hello2", "event": "event2", "flag": true, "field1": 5, "field2": 1005, "nested": ["abc", "key"]}']
2025-12-12 12:40:04,284 - DEBUG - ya.test - get_binary: Binary was found by /home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read
2025-12-12 12:40:04,287 - DEBUG - ya.test - _get_command_output_file: Command err will be placed to pq_read.err.34
2025-12-12 12:40:04,287 - DEBUG - ya.test - execute: Executing '['/home/runner/.ya/build/build_root/jy0o/0018c1/ydb/tests/tools/pq_read/pq_read', '--endpoint', 'localhost:63390', '--database', 'local', '--topic-path', 'test_filters_optional_field_output', '--consumer-name', 'test_filters_optional_field_consumer', '--disable-cluster-discovery', '--messages-count', '1', '--timeout', '30000ms', '--commit-after-processing']' in 'None' (waiting)
2025-12-12 12:40:04,288 - DEBUG - ya.test - execute: Command pid: 1730325
2025-12-12 12:40:09,000 - DEBUG - ya.test - _wait: Process resource usage is not available as process finished before wait4 was called
2025-12-12 12:40:09,000 - DEBUG - ya.test - _save_outputs: Command (pid 1730325) rc: 0
2025-12-12 12:40:09,001 - DEBUG - ya.test - _save_outputs: Command (pid 1730325) elapsed time (sec): 4.711249351501465
2025-12-12 12:40:09,001 - DEBUG - ya.test - _save_outputs: Command (pid 1730325) wtime: 4.713
2025-12-12 12:40:09,001 - DEBUG - ya.test - _save_outputs: Command (pid 1730325) output:
None
2025-12-12 12:40:09,001 - DEBUG - ya.test - _save_outputs: Command (pid 1730325) errors:
2025-12-12T12:40:04.306703Z :INFO: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Starting read session
2025-12-12T12:40:04.306748Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Starting session to cluster null (localhost:63390)
2025-12-12T12:40:04.307213Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:40:04.307228Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:40:04.307235Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] Reconnecting session to cluster null in 0.000000s
2025-12-12T12:40:04.312556Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] Successfully connected. Initializing session
2025-12-12T12:40:04.313905Z :INFO: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] Server session id: test_filters_optional_field_consumer_1_71_9330093034349151921_v1
2025-12-12T12:40:04.314859Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:40:04.315467Z :INFO: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "". Topic: "test_filters_optional_field_output". Partition: 0. Read offset: (NULL)
2025-12-12T12:40:05.308308Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:0:21
2025-12-12T12:40:05.308357Z :INFO: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1001 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:40:08.982257Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-12-12T12:40:08.982359Z :DEBUG: [local] Decompression task done. Partition/PartitionSessionId: 0 (21-21)
2025-12-12T12:40:08.982442Z :DEBUG: [local] Take Data. Partition 0. Read: {0, 0} (21-21)
2025-12-12T12:40:08.982563Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] Commit offsets [21, 22). Partition stream id: 1
2025-12-12T12:40:08.982725Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] The application data is transferred to the client. Number of messages 1, size 3 bytes
2025-12-12T12:40:08.985400Z :DEBUG: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] [null] Committed response: cookies { assign_id: 1 partition_cookie: 1 }
Closing session. Got 1 messages
2025-12-12T12:40:08.985572Z :INFO: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Closing read session. Close timeout: 5.000000s
2025-12-12T12:40:08.985607Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:21:22
2025-12-12T12:40:08.985638Z :INFO: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4678 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
Session closed
2025-12-12T12:40:08.985975Z :NOTICE: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
Stopping driver...
Driver stopped. Exit
Session closed event: SessionClosed { Status: SUCCESS Issues: "<main>: Error: Session was gracefully closed " }
2025-12-12T12:40:08.986132Z :INFO: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Closing read session. Close timeout: 0.000000s
2025-12-12T12:40:08.986142Z :INFO: [local] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:test_filters_optional_field_output:0:1:21:22
2025-12-12T12:40:08.986163Z :INFO: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4679 BytesRead: 3 MessagesRead: 1 BytesReadCompressed: 3 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-12-12T12:40:08.986173Z :NOTICE: [local] [local] [b0cfa7be-97b863ff-240b6b4a-37378121] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }

2025-12-12 12:40:09,002 - INFO - root - read_stream: Data was read from test_filters_optional_field_output: ['102']
2025-12-12 12:40:09,018 - DEBUG - root - control_query: Result: 
2025-12-12 12:40:09,026 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7to85u5j117r84"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543203
        nanos: 637022000
      }
      modified_at {
        seconds: 1765543209
        nanos: 12682000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543203
      nanos: 833000000
    }
    execute_mode: RUN
    status: ABORTING_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7to85u5fugcrst-ptqudq7to85u5j117r84"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543203
      nanos: 637022000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:40:09,535 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:40:10,044 - DEBUG - root - describe_query: Result: query {
  meta {
    common {
      id: "ptqudq7to85u5j117r84"
      created_by: "root@builtin"
      modified_by: "root@builtin"
      created_at {
        seconds: 1765543203
        nanos: 637022000
      }
      modified_at {
        seconds: 1765543209
        nanos: 12682000
      }
      revision: 2
    }
    started_at {
      seconds: 1765543203
      nanos: 833000000
    }
    finished_at {
      seconds: 1765543209
      nanos: 933000000
    }
    execute_mode: RUN
    status: ABORTED_BY_USER
    last_job_query_revision: 1
    last_job_id: "ptjudq7to85u5fugcrst-ptqudq7to85u5j117r84"
    started_by: "root@builtin"
    aborted_by: "root@builtin"
    has_saved_checkpoints: true
    submitted_at {
      seconds: 1765543203
      nanos: 637022000
    }
  }
  content {
    type: STREAMING
    name: "simple"
    acl {
      visibility: PRIVATE
    }
    limits {
      execution_timeout {
      }
    }
    text: "\n            PRAGMA AnsiLike;\n            INSERT INTO yds.`test_filters_optional_field_output`\n            SELECT Cast(time as String) FROM yds.`test_filters_optional_field_input`\n                WITH (format=json_each_row, SCHEMA (time UInt64 NOT NULL, data String, event String, flag Bool, field1 UInt8, field2 Int64, nested Json)) WHERE event LIKE \"%event2%\""
    syntax: YQL_V1
  }
  plan {
    json: "{\"Detailed\":{\"Operations\":[{\"Id\":3,\"Name\":\"DqStage\",\"Streams\":{\"Program\":[{\"Name\":\"DqSourceWideWrap\"},{\"Name\":\"NarrowMap\"},{\"Name\":\"FlatMap\"}]}},{\"Id\":2,\"Name\":\"DqQuery!\",\"DependsOn\":[3]},{\"Id\":1,\"Name\":\"Commit!\",\"DependsOn\":[2]}],\"OperationRoot\":1,\"Providers\":[],\"OperationStats\":{\"Commit!\":1,\"DqQuery!\":1,\"DqStage\":1}},\"Basic\":{\"nodes\":[{\"id\":3,\"level\":1,\"name\":\"DqStage #3\",\"type\":\"op\"},{\"id\":2,\"level\":2,\"name\":\"DqQuery!\",\"type\":\"op\"},{\"id\":1,\"level\":3,\"name\":\"Commit!\",\"type\":\"op\"}],\"links\":[{\"source\":3,\"target\":2},{\"source\":2,\"target\":1}]}}"
  }
  issue {
    message: "ABORTED_BY_USER"
    severity: 1
  }
  transient_issue {
    message: "Execution"
    issue_code: 1060
    severity: 1
    issues {
      position {
        row: 4
        column: 13
      }
      message: "Row dispatcher will use the predicate: String::Contains(`event`, \"event2\")"
      end_position {
        row: 4
        column: 13
      }
      severity: 1
    }
  }
  statistics {
    json: "{\"Graph=0\":{\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"CpuTimeUs\":{\"sum\":\"59ms\",\"count\":1,\"avg\":\"59ms\",\"max\":\"59ms\",\"min\":\"59ms\"},\"IngressRows\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"EgressBytes\":{\"sum\":3,\"count\":1,\"avg\":3,\"max\":3,\"min\":3},\"EgressRows\":{\"sum\":7,\"count\":1,\"avg\":7,\"max\":7,\"min\":7},\"MaxMemoryUsage\":{\"sum\":196608,\"count\":1,\"avg\":196608,\"max\":196608,\"min\":196608},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0}}}"
  }
  ast {
    data: "(\n(let $1 (Configure! world (DataSource \'\"config\") \'\"DqEngine\" \'\"force\"))\n(let $2 (DataSource \'\"pq\" \'\"yds\"))\n(let $3 \'(\'(\'\"PartitionsCount\" \'\"1\")))\n(let $4 (DataType \'String))\n(let $5 (StructType \'(\'\"event\" (OptionalType $4)) \'(\'\"time\" (DataType \'Uint64))))\n(let $6 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_input\" $3 \'() $5))\n(let $7 \'(\'\"Endpoint\" \'\"localhost:63390\"))\n(let $8 \'(\'\"SharedReading\" \'\"1\"))\n(let $9 \'(\'\"AddBearerToToken\" \'\"1\"))\n(let $10 \'($7 $8 \'(\'\"ReconnectPeriod\" \'\"\") \'(\'\"Format\" \'\"json_each_row\") \'(\'\"ReadGroup\" \'\"ptcudq7tsif2mkfcjoeh\") $9))\n(let $11 (SecureParam \'\"cluster:default_yds\"))\n(let $12 (DqPqTopicSource $1 $6 \'(\'\"event\" \'\"time\") $10 $11 \'\"B\\x1E\\b\\v\\x12\\a\\x12\\x05event\\x1A\\x11\\n\\x0F\\n\\x03\\b\\x81 \\x12\\bB\\x06event2\" $5 \'\"\"))\n(let $13 (DataSink \'\"pq\" \'\"yds\"))\n(let $14 (PqTopic \'\"yds\" \'\"local\" \'\"test_filters_optional_field_output\" $3 \'() (StructType \'(\'\"Data\" $4))))\n(let $15 (DqPqTopicSink $14 \'($7 $9) $11))\n(return (Commit! (DqQuery! $1 \'((DqStage \'((DqSource $2 $12)) (lambda \'($16) (block \'(\n  (let $17 \'(\'(\'\"format\" \'\"json_each_row\") \'(\'\"formatSettings\" \'(\'(\'\"data.datetime.formatname\" \'\"POSIX\") \'(\'\"data.timestamp.formatname\" \'\"POSIX\"))) \'(\'\"settings\" \'($8))))\n  (let $18 (DqSourceWideWrap $16 $2 $5 $17))\n  (return (FlatMap (NarrowMap $18 (lambda \'($19 $20) (AsStruct \'(\'\"event\" $19) \'(\'\"time\" $20)))) (lambda \'($21) (OptionalIf (Coalesce (StringContains (Member $21 \'\"event\") (String \'\"event2\")) (Bool \'false)) (AsStruct \'(\'\"column0\" (SafeCast (Member $21 \'\"time\") $4)))))))\n))) \'(\'(\'\"_logical_id\" \'200697)) \'((DqSink \'\"0\" $13 $15))))) $13))\n)\n"
  }
}

2025-12-12 12:40:10,080 - DEBUG - root - describe_query: Result: ... (repeated, see above) ...
2025-12-12 12:40:10,086 - INFO - ya.test - pytest_runtest_teardown: Test teardown
2025-12-12 12:40:33,607 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Preparing initial endpoint to resolve endpoints
2025-12-12 12:40:33,608 - DEBUG - ydb.connection - channel_factory: Channel options: [('grpc.max_receive_message_length', 64000000), ('grpc.max_send_message_length', 64000000), ('grpc.primary_user_agent', 'python-library'), ('grpc.lb_policy_name', 'round_robin'), ('grpc.keepalive_time_ms', 1250), ('grpc.keepalive_timeout_ms', 10000), ('grpc.http2.max_pings_without_data', 0), ('grpc.keepalive_permit_without_calls', 0)]
2025-12-12 12:40:33,613 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - context_resolve: Resolving endpoints for database local
2025-12-12 12:40:33,614 - DEBUG - ydb.connection - _prepare_call: RpcState(ListEndpoints, 2dc04cd7-3c8d-4333-890d-ab3832699822, localhost:63390): creating call state
2025-12-12 12:40:33,614 - DEBUG - ydb.connection - _log_request: RpcState(ListEndpoints, 2dc04cd7-3c8d-4333-890d-ab3832699822, localhost:63390): request = { database: "local" }
2025-12-12 12:40:33,617 - DEBUG - ydb.connection - _log_response: RpcState(ListEndpoints, 2dc04cd7-3c8d-4333-890d-ab3832699822, localhost:63390): response = { operation { ready: true status: SUCCESS result { [type.googleapis.com/Ydb.Discovery.ListEndpointsResult] { endpoints { address: "ghrun-fhkyrtz6p4.auto.internal" port: 63390 service: "legacy" service: "tablet_service" service: "yql" service: "discovery" service: "cms" service: "locking" service: "kesus" service: "pq" service: "pqcd" service: "pqv1" service: "topic" service: "datastreams" service: "scripting" service: "clickhouse_internal" service: "rate_limiter" service: "analytics" service: "export" service: "import" service: "yq" service: "keyvalue" service: "monitoring" service: "auth" service: "query_service" service: "view" location: "1" node_id: 1 } self_location: "1" } } } }
2025-12-12 12:40:33,617 - DEBUG - ydb.resolver.DiscoveryEndpointsResolver - _add_debug_details: Resolved endpoints for database local: DiscoveryResult <self_location: 1, endpoints [<Endpoint ghrun-fhkyrtz6p4.auto.internal:63390, location 1, ssl: False>]>
2025-12-12 12:40:33,617 - INFO - ydb.connection - close: Closing channel for endpoint localhost:63390
2025-12-12 12:40:42,095 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:16122/1
2025-12-12 12:40:42,096 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/19168
2025-12-12 12:40:42,097 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/7970
2025-12-12 12:40:42,098 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/17320
2025-12-12 12:40:42,100 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/16122
2025-12-12 12:40:42,100 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/3637
2025-12-12 12:40:42,100 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/2763
2025-12-12 12:40:43,102 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:24055/3
2025-12-12 12:40:45,102 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:16856/2
2025-12-12 12:40:45,103 - INFO - ydb.tests.library.harness.kikimr_runner - stop: Stopped node localhost:22059/1
2025-12-12 12:40:45,107 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/7571
2025-12-12 12:40:45,111 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/2624
2025-12-12 12:40:45,111 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/22476
2025-12-12 12:40:45,111 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/24055
2025-12-12 12:40:45,112 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/21538
2025-12-12 12:40:45,118 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/18555
2025-12-12 12:40:45,118 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/2592
2025-12-12 12:40:45,118 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/16856
2025-12-12 12:40:45,118 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/65203
2025-12-12 12:40:45,118 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/24339
2025-12-12 12:40:45,119 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/25152
2025-12-12 12:40:45,119 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/22059
2025-12-12 12:40:45,119 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/22604
2025-12-12 12:40:45,119 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/5913
2025-12-12 12:40:45,119 - DEBUG - library.python.filelock - release: Ensuring FileLock released: /home/runner/.ya/build/port_sync_dir/25468
