2025-11-11T14:19:53.226531Z :GRPC_SERVER NOTICE: grpc_request_proxy.cpp:369: Grpc request proxy started, nodeid# 3, serve as static node
2025-11-11T14:19:53.226602Z :GRPC_SERVER CRIT: grpc_request_proxy.cpp:429: Failed to deliver subscription request to config dispatcher
2025-11-11T14:19:53.226606Z :GRPC_SERVER NOTICE: grpc_request_proxy.cpp:369: Grpc request proxy started, nodeid# 3, serve as static node
2025-11-11T14:19:53.226619Z :GRPC_SERVER CRIT: grpc_request_proxy.cpp:429: Failed to deliver subscription request to config dispatcher
2025-11-11T14:19:53.226786Z :FQ_LOG_UPDATER DEBUG: log.cpp:93: Updated YQL logs priority: 8
2025-11-11T14:19:53.226795Z :FQ_LOG_UPDATER CRIT: log.cpp:55: Failed to deliver subscription request to config dispatcher.
2025-11-11T14:19:53.226799Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:188: Bootstrap
2025-11-11T14:19:53.226801Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:191: Create sdk ydb connection
2025-11-11T14:19:53.226808Z :YQ_RATE_LIMITER INFO: quoter_service.cpp:124: Bootstraping with config: { Enabled: true DataPlaneEnabled: true Database { Endpoint: "localhost:11255" Database: "local" TablePrefix: "RateLimiter_0daf70c6-4121-4158-87c6-13d85e7af04f" } Limiters { CoordinationNodePath: "rate_limiter" } }
2025-11-11T14:19:53.227325Z :FQ_ROW_DISPATCHER DEBUG: row_dispatcher.cpp:534: RowDispatcher: Successfully bootstrapped row dispatcher, id [3:7571472406419904341:2063], tenant /compute
2025-11-11T14:19:53.227419Z :YQL_NODES_MANAGER INFO: nodes_manager.cpp:88: Bootstrap, InstanceId: a2d833d6-4d1c2ddb-fccdf8ad-36a4da1e
2025-11-11T14:19:53.227421Z :YQL_NODES_MANAGER DEBUG: nodes_manager.cpp:310: TNodesManagerActor::ResolveSelfAddress
2025-11-11T14:19:53.227432Z :YQ_TEST_CONNECTION DEBUG: test_connection.cpp:142: Starting yandex query test connection. Actor id: [3:7571472406419904346:2068]
2025-11-11T14:19:53.227481Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461621, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:19:53.227491Z :FQ_QUOTA_PROXY INFO: quota_proxy.cpp:90: STARTED
2025-11-11T14:19:53.228774Z :STREAMS_STORAGE_SERVICE TRACE: storage_proxy.cpp:213: Initialize
2025-11-11T14:19:53.228885Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:209: Successfully bootstrapped TStorageProxy [3:7571472406419904340:2062] with connection to localhost:11255:local
2025-11-11T14:19:53.228896Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:232: TLeaderElection [3:7571472406419904366:2083] Successfully bootstrapped, local coordinator id [3:7571472406419904365:2082], tenant id compute, local mode 0, coordination node path local/row_dispatcher/compute, endpoint localhost:11255
2025-11-11T14:19:53.229154Z :FQ_ROW_DISPATCHER DEBUG: coordinator.cpp:267: Coordinator: Successfully bootstrapped coordinator, id [3:7571472406419904365:2082], NodesManagerId [0:4705493345362661702:78]
2025-11-11T14:19:53.230488Z :FQ_QUOTA_SERVICE INFO: quota_manager.cpp:196: STARTED
2025-11-11T14:19:53.230508Z :FQ_ROW_DISPATCHER DEBUG: row_dispatcher.cpp:627: RowDispatcher: TEvCoordinatorChangesSubscribe from [3:7571472406419904365:2082]
2025-11-11T14:19:53.232064Z :FQ_ROW_DISPATCHER DEBUG: schema.cpp:71: Run create coordination node "local/row_dispatcher/compute" actor
2025-11-11T14:19:53.232072Z :FQ_ROW_DISPATCHER DEBUG: schema.cpp:113: Call create coordination node "local/row_dispatcher/compute"
2025-11-11T14:19:53.232075Z :FQ_ROW_DISPATCHER DEBUG: schema.cpp:411: Call create coordination node "local/row_dispatcher/compute"
2025-11-11T14:19:53.233978Z :MEMORY_PROFILER NOTICE: monitor.cpp:332: Bootstrapped
2025-11-11T14:19:53.263589Z :SCHEME_BOARD_SUBSCRIBER NOTICE: subscriber.cpp:849: [main][3:7571472406419904360:2077][/Root] Set up state: owner# [3:7571472406419904320:2052], state# { Deleted: 1 Strong: 0 Version: <Invalid> DomainId: <Invalid> AbandonedSchemeShards: there are 0 elements }
2025-11-11T14:19:53.263685Z :SCHEME_BOARD_SUBSCRIBER NOTICE: subscriber.cpp:849: [main][3:7571472406419904362:2079][/Root] Set up state: owner# [3:7571472406419904321:2053], state# { Deleted: 1 Strong: 0 Version: <Invalid> DomainId: <Invalid> AbandonedSchemeShards: there are 0 elements }
2025-11-11T14:19:53.263696Z :SCHEME_BOARD_SUBSCRIBER NOTICE: subscriber.cpp:849: [main][3:7571472406419904363:2080][/compute] Set up state: owner# [3:7571472406419904321:2053], state# { Deleted: 1 Strong: 0 Version: <Invalid> DomainId: <Invalid> AbandonedSchemeShards: there are 0 elements }
2025-11-11T14:19:53.263732Z :GRPC_SERVER WARN: grpc_request_proxy.cpp:572: SchemeBoardDelete /Root Strong=0
2025-11-11T14:19:53.263736Z :GRPC_SERVER WARN: grpc_request_proxy.cpp:572: SchemeBoardDelete /Root Strong=0
2025-11-11T14:19:53.265638Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:318: TNodesManagerActor::NodesHealthCheck
2025-11-11T14:19:53.266094Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:19:53.266098Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:19:53.271051Z :SCHEME_BOARD_SUBSCRIBER NOTICE: subscriber.cpp:849: [main][3:7571472406419904361:2078][/compute] Set up state: owner# [3:7571472406419904320:2052], state# { Deleted: 1 Strong: 0 Version: <Invalid> DomainId: <Invalid> AbandonedSchemeShards: there are 0 elements }
2025-11-11T14:19:53.271066Z :GRPC_SERVER WARN: grpc_request_proxy.cpp:572: SchemeBoardDelete /compute Strong=0
2025-11-11T14:19:53.271095Z :GRPC_SERVER WARN: grpc_request_proxy.cpp:572: SchemeBoardDelete /compute Strong=0
2025-11-11T14:19:53.271672Z :FQ_ROW_DISPATCHER DEBUG: schema.cpp:155: Successfully created coordination node "local/row_dispatcher/compute"
2025-11-11T14:19:53.271683Z :FQ_ROW_DISPATCHER DEBUG: schema.cpp:122: Reply for create coordination node "local/row_dispatcher/compute": { <main>: Error: Check failed: path: '/local/row_dispatcher/compute', error: path exist, request accepts it (id: [OwnerId: 72057594046678944, LocalPathId: 29], type: EPathTypeKesus, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_kesus.cpp:339 }
2025-11-11T14:19:53.271696Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:345: TLeaderElection [3:7571472406419904366:2083] Coordination node successfully created
2025-11-11T14:19:53.271700Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:323: TLeaderElection [3:7571472406419904366:2083] Start session
2025-11-11T14:19:53.283875Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:389: Send NodeInfo with size: 2 to DynamicNameserver
2025-11-11T14:19:53.297630Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:359: TLeaderElection [3:7571472406419904366:2083] Session successfully created
2025-11-11T14:19:53.302167Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:499: Checkpoint storage and state storage were successfully inited
2025-11-11T14:19:53.313364Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:372: TLeaderElection [3:7571472406419904366:2083] Semaphore successfully created
2025-11-11T14:19:53.313371Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:304: TLeaderElection [3:7571472406419904366:2083] Try to acquire semaphore
2025-11-11T14:19:53.313429Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:420: TLeaderElection [3:7571472406419904366:2083] Describe semaphore
2025-11-11T14:19:53.325519Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:469: TLeaderElection [3:7571472406419904366:2083] Semaphore successfully described: coordinator id [1:7571472397025462437:2082] generation 4
2025-11-11T14:19:53.325538Z :FQ_ROW_DISPATCHER INFO: leader_election.cpp:471: TLeaderElection [3:7571472406419904366:2083] Send TEvCoordinatorChanged to [3:7571472406419904341:2063], new coordinator id [1:7571472397025462437:2082], previous coordinator id [0:0:0]
2025-11-11T14:19:53.325562Z :FQ_ROW_DISPATCHER DEBUG: row_dispatcher.cpp:559: RowDispatcher: Coordinator changed, old leader (empty maybe), new [1:7571472397025462437:2082] generation 4
2025-11-11T14:19:53.325588Z :FQ_ROW_DISPATCHER DEBUG: coordinator.cpp:386: Coordinator: New leader [1:7571472397025462437:2082], SelfId [3:7571472406419904365:2082]
2025-11-11T14:19:53.542221Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:597: RowDispatcher: TEvUndelivered, from [1:7571472397025462437:2082], reason Disconnected
2025-11-11T14:19:54.223562Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461622, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:19:54.223591Z :FQ_ROW_DISPATCHER DEBUG: coordinator.cpp:542: Coordinator: Send TEvGetNodesRequest to NodesManager
2025-11-11T14:19:54.223830Z :YQL_NODES_MANAGER DEBUG: nodes_manager.cpp:300: TNodesManagerActor::TEvGetNodesRequest
2025-11-11T14:19:54.223838Z :FQ_ROW_DISPATCHER INFO: coordinator.cpp:573: Coordinator: Updated node info, node count: 3
2025-11-11T14:19:54.236697Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:19:54.236707Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:19:54.255618Z :FQ_QUOTA_SERVICE DEBUG: quota_manager.cpp:230: IC Peers[2]: [1, 2]
2025-11-11T14:19:55.224943Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [1:7571472397025462437:2082]
2025-11-11T14:19:55.224968Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:19:55.224985Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461623, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:19:55.238507Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:19:55.238521Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:19:56.225533Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461624, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:19:56.301134Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:19:56.301151Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:19:57.130023Z :INTERCONNECT WARN: interconnect_handshake.cpp:543: Handshake [3:7571472423599773747:2061] [node 1] ICH09 Neither CompatibilityInfo nor VersionTag of the peer can be validated, accepting by default
2025-11-11T14:19:57.225898Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [1:7571472397025462437:2082]
2025-11-11T14:19:57.225919Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:19:57.225929Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461625, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:19:57.229121Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:19:57.233222Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:19:57.233233Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:19:57.671769Z :INTERCONNECT WARN: interconnect_handshake.cpp:543: Handshake [3:7571472423599773755:2063] [node 2] ICH09 Neither CompatibilityInfo nor VersionTag of the peer can be validated, accepting by default
2025-11-11T14:19:58.226391Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461626, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:19:58.231085Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:19:58.231096Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:19:58.265571Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:318: TNodesManagerActor::NodesHealthCheck
2025-11-11T14:19:58.273845Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:389: Send NodeInfo with size: 2 to DynamicNameserver
2025-11-11T14:19:59.226832Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [1:7571472397025462437:2082]
2025-11-11T14:19:59.226843Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461627, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:19:59.226854Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:19:59.227552Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:19:59.230279Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:19:59.230299Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:00.227370Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461628, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:00.232348Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:00.232367Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:01.228594Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [1:7571472397025462437:2082]
2025-11-11T14:20:01.228607Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a461629, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:01.228621Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:20:01.229846Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:01.240323Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:01.240336Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:02.228440Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616210, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:02.232152Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:02.232165Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:03.229267Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [1:7571472397025462437:2082]
2025-11-11T14:20:03.229297Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:20:03.229319Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616211, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:03.230338Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:03.237659Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:03.237674Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:03.266541Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:318: TNodesManagerActor::NodesHealthCheck
2025-11-11T14:20:03.274822Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:389: Send NodeInfo with size: 2 to DynamicNameserver
2025-11-11T14:20:04.230101Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616212, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:04.233835Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:04.233845Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:04.518653Z :INTERCONNECT_NETWORK NOTICE: interconnect_tcp_input_session.cpp:715: [3 <-> 1] connection closed by peer
2025-11-11T14:20:04.519322Z :INTERCONNECT_NETWORK NOTICE: interconnect_handshake.cpp:1581: [3 <-> 1] network-related error occured on handshake: outgoing handshake Peer# ghrun-vb3yoermsa(127.0.1.1:17282) Couldn't connect to any resolved address
2025-11-11T14:20:04.529492Z :INTERCONNECT_NETWORK NOTICE: interconnect_handshake.cpp:1581: [3 <-> 1] network-related error occured on handshake: outgoing handshake Peer# ghrun-vb3yoermsa(127.0.1.1:17282) Couldn't connect to any resolved address
2025-11-11T14:20:04.590927Z :INTERCONNECT_NETWORK NOTICE: interconnect_handshake.cpp:1581: [3 <-> 1] network-related error occured on handshake: outgoing handshake Peer# ghrun-vb3yoermsa(127.0.1.1:17282) Couldn't connect to any resolved address
2025-11-11T14:20:04.737968Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:438: TLeaderElection [3:7571472406419904366:2083] Semaphore changed
2025-11-11T14:20:04.737980Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:420: TLeaderElection [3:7571472406419904366:2083] Describe semaphore
2025-11-11T14:20:04.738360Z :FQ_ROW_DISPATCHER DEBUG: leader_election.cpp:469: TLeaderElection [3:7571472406419904366:2083] Semaphore successfully described: coordinator id [2:7571472399481445439:2113] generation 5
2025-11-11T14:20:04.738372Z :FQ_ROW_DISPATCHER INFO: leader_election.cpp:471: TLeaderElection [3:7571472406419904366:2083] Send TEvCoordinatorChanged to [3:7571472406419904341:2063], new coordinator id [2:7571472399481445439:2113], previous coordinator id [1:7571472397025462437:2082]
2025-11-11T14:20:04.738392Z :FQ_ROW_DISPATCHER DEBUG: row_dispatcher.cpp:559: RowDispatcher: Coordinator changed, old leader [1:7571472397025462437:2082], new [2:7571472399481445439:2113] generation 5
2025-11-11T14:20:04.738422Z :FQ_ROW_DISPATCHER DEBUG: coordinator.cpp:386: Coordinator: New leader [2:7571472399481445439:2113], SelfId [3:7571472406419904365:2082]
2025-11-11T14:20:04.738933Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:04.834974Z :INTERCONNECT_NETWORK NOTICE: interconnect_handshake.cpp:1581: [3 <-> 1] network-related error occured on handshake: outgoing handshake Peer# ghrun-vb3yoermsa(127.0.1.1:17282) Couldn't connect to any resolved address
2025-11-11T14:20:05.230608Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [2:7571472399481445439:2113]
2025-11-11T14:20:05.230636Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:20:05.230661Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616213, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:05.233792Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:05.236930Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:05.236939Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:06.231004Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616214, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:06.241697Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:06.241710Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:06.682791Z :INTERCONNECT WARN: interconnect_handshake.cpp:543: Handshake [3:7571472457959512197:2069] [node 1] ICH09 Neither CompatibilityInfo nor VersionTag of the peer can be validated, accepting by default
2025-11-11T14:20:07.231465Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [2:7571472399481445439:2113]
2025-11-11T14:20:07.231473Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616215, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:07.231484Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:20:07.231779Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:07.249698Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:07.249712Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 1
2025-11-11T14:20:07.249726Z :FQ_PENDING_FETCHER DEBUG: pending_fetcher.cpp:361: NewTask: Scope: yandexcloud://my_folder Id: ptqudslmk6ath0mgbk4q UserId: root@builtin AuthToken: **** (B6C6F477)
2025-11-11T14:20:07.249901Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:375: QueryId: ptqudslmk6ath0mgbk4q Start run actor. Compute state: RUNNING
2025-11-11T14:20:07.249905Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:469: QueryId: ptqudslmk6ath0mgbk4q FillConnections
2025-11-11T14:20:07.249908Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616216, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:07.249941Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:2333: QueryId: ptqudslmk6ath0mgbk4q Run actors params: { QueryId: ptqudslmk6ath0mgbk4q CloudId: mock_cloud UserId: root@builtin Owner: c2e456c3-58156b0d-52e2332-b2a4616215 PreviousQueryRevision: 2 Connections: 1 Bindings: 0 AccountIdSignatures: 0 QueryType: STREAMING ExecuteMode: RUN ResultId: ptrudslmjrvf4jco808t StateLoadMode: FROM_LAST_CHECKPOINT StreamingDisposition: { from_last_checkpoint { } } Status: RUNNING DqGraphs: 1 DqGraphIndex: 0 Resource.TopicConsumers: 1 }
2025-11-11T14:20:07.250023Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:911: QueryId: ptqudslmk6ath0mgbk4q Overall dq tasks: 2
2025-11-11T14:20:07.250128Z :FQ_PINGER TRACE: pinger.cpp:171: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Start Pinger
2025-11-11T14:20:07.250163Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1599: QueryId: ptqudslmk6ath0mgbk4q ResultWriter was NOT CREATED since ResultType is empty
2025-11-11T14:20:07.250261Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.250 DEBUG ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] task_controller_impl.h:86: _RowsLimitPerWrite = 0
2025-11-11T14:20:07.250269Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { resources { rate_limiter: READY compilation: READY topic_consumers_state: READY rate_limiter_path: "local/RateLimiter_0daf70c6-4121-4158-87c6-13d85e7af04f/rate_limiter" topic_consumers { database: "local" topic_path: "test_group_by_hop_restart_node_input" consumer_name: "ptqudslmk6ath0mgbk4q" cluster_endpoint: "localhost:11255" token_name: "cluster:default_yds" add_bearer_to_token: true } } }
2025-11-11T14:20:07.250274Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:07.250313Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1653: QueryId: ptqudslmk6ath0mgbk4q Executer: [3:7571472466549446797:2163], Controller: [3:7571472466549446799:2165], ResultIdActor: [3:7571472466549446797:2163]
2025-11-11T14:20:07.250337Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.250 DEBUG ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] executer_actor.cpp:140: {ptqudslmk6ath0mgbk4q} TDqExecuter::OnGraph
2025-11-11T14:20:07.250348Z :YQL_PROXY INFO: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.250 INFO  ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] executer_actor.cpp:157: {ptqudslmk6ath0mgbk4q} Trying to allocate 2 workers [EnableComputeActor=1]
2025-11-11T14:20:07.251386Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.251 DEBUG ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] executer_actor.cpp:247: {ptqudslmk6ath0mgbk4q} Dq timeouts are set to: 0.000000s (global), 600.000000s (workers allocation fail), 30.000000s (workers allocation warn) 
2025-11-11T14:20:07.252034Z :YQL_NODES_MANAGER DEBUG: nodes_manager.cpp:125: TEvAllocateWorkersResponse Nodes {
  ResourceId: 4294967299
  Worker {
    NodeId: 3
    Guid: "a2d833d6-4d1c2ddb-fccdf8ad-36a4da1e,ghrun-vb3yoermsa"
  }
  Worker {
    NodeId: 1
    Guid: "f2c6c534-4c0a8d53-b04a8a86-dc0f5e3b,ghrun-vb3yoermsa"
  }
}
2025-11-11T14:20:07.252097Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] resource_allocator.cpp:141: {ptqudslmk6ath0mgbk4q/[3:7571472466549446800:2166]} TEvAllocateWorkersResponse 3
2025-11-11T14:20:07.252107Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] resource_allocator.cpp:106: {ptqudslmk6ath0mgbk4q/[3:7571472466549446800:2166]} RequestActorIdsFromNodes 3
2025-11-11T14:20:07.252115Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] resource_allocator.cpp:115: {ptqudslmk6ath0mgbk4q/[3:7571472466549446800:2166]} RequestActorIdsFromNodes 3 4294967299
2025-11-11T14:20:07.252122Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] resource_allocator.cpp:119: {ptqudslmk6ath0mgbk4q/[3:7571472466549446800:2166]} RequestedNode: 3
2025-11-11T14:20:07.252142Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] resource_allocator.cpp:119: {ptqudslmk6ath0mgbk4q/[3:7571472466549446800:2166]} RequestedNode: 1
2025-11-11T14:20:07.252161Z :YQL_PROXY WARN: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 WARN  ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] resource_allocator.cpp:259: {ptqudslmk6ath0mgbk4q/[3:7571472466549446800:2166]} Send TEvAllocateWorkersRequest to Id:a2d833d6-4d1c2ddb-fccdf8ad-36a4da1e,ghrun-vb3yoermsa,NodeId:3,
2025-11-11T14:20:07.252178Z :YQL_PROXY WARN: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 WARN  ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] resource_allocator.cpp:259: {ptqudslmk6ath0mgbk4q/[3:7571472466549446800:2166]} Send TEvAllocateWorkersRequest to Id:f2c6c534-4c0a8d53-b04a8a86-dc0f5e3b,ghrun-vb3yoermsa,NodeId:1,
2025-11-11T14:20:07.252204Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] local_worker_manager.cpp:316: {ptqudslmk6ath0mgbk4q} TLocalWorkerManager::TEvAllocateWorkersRequest 281479271677955
2025-11-11T14:20:07.252223Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.252 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] local_worker_manager.cpp:376: {ptqudslmk6ath0mgbk4q} Create compute actor: async
2025-11-11T14:20:07.257601Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:07.257613Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:07.269593Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { expired_at { seconds: 1762870827 nanos: 259000000 } }
2025-11-11T14:20:07.269628Z :FQ_RUN_ACTOR TRACE: run_actor.cpp:861: QueryId: ptqudslmk6ath0mgbk4q Forward ping response. Success: 1. Cookie: 0
2025-11-11T14:20:07.287949Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:134: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Start compute actor [3:7571472466549446801:2167], task: 1
2025-11-11T14:20:07.287985Z :KQP_COMPUTE DEBUG: dq_async_compute_actor.cpp:113: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Use CPU quota: 1. Rate limiter resource: { "local/RateLimiter_0daf70c6-4121-4158-87c6-13d85e7af04f/rate_limiter", "mock_cloud/my_folder/ptqudslmk6ath0mgbk4q" }
2025-11-11T14:20:07.288033Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:358: {ptqudslmk6ath0mgbk4q} TDqExecuter::TEvAllocateWorkersResponse
2025-11-11T14:20:07.288050Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:384: {ptqudslmk6ath0mgbk4q} Allocated resource 4294967299
2025-11-11T14:20:07.288102Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:401: {ptqudslmk6ath0mgbk4q} WorkerInfo: Id:a2d833d6-4d1c2ddb-fccdf8ad-36a4da1e,ghrun-vb3yoermsa,NodeId:3,StageId:211130
2025-11-11T14:20:07.288124Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:402: {ptqudslmk6ath0mgbk4q} TaskInfo: 0/1
2025-11-11T14:20:07.288135Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:404: {ptqudslmk6ath0mgbk4q}  ObjectId: 8d73c3b672aec01e659c446142c7a17d47fb7b86, dq_vanilla_job.lite, 
2025-11-11T14:20:07.288159Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:401: {ptqudslmk6ath0mgbk4q} WorkerInfo: Id:f2c6c534-4c0a8d53-b04a8a86-dc0f5e3b,ghrun-vb3yoermsa,NodeId:1,StageId:211147
2025-11-11T14:20:07.288169Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:402: {ptqudslmk6ath0mgbk4q} TaskInfo: 1/2
2025-11-11T14:20:07.288177Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:404: {ptqudslmk6ath0mgbk4q}  ObjectId: 8d73c3b672aec01e659c446142c7a17d47fb7b86, dq_vanilla_job.lite, 
2025-11-11T14:20:07.288201Z :YQL_PROXY INFO: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:07.288 INFO  ydbd(pid=1078664, tid=0x00007F43FCD13640) [DQ] executer_actor.cpp:415: {ptqudslmk6ath0mgbk4q} 2 workers allocated
2025-11-11T14:20:07.288368Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:07.288 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:271:  [3:7571472466549446799:2165] ExportStats Summary
2025-11-11T14:20:07.288410Z :YQL_PROXY DEBUG: log.cpp:64: SessionId:  2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:526: Ready State: [3:7571472466549446799:2165]
2025-11-11T14:20:07.288427Z :YQL_PROXY DEBUG: log.cpp:64: SessionId:  2025-11-11 14:20:07.288 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:537: Forward: [3:7571472466549446799:2165] to [3:7571472466549446798:2164]
2025-11-11T14:20:07.288464Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:70: [ptqudslmk6ath0mgbk4q-0.2] TEvReadyState, streaming disposition { from_last_checkpoint { } }, state load mode FROM_LAST_CHECKPOINT, checkpointing period 1.000000s
2025-11-11T14:20:07.288479Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:104: [ptqudslmk6ath0mgbk4q-0.2] AllActors count: 2, ActorsToTrigger count: 1, ActorsToNotify count: 2, ActorsToWaitFor count: 2
2025-11-11T14:20:07.288482Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:114: [ptqudslmk6ath0mgbk4q-0.2] Send TEvRegisterCoordinatorRequest
2025-11-11T14:20:07.288490Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:229: [ptqudslmk6ath0mgbk4q-0.2] Got TEvRegisterCoordinatorRequest
2025-11-11T14:20:07.311919Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:243: [ptqudslmk6ath0mgbk4q-0.2] Graph registered
2025-11-11T14:20:07.311930Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:245: [ptqudslmk6ath0mgbk4q-0.2] Send TEvRegisterCoordinatorResponse
2025-11-11T14:20:07.311976Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:131: [ptqudslmk6ath0mgbk4q-0.2] Got TEvRegisterCoordinatorResponse; issues: 
2025-11-11T14:20:07.311979Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:140: [ptqudslmk6ath0mgbk4q-0.2] Successfully registered in storage
2025-11-11T14:20:07.311981Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:141: [ptqudslmk6ath0mgbk4q-0.2] Send TEvNewCheckpointCoordinator to 2 actor(s)
2025-11-11T14:20:07.311994Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:149: [ptqudslmk6ath0mgbk4q-0.2] Send TEvGetCheckpointsMetadataRequest; state load mode: FROM_LAST_CHECKPOINT; load graph: 0
2025-11-11T14:20:07.312018Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:387: [ptqudslmk6ath0mgbk4q-0] Got TEvGetCheckpointsMetadataRequest
2025-11-11T14:20:07.312383Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:622: [ptqudslmk6ath0mgbk4q-0.2] Handle connected node 1
2025-11-11T14:20:07.351188Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:197: [] Task: 1. Got TEvNewCheckpointCoordinator event: generation 2, actorId: [3:7571472466549446798:2164]
2025-11-11T14:20:07.351200Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:208: [] Task: 1. Assign checkpoint coordinator (generation = 2)
2025-11-11T14:20:07.351874Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:1370: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Create source for input 0 { Source { Type: "PqSource" Settings { type_url: "type.googleapis.com/NYql.NPq.NProto.TDqPqTopicSource" value: "\n$test_group_by_hop_restart_node_input\022\024ptqudslmk6ath0mgbk4q\032\017localhost:11255\"\025\n\023cluster:default_yds*\005local0\002@\001b\007projectb\004timej\025[\"DataType\";\"String\"]j\025[\"DataType\";\"String\"]x\001\222\001\024ptcudslmk718ved0i17d\232\001\rjson_each_row\242\001Q[\"StructType\";[[\"project\";[\"DataType\";\"String\"]];[\"time\";[\"DataType\";\"String\"]]]]\262\001\002\022\000\272\001\026\n\010cloud_id\022\nmock_cloud\272\001 \n\005scope\022\027yandexcloud://my_folder" } WatermarksMode: WATERMARKS_MODE_DISABLED } }
2025-11-11T14:20:07.352121Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:544: SelfId: [0:0:0], TxId: ptqudslmk6ath0mgbk4q, task: 1. PQ source. Start read actor, local row dispatcher [0:5788050504107380562:5260383], metadatafields: , partitions: 0, skip json errors: 0
2025-11-11T14:20:07.352173Z :KQP_COMPUTE DEBUG: dq_pq_read_actor_base.cpp:153: SelfId: [0:0:0], TxId: ptqudslmk6ath0mgbk4q, task: 1. PQ source. SessionId: empty Watermarks enabled: 0 granularity: 0.000000s late arrival delay: 0.000000s idle: 0 idle delay: 0.000000s
2025-11-11T14:20:07.352223Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:07.352 TRACE ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] task_controller_impl.h:160: [3:7571472466549446799:2165] EvState TaskId: 1 State: 2 PingCookie: 0 StatusCode: UNSPECIFIED
2025-11-11T14:20:07.352237Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:07.352 TRACE ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] task_controller_impl.h:201:  [3:7571472466549446799:2165] Executing TaskId: 1
2025-11-11T14:20:07.366338Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:400: [ptqudslmk6ath0mgbk4q-0] Send TEvGetCheckpointsMetadataResponse
2025-11-11T14:20:07.366418Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:186: [ptqudslmk6ath0mgbk4q-0.2] Got TEvGetCheckpointsMetadataResponse
2025-11-11T14:20:07.366431Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:219: [ptqudslmk6ath0mgbk4q-0.2] Will restore from checkpoint 1:8
2025-11-11T14:20:07.366670Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:265: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 1.8] TEvRestoreFromCheckpoint, StateLoadPlan = { StateType: STATE_TYPE_OWN }
2025-11-11T14:20:07.366693Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:457: [ptqudslmk6ath0mgbk4q-0] [1:8] Got TEvGetTaskState: tasks {1}
2025-11-11T14:20:07.366700Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:519: [ptqudslmk6ath0mgbk4q-0] [1:8] GetState, tasks: 1
2025-11-11T14:20:07.382572Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:07.382 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:160: [3:7571472466549446799:2165] EvState TaskId: 2 State: 2 PingCookie: 0 StatusCode: UNSPECIFIED
2025-11-11T14:20:07.382596Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:07.382 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:201:  [3:7571472466549446799:2165] Executing TaskId: 2
2025-11-11T14:20:07.382618Z :YQL_PROXY DEBUG: log.cpp:64: SessionId:  2025-11-11 14:20:07.382 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:561: Update channels
2025-11-11T14:20:07.383329Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:07.382 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:577: 1 Update { Id: 1 TransportVersion: DATA_TRANSPORT_UV_PICKLE_1_0 SrcTaskId: 1 DstTaskId: 2 SrcEndpoint { ActorId { RawX1: 7571472466549446801 RawX2: 4503612512274551 } } DstEndpoint { ActorId { RawX1: 7571472466510497521 RawX2: 4503603922340009 } } SrcStageId: 211130 DstStageId: 211147 }
2025-11-11T14:20:07.383370Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:07.383 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:577: 2 Update { Id: 1 TransportVersion: DATA_TRANSPORT_UV_PICKLE_1_0 SrcTaskId: 1 DstTaskId: 2 SrcEndpoint { ActorId { RawX1: 7571472466549446801 RawX2: 4503612512274551 } } DstEndpoint { ActorId { RawX1: 7571472466510497521 RawX2: 4503603922340009 } } SrcStageId: 211130 DstStageId: 211147 }
2025-11-11T14:20:07.383397Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:1074: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Received channels info: Update { Id: 1 TransportVersion: DATA_TRANSPORT_UV_PICKLE_1_0 SrcTaskId: 1 DstTaskId: 2 SrcEndpoint { ActorId { RawX1: 7571472466549446801 RawX2: 4503612512274551 } } DstEndpoint { ActorId { RawX1: 7571472466510497521 RawX2: 4503603922340009 } } SrcStageId: 211130 DstStageId: 211147 }
2025-11-11T14:20:07.383408Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:1093: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Update output channelId: 1, peer: [1:7571472466510497521:2217]
2025-11-11T14:20:07.455513Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:654: [ptqudslmk6ath0mgbk4q-0] [1:8] ListOfStates results:
2025-11-11T14:20:07.455538Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:9, rows count: 1
2025-11-11T14:20:07.455541Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:8, rows count: 1
2025-11-11T14:20:07.455542Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:7, rows count: 1
2025-11-11T14:20:07.455543Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:6, rows count: 1
2025-11-11T14:20:07.455544Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:5, rows count: 1
2025-11-11T14:20:07.455545Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:4, rows count: 1
2025-11-11T14:20:07.455547Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:3, rows count: 1
2025-11-11T14:20:07.455548Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:2, rows count: 1
2025-11-11T14:20:07.455549Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:675: [ptqudslmk6ath0mgbk4q-0] [1:8] taskId 1 checkpoint id: 1:1, rows count: 1
2025-11-11T14:20:07.455556Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:901: [ptqudslmk6ath0mgbk4q-0] [1:8] SkipStatesInFuture, skip 1 checkpoints
2025-11-11T14:20:07.455605Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:796: [ptqudslmk6ath0mgbk4q-0] [1:8] SelectState: task_id 1, seq_no 8, blob_seq_num 0
2025-11-11T14:20:07.521809Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:410: [ptqudslmk6ath0mgbk4q-0] [1:8] DeserializeState, task id 1, blob size 131
2025-11-11T14:20:07.521856Z :STREAMS_STORAGE_SERVICE DEBUG: ydb_state_storage.cpp:960: [ptqudslmk6ath0mgbk4q-0] [1:8] ApplyIncrements
2025-11-11T14:20:07.521982Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:476: [ptqudslmk6ath0mgbk4q-0] [{ Id: 8 Generation: 1 }] Send TEvGetTaskStateResult: tasks: {1}
2025-11-11T14:20:07.522046Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:336: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 1.8] TEvGetTaskStateResult: restoring state
2025-11-11T14:20:07.522054Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:792: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Load state
2025-11-11T14:20:07.522074Z :KQP_COMPUTE DEBUG: dq_pq_read_actor_base.cpp:153: SelfId: [0:0:0], TxId: ptqudslmk6ath0mgbk4q, task: 1. PQ source. SessionId: empty Watermarks enabled: 0 granularity: 0.000000s late arrival delay: 0.000000s idle: 0 idle delay: 0.000000s
2025-11-11T14:20:07.522102Z :KQP_COMPUTE DEBUG: dq_pq_read_actor_base.cpp:133: SelfId: [0:0:0], TxId: ptqudslmk6ath0mgbk4q, task: 1. PQ source. SessionId: empty StartingMessageTs 2025-11-11T14:19:57.108000Z Restoring offset: {0@,5},
2025-11-11T14:20:07.522120Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:362: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 1.8] Checkpoint state restored
2025-11-11T14:20:07.522147Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:297: [ptqudslmk6ath0mgbk4q-0.2] [1:8] Got TEvRestoreFromCheckpointResult; taskId: 1, checkpoint: 1:8, status: OK, issues: 
2025-11-11T14:20:07.522175Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:320: [ptqudslmk6ath0mgbk4q-0.2] [1:8] Task state restored, need 1 more acks
2025-11-11T14:20:07.523411Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:297: [ptqudslmk6ath0mgbk4q-0.2] [1:8] Got TEvRestoreFromCheckpointResult; taskId: 2, checkpoint: 1:8, status: OK, issues: 
2025-11-11T14:20:07.523422Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:320: [ptqudslmk6ath0mgbk4q-0.2] [1:8] Task state restored, need 0 more acks
2025-11-11T14:20:07.523426Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:445: [ptqudslmk6ath0mgbk4q-0.2] Send TEvRun to all actors
2025-11-11T14:20:07.523474Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:1174: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Got TEvRun from actor [3:7571472466549446798:2164]
2025-11-11T14:20:07.523489Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:07.523492Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:07.523498Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [0:0:0], TxId: ptqudslmk6ath0mgbk4q, task: 1. PQ source. GetAsyncInputData freeSpace = 1
2025-11-11T14:20:07.523508Z :KQP_COMPUTE DEBUG: dq_pq_rd_read_actor.cpp:1489: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Switch to single-cluster mode
2025-11-11T14:20:07.523513Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:595: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Send TEvCoordinatorChangesSubscribe to local RD ([0:5788050504107380562:5260383])
2025-11-11T14:20:07.523523Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:622: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Send TEvCoordinatorChangesSubscribe to local row dispatcher, self id [3:7571472466549446805:2167]
2025-11-11T14:20:07.523529Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:07.523536Z :FQ_ROW_DISPATCHER DEBUG: row_dispatcher.cpp:627: RowDispatcher: TEvCoordinatorChangesSubscribe from [3:7571472466549446805:2167]
2025-11-11T14:20:07.523543Z :FQ_ROW_DISPATCHER DEBUG: row_dispatcher.cpp:627: RowDispatcher: TEvCoordinatorChangesSubscribe from [3:7571472466549446805:2167]
2025-11-11T14:20:07.523550Z :KQP_COMPUTE DEBUG: dq_pq_rd_read_actor.cpp:983: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. TEvCoordinatorChanged, new coordinator [2:7571472399481445439:2113]
2025-11-11T14:20:07.523555Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:642: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Send TEvCoordinatorRequest to coordinator [2:7571472399481445439:2113], partIds: 0 cookie 1
2025-11-11T14:20:07.523579Z :KQP_COMPUTE DEBUG: dq_pq_rd_read_actor.cpp:983: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. TEvCoordinatorChanged, new coordinator [2:7571472399481445439:2113]
2025-11-11T14:20:07.523582Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:07.523619Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:07.523 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:07.523659Z :KQP_COMPUTE TRACE: dq_compute_memory_quota.h:97: TxId: ptqudslmk6ath0mgbk4q, task: 1. Peak memory usage: 2031616
2025-11-11T14:20:07.523671Z :KQP_COMPUTE DEBUG: dq_pq_rd_read_actor.cpp:1052: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. EvNodeConnected 2
2025-11-11T14:20:07.523675Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:07.523697Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:07.523705Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:07.523711Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:07.523715Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:1105: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Ask CPU quota: 64ms
2025-11-11T14:20:07.524312Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:1027: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Received TEvCoordinatorResult from [2:7571472399481445439:2113], cookie 1
2025-11-11T14:20:07.524335Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:1326: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. UpdateSessions, Sessions size 0
2025-11-11T14:20:07.524337Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:1329: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Distribution is changed, remove sessions
2025-11-11T14:20:07.524343Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:1348: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Create session to [2:7571472399481445363:2063], generation 1
2025-11-11T14:20:07.524352Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:706: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Send TEvStartSession to [2:7571472399481445363:2063], connection id 1 partitions offsets (0 / 5),
2025-11-11T14:20:07.525318Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:937: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Received TEvRetry, EventQueueId 1
2025-11-11T14:20:07.525399Z :KQP_COMPUTE DEBUG: dq_pq_rd_read_actor.cpp:1052: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. EvNodeConnected 2
2025-11-11T14:20:07.526332Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:1162: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. CPU quota delay: 2ms
2025-11-11T14:20:07.527796Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:848: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Received TEvStartSessionAck from [2:7571472399481445363:2063], seqNo 1, ConfirmedSeqNo 1, generation 1
2025-11-11T14:20:08.231916Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616217, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:08.236008Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:08.236026Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:08.266707Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:318: TNodesManagerActor::NodesHealthCheck
2025-11-11T14:20:08.274805Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:389: Send NodeInfo with size: 2 to DynamicNameserver
2025-11-11T14:20:08.288273Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:08.288 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:271:  [3:7571472466549446799:2165] ExportStats Summary
2025-11-11T14:20:08.288479Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { statistics: "{\"Graph=0\":{\"TaskRunner\":{\"Stage=211130\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=211147\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=Total\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":2,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1}}}}}" }
2025-11-11T14:20:08.288482Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:08.299457Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { expired_at { seconds: 1762870828 nanos: 294000000 } }
2025-11-11T14:20:08.299501Z :FQ_RUN_ACTOR TRACE: run_actor.cpp:861: QueryId: ptqudslmk6ath0mgbk4q Forward ping response. Success: 1. Cookie: 6
2025-11-11T14:20:08.523726Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:373: [ptqudslmk6ath0mgbk4q-0.2] Got TEvScheduleCheckpointing
2025-11-11T14:20:08.523741Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:349: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Registering new checkpoint in storage
2025-11-11T14:20:08.523834Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:253: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvCreateCheckpointRequest
2025-11-11T14:20:08.541739Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:874: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Received TEvStatistics from [2:7571472399481445363:2063], seqNo 2, ConfirmedSeqNo 1 generation 1
2025-11-11T14:20:08.555592Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:295: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Checkpoint created
2025-11-11T14:20:08.555606Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:297: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Send TEvCreateCheckpointResponse
2025-11-11T14:20:08.555644Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:389: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvCreateCheckpointResponse
2025-11-11T14:20:08.555651Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:435: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Checkpoint successfully created, going to inject barriers to 1 actor(s)
2025-11-11T14:20:08.555675Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:239: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.1] TEvInjectCheckpoint
2025-11-11T14:20:08.555692Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:08.555695Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1502: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Skip polling sources because of pending checkpoint
2025-11-11T14:20:08.555697Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:694: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. DoExecuteImpl: 1
2025-11-11T14:20:08.555739Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:08.555 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:08.555765Z :DQ_TASK_RUNNER TRACE: task_runner_actor_local.cpp:510: SelfId: [3:7571472466549446803:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Pending 1 checkpoints to be sent
2025-11-11T14:20:08.555773Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:08.555804Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 1 watermark injected: (empty maybe)
2025-11-11T14:20:08.555807Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:447: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.1] Performing task checkpoint
2025-11-11T14:20:08.555810Z :KQP_COMPUTE DEBUG: dq_async_compute_actor.cpp:822: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Save state
2025-11-11T14:20:08.555818Z :KQP_COMPUTE DEBUG: dq_pq_read_actor_base.cpp:94: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. SessionId: empty SaveState, offsets: {0,5},
2025-11-11T14:20:08.555828Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:474: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.1] CA state saved
2025-11-11T14:20:08.555830Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:449: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.1] Injecting checkpoint barrier to outputs
2025-11-11T14:20:08.555839Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:536: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.1] Task checkpoint is done. Send to storage
2025-11-11T14:20:08.555842Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:08.555848Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:08.555866Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:566: TxId: ptqudslmk6ath0mgbk4q, task: 1. SendChannelData, channelId: 1, peer: [1:7571472466510497521:2217], chunks: 0, bytes: 0, watermark: 0, checkpoint: 1, seqNo: 1, finished: 0
2025-11-11T14:20:08.555879Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:08.555880Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:08.555884Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:08.555889Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:08.555899Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:08.555911Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:08.555 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:08.555917Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:08.555923Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:08.555924Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:08.555927Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:96;inFlightCount:1;)
2025-11-11T14:20:08.555935Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:409: [ptqudslmk6ath0mgbk4q-0] [2:1] Got TEvSaveTaskState: task 1
2025-11-11T14:20:08.557121Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:179: TxId: ptqudslmk6ath0mgbk4q, task: 1. Received channel data ack for channelId: 1, seqNo: 1, lastSentSeqNo: 1, freeSpace: 1000000, early finish: 0
2025-11-11T14:20:08.557129Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:207: TxId: ptqudslmk6ath0mgbk4q, task: 1. PeerState, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;), sentSeqNo: 1, ackSeqNo: 1
2025-11-11T14:20:08.557130Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:220: TxId: ptqudslmk6ath0mgbk4q, task: 1. Resume compute actor
2025-11-11T14:20:08.557133Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:08.557134Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:08.557136Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:08.557138Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:08.557141Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:08.557153Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:08.557 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:08.557158Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:08.557167Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:08.557168Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:08.557170Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:08.558829Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:433: [ptqudslmk6ath0mgbk4q-0] [2:1] TEvSaveTaskState Apply: task: 1
2025-11-11T14:20:08.558841Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:448: [ptqudslmk6ath0mgbk4q-0] [2:1] Send TEvSaveTaskStateResult: task: 1
2025-11-11T14:20:08.558885Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvSaveTaskStateResult; task 1, status: OK, size: 131
2025-11-11T14:20:08.558893Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Task state saved, need 1 more acks
2025-11-11T14:20:08.559844Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvSaveTaskStateResult; task 2, status: OK, size: 139
2025-11-11T14:20:08.559852Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Task state saved, need 0 more acks
2025-11-11T14:20:08.559854Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:489: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got all acks, changing checkpoint status to 'PendingCommit'
2025-11-11T14:20:08.559866Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:305: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvSetCheckpointPendingCommitStatusRequest
2025-11-11T14:20:08.584464Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:320: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Status updated to 'PendingCommit'
2025-11-11T14:20:08.584481Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:322: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Send TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:08.585317Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:501: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:08.585331Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:516: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Checkpoint status changed to 'PendingCommit', committing states to 2 actor(s)
2025-11-11T14:20:08.585375Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:746: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Commit state
2025-11-11T14:20:08.585391Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvStateCommitted; task: 1
2025-11-11T14:20:08.585396Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:1] State committed [3:7571472466549446801:2167], need 1 more acks
2025-11-11T14:20:08.585765Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvStateCommitted; task: 2
2025-11-11T14:20:08.585772Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:1] State committed [1:7571472466510497521:2217], need 0 more acks
2025-11-11T14:20:08.585774Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:543: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got all acks, changing checkpoint status to 'Completed'
2025-11-11T14:20:08.585788Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:330: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvCompleteCheckpointRequest
2025-11-11T14:20:08.613161Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:348: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Status updated to 'Completed'
2025-11-11T14:20:08.613175Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:355: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Send TEvCompleteCheckpointResponse
2025-11-11T14:20:08.613284Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:564: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Got TEvCompleteCheckpointResponse
2025-11-11T14:20:08.613300Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:579: [ptqudslmk6ath0mgbk4q-0.2] [2:1] Checkpoint completed
2025-11-11T14:20:09.232371Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [2:7571472399481445439:2113]
2025-11-11T14:20:09.232382Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616218, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:09.232406Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:20:09.232815Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:09.238974Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:09.238993Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:09.288814Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:09.288 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:271:  [3:7571472466549446799:2165] ExportStats Summary
2025-11-11T14:20:09.289049Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { statistics: "{\"Graph=0\":{\"TaskRunner\":{\"Stage=211130\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=211147\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=Total\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":2,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1}}}}}" }
2025-11-11T14:20:09.289068Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:09.313754Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { expired_at { seconds: 1762870829 nanos: 305000000 } }
2025-11-11T14:20:09.313788Z :FQ_RUN_ACTOR TRACE: run_actor.cpp:861: QueryId: ptqudslmk6ath0mgbk4q Forward ping response. Success: 1. Cookie: 6
2025-11-11T14:20:09.524175Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:373: [ptqudslmk6ath0mgbk4q-0.2] Got TEvScheduleCheckpointing
2025-11-11T14:20:09.524183Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:349: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Registering new checkpoint in storage
2025-11-11T14:20:09.524228Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:253: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvCreateCheckpointRequest
2025-11-11T14:20:09.526169Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:955: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. TEvRetryQueuePrivate::TEvEvHeartbeat
2025-11-11T14:20:09.526184Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:971: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Send TEvEvHeartbeat
2025-11-11T14:20:09.551590Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:295: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Checkpoint created
2025-11-11T14:20:09.551623Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:297: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Send TEvCreateCheckpointResponse
2025-11-11T14:20:09.551656Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:389: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvCreateCheckpointResponse
2025-11-11T14:20:09.551664Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:435: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Checkpoint successfully created, going to inject barriers to 1 actor(s)
2025-11-11T14:20:09.551691Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:239: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.2] TEvInjectCheckpoint
2025-11-11T14:20:09.551701Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:09.551704Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1502: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Skip polling sources because of pending checkpoint
2025-11-11T14:20:09.551706Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:694: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. DoExecuteImpl: 1
2025-11-11T14:20:09.551757Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:09.551 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:09.551787Z :DQ_TASK_RUNNER TRACE: task_runner_actor_local.cpp:510: SelfId: [3:7571472466549446803:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Pending 1 checkpoints to be sent
2025-11-11T14:20:09.551801Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:09.551846Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 1 watermark injected: (empty maybe)
2025-11-11T14:20:09.551853Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:447: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.2] Performing task checkpoint
2025-11-11T14:20:09.551855Z :KQP_COMPUTE DEBUG: dq_async_compute_actor.cpp:822: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Save state
2025-11-11T14:20:09.551863Z :KQP_COMPUTE DEBUG: dq_pq_read_actor_base.cpp:94: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. SessionId: empty SaveState, offsets: {0,5},
2025-11-11T14:20:09.551874Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:474: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.2] CA state saved
2025-11-11T14:20:09.551876Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:449: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.2] Injecting checkpoint barrier to outputs
2025-11-11T14:20:09.551884Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:536: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.2] Task checkpoint is done. Send to storage
2025-11-11T14:20:09.551887Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:09.551893Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:09.551893Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:409: [ptqudslmk6ath0mgbk4q-0] [2:2] Got TEvSaveTaskState: task 1
2025-11-11T14:20:09.551911Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:566: TxId: ptqudslmk6ath0mgbk4q, task: 1. SendChannelData, channelId: 1, peer: [1:7571472466510497521:2217], chunks: 0, bytes: 0, watermark: 0, checkpoint: 1, seqNo: 2, finished: 0
2025-11-11T14:20:09.551928Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:09.551930Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:09.551933Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:09.551939Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:09.551948Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:09.551960Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:09.551 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:09.551974Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:09.551981Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:09.551983Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:09.551986Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:96;inFlightCount:1;)
2025-11-11T14:20:09.552384Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:179: TxId: ptqudslmk6ath0mgbk4q, task: 1. Received channel data ack for channelId: 1, seqNo: 2, lastSentSeqNo: 2, freeSpace: 1000000, early finish: 0
2025-11-11T14:20:09.552396Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:207: TxId: ptqudslmk6ath0mgbk4q, task: 1. PeerState, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;), sentSeqNo: 2, ackSeqNo: 2
2025-11-11T14:20:09.552398Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:220: TxId: ptqudslmk6ath0mgbk4q, task: 1. Resume compute actor
2025-11-11T14:20:09.552403Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:09.552405Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:09.552408Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:09.552411Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:09.552419Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:09.552440Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:09.552 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:09.552452Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:09.552466Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:09.552467Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:09.552470Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:09.556078Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:433: [ptqudslmk6ath0mgbk4q-0] [2:2] TEvSaveTaskState Apply: task: 1
2025-11-11T14:20:09.556090Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:448: [ptqudslmk6ath0mgbk4q-0] [2:2] Send TEvSaveTaskStateResult: task: 1
2025-11-11T14:20:09.556130Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvSaveTaskStateResult; task 1, status: OK, size: 131
2025-11-11T14:20:09.556142Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Task state saved, need 1 more acks
2025-11-11T14:20:09.556195Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvSaveTaskStateResult; task 2, status: OK, size: 139
2025-11-11T14:20:09.556201Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Task state saved, need 0 more acks
2025-11-11T14:20:09.556203Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:489: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got all acks, changing checkpoint status to 'PendingCommit'
2025-11-11T14:20:09.556216Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:305: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvSetCheckpointPendingCommitStatusRequest
2025-11-11T14:20:09.583061Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:320: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Status updated to 'PendingCommit'
2025-11-11T14:20:09.583077Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:322: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Send TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:09.583121Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:501: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:09.583128Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:516: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Checkpoint status changed to 'PendingCommit', committing states to 2 actor(s)
2025-11-11T14:20:09.583173Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:746: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Commit state
2025-11-11T14:20:09.583196Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvStateCommitted; task: 1
2025-11-11T14:20:09.583201Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:2] State committed [3:7571472466549446801:2167], need 1 more acks
2025-11-11T14:20:09.583564Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvStateCommitted; task: 2
2025-11-11T14:20:09.583568Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:2] State committed [1:7571472466510497521:2217], need 0 more acks
2025-11-11T14:20:09.583573Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:543: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got all acks, changing checkpoint status to 'Completed'
2025-11-11T14:20:09.583589Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:330: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvCompleteCheckpointRequest
2025-11-11T14:20:09.611527Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:348: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Status updated to 'Completed'
2025-11-11T14:20:09.611545Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:355: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Send TEvCompleteCheckpointResponse
2025-11-11T14:20:09.611602Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:564: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Got TEvCompleteCheckpointResponse
2025-11-11T14:20:09.611610Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:579: [ptqudslmk6ath0mgbk4q-0.2] [2:2] Checkpoint completed
2025-11-11T14:20:10.232805Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616219, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:10.236810Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:10.236826Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:10.289192Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:10.289 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:271:  [3:7571472466549446799:2165] ExportStats Summary
2025-11-11T14:20:10.289436Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { statistics: "{\"Graph=0\":{\"TaskRunner\":{\"Stage=211130\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=211147\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=Total\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":2,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1}}}}}" }
2025-11-11T14:20:10.289445Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:10.306891Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { expired_at { seconds: 1762870830 nanos: 296000000 } }
2025-11-11T14:20:10.306936Z :FQ_RUN_ACTOR TRACE: run_actor.cpp:861: QueryId: ptqudslmk6ath0mgbk4q Forward ping response. Success: 1. Cookie: 6
2025-11-11T14:20:10.524749Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:373: [ptqudslmk6ath0mgbk4q-0.2] Got TEvScheduleCheckpointing
2025-11-11T14:20:10.524767Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:349: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Registering new checkpoint in storage
2025-11-11T14:20:10.524794Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:253: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvCreateCheckpointRequest
2025-11-11T14:20:10.541253Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:874: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Received TEvStatistics from [2:7571472399481445363:2063], seqNo 3, ConfirmedSeqNo 2 generation 1
2025-11-11T14:20:10.555994Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:295: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Checkpoint created
2025-11-11T14:20:10.556009Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:297: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Send TEvCreateCheckpointResponse
2025-11-11T14:20:10.556082Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:389: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvCreateCheckpointResponse
2025-11-11T14:20:10.556093Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:435: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Checkpoint successfully created, going to inject barriers to 1 actor(s)
2025-11-11T14:20:10.556121Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:239: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.3] TEvInjectCheckpoint
2025-11-11T14:20:10.556140Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:10.556143Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1502: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Skip polling sources because of pending checkpoint
2025-11-11T14:20:10.556145Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:694: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. DoExecuteImpl: 1
2025-11-11T14:20:10.556192Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:10.556 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:10.556228Z :DQ_TASK_RUNNER TRACE: task_runner_actor_local.cpp:510: SelfId: [3:7571472466549446803:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Pending 1 checkpoints to be sent
2025-11-11T14:20:10.556241Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:10.556283Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 1 watermark injected: (empty maybe)
2025-11-11T14:20:10.556290Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:447: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.3] Performing task checkpoint
2025-11-11T14:20:10.556292Z :KQP_COMPUTE DEBUG: dq_async_compute_actor.cpp:822: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Save state
2025-11-11T14:20:10.556300Z :KQP_COMPUTE DEBUG: dq_pq_read_actor_base.cpp:94: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. SessionId: empty SaveState, offsets: {0,5},
2025-11-11T14:20:10.556318Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:474: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.3] CA state saved
2025-11-11T14:20:10.556321Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:449: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.3] Injecting checkpoint barrier to outputs
2025-11-11T14:20:10.556331Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:536: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.3] Task checkpoint is done. Send to storage
2025-11-11T14:20:10.556337Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:10.556344Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:10.556353Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:409: [ptqudslmk6ath0mgbk4q-0] [2:3] Got TEvSaveTaskState: task 1
2025-11-11T14:20:10.556361Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:566: TxId: ptqudslmk6ath0mgbk4q, task: 1. SendChannelData, channelId: 1, peer: [1:7571472466510497521:2217], chunks: 0, bytes: 0, watermark: 0, checkpoint: 1, seqNo: 3, finished: 0
2025-11-11T14:20:10.556382Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:10.556390Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:10.556394Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:10.556399Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:10.556408Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:10.556427Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:10.556 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:10.556437Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:10.556449Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:10.556452Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:10.556455Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:96;inFlightCount:1;)
2025-11-11T14:20:10.558022Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:179: TxId: ptqudslmk6ath0mgbk4q, task: 1. Received channel data ack for channelId: 1, seqNo: 3, lastSentSeqNo: 3, freeSpace: 1000000, early finish: 0
2025-11-11T14:20:10.558037Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:207: TxId: ptqudslmk6ath0mgbk4q, task: 1. PeerState, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;), sentSeqNo: 3, ackSeqNo: 3
2025-11-11T14:20:10.558038Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:220: TxId: ptqudslmk6ath0mgbk4q, task: 1. Resume compute actor
2025-11-11T14:20:10.558046Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:10.558049Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:10.558053Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:10.558057Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:10.558066Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:10.558094Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:10.558 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:10.558120Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:10.558140Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:10.558142Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:10.558147Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:10.559589Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:433: [ptqudslmk6ath0mgbk4q-0] [2:3] TEvSaveTaskState Apply: task: 1
2025-11-11T14:20:10.559600Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:448: [ptqudslmk6ath0mgbk4q-0] [2:3] Send TEvSaveTaskStateResult: task: 1
2025-11-11T14:20:10.559690Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvSaveTaskStateResult; task 1, status: OK, size: 131
2025-11-11T14:20:10.559697Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Task state saved, need 1 more acks
2025-11-11T14:20:10.561758Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvSaveTaskStateResult; task 2, status: OK, size: 139
2025-11-11T14:20:10.561767Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Task state saved, need 0 more acks
2025-11-11T14:20:10.561769Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:489: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got all acks, changing checkpoint status to 'PendingCommit'
2025-11-11T14:20:10.561781Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:305: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvSetCheckpointPendingCommitStatusRequest
2025-11-11T14:20:10.585287Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:320: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Status updated to 'PendingCommit'
2025-11-11T14:20:10.585300Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:322: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Send TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:10.585326Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:501: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:10.585332Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:516: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Checkpoint status changed to 'PendingCommit', committing states to 2 actor(s)
2025-11-11T14:20:10.585375Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:746: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Commit state
2025-11-11T14:20:10.585393Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvStateCommitted; task: 1
2025-11-11T14:20:10.585399Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:3] State committed [3:7571472466549446801:2167], need 1 more acks
2025-11-11T14:20:10.585815Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvStateCommitted; task: 2
2025-11-11T14:20:10.585825Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:3] State committed [1:7571472466510497521:2217], need 0 more acks
2025-11-11T14:20:10.585826Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:543: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got all acks, changing checkpoint status to 'Completed'
2025-11-11T14:20:10.585841Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:330: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvCompleteCheckpointRequest
2025-11-11T14:20:10.615131Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:348: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Status updated to 'Completed'
2025-11-11T14:20:10.615155Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:355: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Send TEvCompleteCheckpointResponse
2025-11-11T14:20:10.615257Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:564: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Got TEvCompleteCheckpointResponse
2025-11-11T14:20:10.615274Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:579: [ptqudslmk6ath0mgbk4q-0.2] [2:3] Checkpoint completed
2025-11-11T14:20:11.233239Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [2:7571472399481445439:2113]
2025-11-11T14:20:11.233263Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:20:11.233277Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616220, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:11.233749Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:11.245851Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:11.245865Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:11.289609Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:11.289 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:271:  [3:7571472466549446799:2165] ExportStats Summary
2025-11-11T14:20:11.289815Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { statistics: "{\"Graph=0\":{\"TaskRunner\":{\"Stage=211130\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=211147\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=Total\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":2,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1}}}}}" }
2025-11-11T14:20:11.289822Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:11.313543Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { expired_at { seconds: 1762870831 nanos: 305000000 } }
2025-11-11T14:20:11.313582Z :FQ_RUN_ACTOR TRACE: run_actor.cpp:861: QueryId: ptqudslmk6ath0mgbk4q Forward ping response. Success: 1. Cookie: 6
2025-11-11T14:20:11.525155Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:373: [ptqudslmk6ath0mgbk4q-0.2] Got TEvScheduleCheckpointing
2025-11-11T14:20:11.525163Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:349: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Registering new checkpoint in storage
2025-11-11T14:20:11.525187Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:253: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvCreateCheckpointRequest
2025-11-11T14:20:11.527133Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:955: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. TEvRetryQueuePrivate::TEvEvHeartbeat
2025-11-11T14:20:11.527152Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:971: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Send TEvEvHeartbeat
2025-11-11T14:20:11.554727Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:295: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Checkpoint created
2025-11-11T14:20:11.554741Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:297: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Send TEvCreateCheckpointResponse
2025-11-11T14:20:11.554770Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:389: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvCreateCheckpointResponse
2025-11-11T14:20:11.554777Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:435: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Checkpoint successfully created, going to inject barriers to 1 actor(s)
2025-11-11T14:20:11.554804Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:239: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.4] TEvInjectCheckpoint
2025-11-11T14:20:11.554817Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:11.554821Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1502: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Skip polling sources because of pending checkpoint
2025-11-11T14:20:11.554823Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:694: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. DoExecuteImpl: 1
2025-11-11T14:20:11.554866Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:11.554 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:11.554901Z :DQ_TASK_RUNNER TRACE: task_runner_actor_local.cpp:510: SelfId: [3:7571472466549446803:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Pending 1 checkpoints to be sent
2025-11-11T14:20:11.554912Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:11.554948Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 1 watermark injected: (empty maybe)
2025-11-11T14:20:11.554953Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:447: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.4] Performing task checkpoint
2025-11-11T14:20:11.554956Z :KQP_COMPUTE DEBUG: dq_async_compute_actor.cpp:822: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Save state
2025-11-11T14:20:11.554965Z :KQP_COMPUTE DEBUG: dq_pq_read_actor_base.cpp:94: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. SessionId: empty SaveState, offsets: {0,5},
2025-11-11T14:20:11.554974Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:474: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.4] CA state saved
2025-11-11T14:20:11.554977Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:449: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.4] Injecting checkpoint barrier to outputs
2025-11-11T14:20:11.554988Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:536: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.4] Task checkpoint is done. Send to storage
2025-11-11T14:20:11.554991Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:11.554997Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:11.555015Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:566: TxId: ptqudslmk6ath0mgbk4q, task: 1. SendChannelData, channelId: 1, peer: [1:7571472466510497521:2217], chunks: 0, bytes: 0, watermark: 0, checkpoint: 1, seqNo: 4, finished: 0
2025-11-11T14:20:11.555038Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:11.555039Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:11.555043Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:11.555049Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:11.555058Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:11.555072Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:11.555 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:11.555079Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:11.555089Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:11.555091Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:11.555093Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:96;inFlightCount:1;)
2025-11-11T14:20:11.555103Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:409: [ptqudslmk6ath0mgbk4q-0] [2:4] Got TEvSaveTaskState: task 1
2025-11-11T14:20:11.557950Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:179: TxId: ptqudslmk6ath0mgbk4q, task: 1. Received channel data ack for channelId: 1, seqNo: 4, lastSentSeqNo: 4, freeSpace: 1000000, early finish: 0
2025-11-11T14:20:11.557966Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:207: TxId: ptqudslmk6ath0mgbk4q, task: 1. PeerState, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;), sentSeqNo: 4, ackSeqNo: 4
2025-11-11T14:20:11.557967Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:220: TxId: ptqudslmk6ath0mgbk4q, task: 1. Resume compute actor
2025-11-11T14:20:11.557976Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:11.557978Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:11.557984Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:11.557989Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:11.558002Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:11.558032Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:11.558 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:11.558050Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:11.558076Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:11.558079Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:11.558084Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:11.558622Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:433: [ptqudslmk6ath0mgbk4q-0] [2:4] TEvSaveTaskState Apply: task: 1
2025-11-11T14:20:11.558634Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:448: [ptqudslmk6ath0mgbk4q-0] [2:4] Send TEvSaveTaskStateResult: task: 1
2025-11-11T14:20:11.558703Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvSaveTaskStateResult; task 1, status: OK, size: 131
2025-11-11T14:20:11.558712Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Task state saved, need 1 more acks
2025-11-11T14:20:11.561352Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvSaveTaskStateResult; task 2, status: OK, size: 139
2025-11-11T14:20:11.561360Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Task state saved, need 0 more acks
2025-11-11T14:20:11.561363Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:489: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got all acks, changing checkpoint status to 'PendingCommit'
2025-11-11T14:20:11.561381Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:305: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvSetCheckpointPendingCommitStatusRequest
2025-11-11T14:20:11.587579Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:320: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Status updated to 'PendingCommit'
2025-11-11T14:20:11.587593Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:322: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Send TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:11.587624Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:501: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:11.587631Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:516: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Checkpoint status changed to 'PendingCommit', committing states to 2 actor(s)
2025-11-11T14:20:11.587675Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:746: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Commit state
2025-11-11T14:20:11.587693Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvStateCommitted; task: 1
2025-11-11T14:20:11.587701Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:4] State committed [3:7571472466549446801:2167], need 1 more acks
2025-11-11T14:20:11.593177Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvStateCommitted; task: 2
2025-11-11T14:20:11.593190Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:4] State committed [1:7571472466510497521:2217], need 0 more acks
2025-11-11T14:20:11.593192Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:543: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got all acks, changing checkpoint status to 'Completed'
2025-11-11T14:20:11.593214Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:330: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvCompleteCheckpointRequest
2025-11-11T14:20:11.617953Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:348: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Status updated to 'Completed'
2025-11-11T14:20:11.617964Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:355: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Send TEvCompleteCheckpointResponse
2025-11-11T14:20:11.617992Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:564: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Got TEvCompleteCheckpointResponse
2025-11-11T14:20:11.618000Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:579: [ptqudslmk6ath0mgbk4q-0.2] [2:4] Checkpoint completed
2025-11-11T14:20:12.233708Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616221, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:12.241291Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:12.241307Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:12.249060Z :FQ_PINGER TRACE: pinger.cpp:400: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Request Private::PingTask
2025-11-11T14:20:12.257340Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { expired_at { seconds: 1762870832 nanos: 252000000 } }
2025-11-11T14:20:12.290082Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.290 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:271:  [3:7571472466549446799:2165] ExportStats Summary
2025-11-11T14:20:12.290354Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { statistics: "{\"Graph=0\":{\"TaskRunner\":{\"Stage=211130\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=211147\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":1,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=Total\":{\"CpuTimeUs\":{\"sum\":\"0.00s\",\"count\":2,\"avg\":\"0.00s\",\"max\":\"0.00s\",\"min\":\"0.00s\"},\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1}}}}}" }
2025-11-11T14:20:12.290364Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:12.307678Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { expired_at { seconds: 1762870832 nanos: 300000000 } }
2025-11-11T14:20:12.307729Z :FQ_RUN_ACTOR TRACE: run_actor.cpp:861: QueryId: ptqudslmk6ath0mgbk4q Forward ping response. Success: 1. Cookie: 6
2025-11-11T14:20:12.418024Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.417 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:229:  Ping TaskId: 1, Compute ActorId: [3:7571472466549446801:2167], PingCookie: 1
2025-11-11T14:20:12.418069Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.418 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:229:  Ping TaskId: 2, Compute ActorId: [1:7571472466510497521:2217], PingCookie: 2
2025-11-11T14:20:12.418088Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:451: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Got TEvStateRequest from actor [3:7571472466549446799:2165] PingCookie: 1
2025-11-11T14:20:12.418103Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.418201Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.418 TRACE ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] task_controller_impl.h:160: [3:7571472466549446799:2165] EvState TaskId: 1 State: 2 PingCookie: 1 StatusCode: SUCCESS
2025-11-11T14:20:12.418221Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.418 TRACE ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] task_controller_impl.h:174:  [3:7571472466549446799:2165] AddStats 1
2025-11-11T14:20:12.418288Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.418 TRACE ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] task_controller_impl.h:201:  [3:7571472466549446799:2165] Executing TaskId: 1
2025-11-11T14:20:12.418661Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.418 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:160: [3:7571472466549446799:2165] EvState TaskId: 2 State: 2 PingCookie: 2 StatusCode: SUCCESS
2025-11-11T14:20:12.418678Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.418 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:174:  [3:7571472466549446799:2165] AddStats 2
2025-11-11T14:20:12.418751Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:12.418 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:201:  [3:7571472466549446799:2165] Executing TaskId: 2
2025-11-11T14:20:12.525755Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:373: [ptqudslmk6ath0mgbk4q-0.2] Got TEvScheduleCheckpointing
2025-11-11T14:20:12.525770Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:349: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Registering new checkpoint in storage
2025-11-11T14:20:12.525793Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:253: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvCreateCheckpointRequest
2025-11-11T14:20:12.538486Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:919: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Received TEvNewDataArrived from [2:7571472399481445363:2063], partition 0, seqNo 4, ConfirmedSeqNo 3 generation 1
2025-11-11T14:20:12.539028Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:1097: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Received TEvMessageBatch from [2:7571472399481445363:2063], seqNo 5, ConfirmedSeqNo 4 generation 1
2025-11-11T14:20:12.539045Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:1145: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. TEvMessageBatch NextOffset 9
2025-11-11T14:20:12.539067Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:12.539070Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:12.539074Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:12.539131Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:794: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. NextOffset 9
2025-11-11T14:20:12.539141Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:798: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Return 4 rows, watermark (empty maybe), buffer size 0, free space 999820, result size 180
2025-11-11T14:20:12.539147Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 180 bytes, 4 rows, finished: 0
2025-11-11T14:20:12.539183Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:12.539189Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:12.539190Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:12.539192Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 999820
2025-11-11T14:20:12.539195Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 999820, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:12.539233Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.539 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:12.539301Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:12.539305Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.539337Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:12.539340Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:12.539347Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:12.539372Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.539 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} channelId: 1. Took 4 rows
2025-11-11T14:20:12.539385Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.539 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:12.539399Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:566: TxId: ptqudslmk6ath0mgbk4q, task: 1. SendChannelData, channelId: 1, peer: [1:7571472466510497521:2217], chunks: 4, bytes: 153, watermark: 0, checkpoint: 0, seqNo: 5, finished: 0
2025-11-11T14:20:12.539421Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.539428Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:12.539430Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:12.539433Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:249;inFlightCount:1;)
2025-11-11T14:20:12.539436Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:12.539437Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:12.539440Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:12.539442Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:12.539448Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:12.539457Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.539 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:12.539462Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.539468Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:12.539469Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:12.539472Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:249;inFlightCount:1;)
2025-11-11T14:20:12.539900Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:179: TxId: ptqudslmk6ath0mgbk4q, task: 1. Received channel data ack for channelId: 1, seqNo: 5, lastSentSeqNo: 5, freeSpace: 999847, early finish: 0
2025-11-11T14:20:12.539915Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:207: TxId: ptqudslmk6ath0mgbk4q, task: 1. PeerState, peerState:(freeSpace:999847;inFlightBytes:0;inFlightCount:0;), sentSeqNo: 5, ackSeqNo: 5
2025-11-11T14:20:12.539916Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:220: TxId: ptqudslmk6ath0mgbk4q, task: 1. Resume compute actor
2025-11-11T14:20:12.539923Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:12.539925Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:12.539928Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:12.539931Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:12.539939Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:12.539964Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.539 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:12.539976Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.539992Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:12.540001Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:12.540004Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:999847;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:12.542137Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:874: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Received TEvStatistics from [2:7571472399481445363:2063], seqNo 6, ConfirmedSeqNo 4 generation 1
2025-11-11T14:20:12.546193Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:179: TxId: ptqudslmk6ath0mgbk4q, task: 1. Received channel data ack for channelId: 1, seqNo: 5, lastSentSeqNo: 5, freeSpace: 1000000, early finish: 0
2025-11-11T14:20:12.546209Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:207: TxId: ptqudslmk6ath0mgbk4q, task: 1. PeerState, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;), sentSeqNo: 5, ackSeqNo: 5
2025-11-11T14:20:12.546211Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:220: TxId: ptqudslmk6ath0mgbk4q, task: 1. Resume compute actor
2025-11-11T14:20:12.546221Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:12.546223Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:12.546228Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:12.546233Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:12.546248Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:12.546285Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.546 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:12.546303Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.546327Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:12.546337Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:12.546341Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:12.557113Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:295: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Checkpoint created
2025-11-11T14:20:12.557131Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:297: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Send TEvCreateCheckpointResponse
2025-11-11T14:20:12.557269Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:389: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvCreateCheckpointResponse
2025-11-11T14:20:12.557282Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:435: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Checkpoint successfully created, going to inject barriers to 1 actor(s)
2025-11-11T14:20:12.557309Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:239: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.5] TEvInjectCheckpoint
2025-11-11T14:20:12.557328Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:12.557337Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1502: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Skip polling sources because of pending checkpoint
2025-11-11T14:20:12.557340Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:694: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. DoExecuteImpl: 1
2025-11-11T14:20:12.557396Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.557 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:12.557452Z :DQ_TASK_RUNNER TRACE: task_runner_actor_local.cpp:510: SelfId: [3:7571472466549446803:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Pending 1 checkpoints to be sent
2025-11-11T14:20:12.557469Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.557502Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 1 watermark injected: (empty maybe)
2025-11-11T14:20:12.557513Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:447: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.5] Performing task checkpoint
2025-11-11T14:20:12.557516Z :KQP_COMPUTE DEBUG: dq_async_compute_actor.cpp:822: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Save state
2025-11-11T14:20:12.557524Z :KQP_COMPUTE DEBUG: dq_pq_read_actor_base.cpp:94: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. SessionId: empty SaveState, offsets: {0,9},
2025-11-11T14:20:12.557533Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:474: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.5] CA state saved
2025-11-11T14:20:12.557536Z :KQP_COMPUTE TRACE: dq_compute_actor_checkpoints.cpp:449: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.5] Injecting checkpoint barrier to outputs
2025-11-11T14:20:12.557549Z :KQP_COMPUTE DEBUG: dq_compute_actor_checkpoints.cpp:536: [ptqudslmk6ath0mgbk4q-0] Task: 1. [Checkpoint 2.5] Task checkpoint is done. Send to storage
2025-11-11T14:20:12.557551Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:12.557557Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:12.557574Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:566: TxId: ptqudslmk6ath0mgbk4q, task: 1. SendChannelData, channelId: 1, peer: [1:7571472466510497521:2217], chunks: 0, bytes: 0, watermark: 0, checkpoint: 1, seqNo: 6, finished: 0
2025-11-11T14:20:12.557586Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:409: [ptqudslmk6ath0mgbk4q-0] [2:5] Got TEvSaveTaskState: task 1
2025-11-11T14:20:12.557601Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:12.557609Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:12.557613Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:12.557620Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:12.557630Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:12.557646Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.557 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:12.557670Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.557679Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:12.557686Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:12.557689Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:96;inFlightCount:1;)
2025-11-11T14:20:12.558159Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:179: TxId: ptqudslmk6ath0mgbk4q, task: 1. Received channel data ack for channelId: 1, seqNo: 6, lastSentSeqNo: 6, freeSpace: 1000000, early finish: 0
2025-11-11T14:20:12.558176Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:207: TxId: ptqudslmk6ath0mgbk4q, task: 1. PeerState, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;), sentSeqNo: 6, ackSeqNo: 6
2025-11-11T14:20:12.558178Z :KQP_COMPUTE TRACE: dq_compute_actor_channels.cpp:220: TxId: ptqudslmk6ath0mgbk4q, task: 1. Resume compute actor
2025-11-11T14:20:12.558198Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll inputs
2025-11-11T14:20:12.558205Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:1506: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll sources
2025-11-11T14:20:12.558211Z :KQP_COMPUTE TRACE: dq_pq_rd_read_actor.cpp:754: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. GetAsyncInputData freeSpace = 1000000
2025-11-11T14:20:12.558217Z :KQP_COMPUTE TRACE: dq_compute_actor_async_input_helper.h:77: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Poll async input 0. Buffer free space: 1000000, read from async input: 0 bytes, 0 rows, finished: 0
2025-11-11T14:20:12.558231Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:844: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Send TEvContinueRun on OnAsyncInputPushFinished
2025-11-11T14:20:12.558276Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: c2e456c3-58156b0d-52e2332-b2a46162 2025-11-11 14:20:12.558 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] tasks_runner_local.cpp:267: {TODO/1} Run task: 1
2025-11-11T14:20:12.558301Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:491: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. update task runner stats
2025-11-11T14:20:12.558330Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:758: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Resume execution, run status: PendingInput checkpoint: 0 watermark injected: (empty maybe)
2025-11-11T14:20:12.558336Z :KQP_COMPUTE TRACE: dq_compute_actor_impl.h:393: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. ProcessOutputsState.Inflight: 0
2025-11-11T14:20:12.558340Z :KQP_COMPUTE TRACE: dq_async_compute_actor.cpp:532: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. About to drain channelId: 1, hasPeer: 1, peerState:(freeSpace:1000000;inFlightBytes:0;inFlightCount:0;)
2025-11-11T14:20:12.561591Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:433: [ptqudslmk6ath0mgbk4q-0] [2:5] TEvSaveTaskState Apply: task: 1
2025-11-11T14:20:12.561610Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:448: [ptqudslmk6ath0mgbk4q-0] [2:5] Send TEvSaveTaskStateResult: task: 1
2025-11-11T14:20:12.561685Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvSaveTaskStateResult; task 1, status: OK, size: 131
2025-11-11T14:20:12.561695Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Task state saved, need 1 more acks
2025-11-11T14:20:12.562564Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:466: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvSaveTaskStateResult; task 2, status: OK, size: 140
2025-11-11T14:20:12.562579Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:476: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Task state saved, need 0 more acks
2025-11-11T14:20:12.562581Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:489: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got all acks, changing checkpoint status to 'PendingCommit'
2025-11-11T14:20:12.562599Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:305: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvSetCheckpointPendingCommitStatusRequest
2025-11-11T14:20:12.587216Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:320: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Status updated to 'PendingCommit'
2025-11-11T14:20:12.587236Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:322: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Send TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:12.587365Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:501: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvSetCheckpointPendingCommitStatusResponse
2025-11-11T14:20:12.587374Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:516: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Checkpoint status changed to 'PendingCommit', committing states to 2 actor(s)
2025-11-11T14:20:12.587424Z :KQP_COMPUTE DEBUG: dq_compute_actor_impl.h:746: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Commit state
2025-11-11T14:20:12.587439Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvStateCommitted; task: 1
2025-11-11T14:20:12.587443Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:5] State committed [3:7571472466549446801:2167], need 1 more acks
2025-11-11T14:20:12.589814Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:532: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvStateCommitted; task: 2
2025-11-11T14:20:12.589831Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:541: [ptqudslmk6ath0mgbk4q-0.2] [2:5] State committed [1:7571472466510497521:2217], need 0 more acks
2025-11-11T14:20:12.589833Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:543: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got all acks, changing checkpoint status to 'Completed'
2025-11-11T14:20:12.589860Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:330: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvCompleteCheckpointRequest
2025-11-11T14:20:12.623468Z :STREAMS_STORAGE_SERVICE INFO: storage_proxy.cpp:348: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Status updated to 'Completed'
2025-11-11T14:20:12.623487Z :STREAMS_STORAGE_SERVICE DEBUG: storage_proxy.cpp:355: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Send TEvCompleteCheckpointResponse
2025-11-11T14:20:12.623527Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:564: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Got TEvCompleteCheckpointResponse
2025-11-11T14:20:12.623537Z :STREAMS_CHECKPOINT_COORDINATOR INFO: checkpoint_coordinator.cpp:579: [ptqudslmk6ath0mgbk4q-0.2] [2:5] Checkpoint completed
2025-11-11T14:20:13.234138Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616222, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:13.234139Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [2:7571472399481445439:2113]
2025-11-11T14:20:13.234158Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:20:13.234487Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:13.241951Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:13.241966Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:266: Tasks count: 0
2025-11-11T14:20:13.266901Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:318: TNodesManagerActor::NodesHealthCheck
2025-11-11T14:20:13.274842Z :YQL_NODES_MANAGER TRACE: nodes_manager.cpp:389: Send NodeInfo with size: 2 to DynamicNameserver
2025-11-11T14:20:13.290767Z :YQL_PROXY TRACE: log.cpp:64: SessionId:  2025-11-11 14:20:13.290 TRACE ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:271:  [3:7571472466549446799:2165] ExportStats Summary
2025-11-11T14:20:13.292411Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { statistics: "{\"Graph=0\":{\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"TaskRunner\":{\"Input=211130\":{\"Stage=211147\":{\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Input=Total\":{\"Stage=211147\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}},\"Stage=Total\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Output=211147\":{\"Stage=211130\":{\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Output=Total\":{\"Stage=211130\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}},\"Stage=Total\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Sink=0\":{\"Stage=211147\":{\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"EgressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"EgressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopActiveTimeUs\":{\"sum\":\"3.00s\",\"count\":1,\"avg\":\"3.00s\",\"max\":\"3.00s\",\"min\":\"3.00s\"},\"PopBytes\":{\"sum\":24,\"count\":1,\"avg\":24,\"max\":24,\"min\":24},\"PopChunks\":{\"sum\":8,\"count\":1,\"avg\":8,\"max\":8,\"min\":8},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:08.55s\",\"max\":\"14:20:08.55s\",\"min\":\"14:20:08.55s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushActiveTimeUs\":{\"sum\":\"3.00s\",\"count\":1,\"avg\":\"3.00s\",\"max\":\"3.00s\",\"min\":\"3.00s\"},\"PushBytes\":{\"sum\":24,\"count\":1,\"avg\":24,\"max\":24,\"min\":24},\"PushChunks\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:08.55s\",\"max\":\"14:20:08.55s\",\"min\":\"14:20:08.55s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:07.52s\",\"max\":\"14:20:07.52s\",\"min\":\"14:20:07.52s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PushRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushWaitPeriods\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}},\"Stage=Total\":{\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"EgressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"EgressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopActiveTimeUs\":{\"sum\":\"3.00s\",\"count\":1,\"avg\":\"3.00s\",\"max\":\"3.00s\",\"min\":\"3.00s\"},\"PopBytes\":{\"sum\":24,\"count\":1,\"avg\":24,\"max\":24,\"min\":24},\"PopChunks\":{\"sum\":8,\"count\":1,\"avg\":8,\"max\":8,\"min\":8},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:08.55s\",\"max\":\"14:20:08.55s\",\"min\":\"14:20:08.55s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushActiveTimeUs\":{\"sum\":\"3.00s\",\"count\":1,\"avg\":\"3.00s\",\"max\":\"3.00s\",\"min\":\"3.00s\"},\"PushBytes\":{\"sum\":24,\"count\":1,\"avg\":24,\"max\":24,\"min\":24},\"PushChunks\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:08.55s\",\"max\":\"14:20:08.55s\",\"min\":\"14:20:08.55s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:07.52s\",\"max\":\"14:20:07.52s\",\"min\":\"14:20:07.52s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PushRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushWaitPeriods\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Source=PqSource\":{\"Stage=211130\":{\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"IngressChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}},\"Stage=Total\":{\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"IngressChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Stage=211130\":{\"BuildCpuTimeUs\":{\"sum\":\"62ms\",\"count\":1,\"avg\":\"62ms\",\"max\":\"62ms\",\"min\":\"62ms\"},\"ComputeCpuTimeUs\":{\"sum\":\"53us\",\"count\":1,\"avg\":\"53us\",\"max\":\"53us\",\"min\":\"53us\"},\"CpuTimeUs\":{\"sum\":\"66ms\",\"count\":1,\"avg\":\"66ms\",\"max\":\"66ms\",\"min\":\"66ms\"},\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MkqlMaxMemoryUsage\":{\"sum\":2031616,\"count\":1,\"avg\":2031616,\"max\":2031616,\"min\":2031616},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=211147\":{\"BuildCpuTimeUs\":{\"sum\":\"93ms\",\"count\":1,\"avg\":\"93ms\",\"max\":\"93ms\",\"min\":\"93ms\"},\"ComputeCpuTimeUs\":{\"sum\":\"58us\",\"count\":1,\"avg\":\"58us\",\"max\":\"58us\",\"min\":\"58us\"},\"CpuTimeUs\":{\"sum\":\"99ms\",\"count\":1,\"avg\":\"99ms\",\"max\":\"99ms\",\"min\":\"99ms\"},\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"EgressRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MkqlMaxMemoryUsage\":{\"sum\":2031616,\"count\":1,\"avg\":2031616,\"max\":2031616,\"min\":2031616},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=Total\":{\"BuildCpuTimeUs\":{\"sum\":\"0.15s\",\"count\":2,\"avg\":\"78ms\",\"max\":\"93ms\",\"min\":\"62ms\"},\"ComputeCpuTimeUs\":{\"sum\":\"111us\",\"count\":2,\"avg\":\"55us\",\"max\":\"58us\",\"min\":\"53us\"},\"CpuTimeUs\":{\"sum\":\"0.16s\",\"count\":2,\"avg\":\"83ms\",\"max\":\"99ms\",\"min\":\"66ms\"},\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"EgressRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"MkqlMaxMemoryUsage\":{\"sum\":4063232,\"count\":2,\"avg\":2031616,\"max\":2031616,\"min\":2031616},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1}}}}}" }
2025-11-11T14:20:13.292425Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:13.303866Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { action: ABORT expired_at { seconds: 1762870833 nanos: 298000000 } }
2025-11-11T14:20:13.303886Z :FQ_PINGER DEBUG: pinger.cpp:342: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Query action: ABORT
2025-11-11T14:20:13.303914Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:690: QueryId: ptqudslmk6ath0mgbk4q New query action received: ABORT
2025-11-11T14:20:13.303919Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1827: QueryId: ptqudslmk6ath0mgbk4q Is about to finish query with status ABORTED_BY_USER
2025-11-11T14:20:13.303922Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1820: QueryId: ptqudslmk6ath0mgbk4q Write finalizing status: ABORTING_BY_USER
2025-11-11T14:20:13.303936Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:528: QueryId: ptqudslmk6ath0mgbk4q Cancel running query
2025-11-11T14:20:13.303953Z :FQ_RUN_ACTOR TRACE: run_actor.cpp:880: QueryId: ptqudslmk6ath0mgbk4q Forward ping response. Success: 1. Cookie: 6
2025-11-11T14:20:13.303968Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { status: ABORTING_BY_USER }
2025-11-11T14:20:13.303972Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:13.304116Z :YQL_PROXY DEBUG: log.cpp:64: SessionId:  2025-11-11 14:20:13.303 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:130: AbortExecution from [3:7571472466549446795:2161]:ABORTED { <main>: Error: ABORTED_BY_USER }
2025-11-11T14:20:13.304139Z :YQL_PROXY DEBUG: log.cpp:64: SessionId:  2025-11-11 14:20:13.304 DEBUG ydbd(pid=1078664, tid=0x00007F43FE516640) [DQ] task_controller_impl.h:598: OnError { <main>: Error: ABORTED_BY_USER } ABORTED
2025-11-11T14:20:13.304663Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:13.304 DEBUG ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] executer_actor.cpp:304: {ptqudslmk6ath0mgbk4q} OnFailure, status=4, issues size=1, sender=[3:7571472466549446799:2165]
2025-11-11T14:20:13.304798Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:13.304 DEBUG ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] executer_actor.cpp:315: {ptqudslmk6ath0mgbk4q} Issues: <main>: Error: ABORTED_BY_USER

2025-11-11T14:20:13.304814Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:13.304 DEBUG ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] executer_actor.cpp:284: {ptqudslmk6ath0mgbk4q} Finish with status=4 issues=<main>: Error: ABORTED_BY_USER

2025-11-11T14:20:13.305197Z :YQL_PROXY DEBUG: log.cpp:64: SessionId: ptqudslmk6ath0mgbk4q 2025-11-11 14:20:13.305 DEBUG ydbd(pid=1078664, tid=0x00007F43FDD15640) [DQ] executer_actor.cpp:341: {ptqudslmk6ath0mgbk4q} OnQueryResponse status=4 issuses_size=1
2025-11-11T14:20:13.305231Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1397: QueryId: ptqudslmk6ath0mgbk4q TEvQueryResponse received on finish
2025-11-11T14:20:13.305239Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1234: QueryId: ptqudslmk6ath0mgbk4q Query response CANCELLED. Result set index: 0. Issues count: 1. Rows count: 0
2025-11-11T14:20:13.305391Z :KQP_COMPUTE ERROR: dq_compute_actor_impl.h:1215: SelfId: [3:7571472466549446801:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1. Ctx: {}. Handle abort execution event from: [3:7571472406419904342:2064], status: UNAVAILABLE, reason: { <main>: Error: Aborted by LWM }
2025-11-11T14:20:13.305449Z :KQP_COMPUTE DEBUG: dq_compute_actor_channels.cpp:494: TxId: ptqudslmk6ath0mgbk4q, task: 1. pass away
2025-11-11T14:20:13.305555Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:731: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. PassAway
2025-11-11T14:20:13.305576Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:1216: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. State: used buffer size 0 ready buffer event size 0 state 5 InFlyAsyncInputData 0
Counters: CoordinatorChanged 2 CoordinatorResult 1 MessageBatch 1 StartSessionAck 1 NewDataArrived 1 SessionError 0 Statistics 3 NodeDisconnected 0 NodeConnected 2 Undelivered 0 Retry 1 PrivateHeartbeat 2 SessionClosed 0 Pong 0 Heartbeat 0 PrintState 0 ProcessState 0 GetAsyncInputData 16 NotifyCA 1
 [2:7571472399481445363:2063] status 2 is waiting ack 0 connection id 1 id 1, NextSeqNo 5, MyConfSeqNo 6, SeqNos 0, events size 0, connected 1, heartbeat shed 1, last received 2025-11-11T14:20:12.542144Z, last sent 2025-11-11T14:20:12.538508Z
 partitions 0 offsets 0=9 has pending data
2025-11-11T14:20:13.305578Z :KQP_COMPUTE INFO: dq_pq_rd_read_actor.cpp:723: SelfId: [3:7571472466549446805:2167], TxId: ptqudslmk6ath0mgbk4q, task: 1, Cluster: . PQ source. Send StopSession to [2:7571472399481445363:2063] generation 1
2025-11-11T14:20:13.306343Z :STREAMS_CHECKPOINT_COORDINATOR DEBUG: checkpoint_coordinator.cpp:657: [ptqudslmk6ath0mgbk4q-0.2] PassAway
2025-11-11T14:20:13.318280Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { action: ABORT expired_at { seconds: 1762870833 nanos: 313000000 } }
2025-11-11T14:20:13.318291Z :FQ_PINGER DEBUG: pinger.cpp:342: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Query action: ABORT
2025-11-11T14:20:13.318317Z :FQ_RUN_ACTOR TRACE: run_actor.cpp:880: QueryId: ptqudslmk6ath0mgbk4q Forward ping response. Success: 1. Cookie: 3
2025-11-11T14:20:13.318319Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:887: QueryId: ptqudslmk6ath0mgbk4q Finalizing status is saved
2025-11-11T14:20:13.318360Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1508: QueryId: ptqudslmk6ath0mgbk4q Start rate limiter resource deleter
2025-11-11T14:20:13.318374Z :STREAMS DEBUG: read_rule_deleter.cpp:214: ptqudslmk6ath0mgbk4q: Create read rule deleter actor for `test_group_by_hop_restart_node_input` [0]
2025-11-11T14:20:13.318415Z :STREAMS DEBUG: read_rule_deleter.cpp:106: ptqudslmk6ath0mgbk4q: Make request for read rule deletion for topic `test_group_by_hop_restart_node_input` [0]
2025-11-11T14:20:13.359645Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1499: QueryId: ptqudslmk6ath0mgbk4q Rate limiter resource deletion finished. Success: 1. Issues: 
2025-11-11T14:20:13.359659Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:1919: QueryId: ptqudslmk6ath0mgbk4q SendPingAndPassAway, FinalQueryStatus ABORTED_BY_USER
2025-11-11T14:20:13.359683Z :FQ_RUN_ACTOR DEBUG: run_actor.cpp:536: QueryId: ptqudslmk6ath0mgbk4q PassAway
2025-11-11T14:20:13.359913Z :FQ_PINGER TRACE: pinger.cpp:250: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward ping request: { result_id { value: "ptrudslmjrvf4jco808t" } status: ABORTED_BY_USER issues { message: "ABORTED_BY_USER" severity: 1 } statistics: "{\"Graph=0\":{\"Actor\":{\"ActorCreateTimeUs\":{\"sum\":\"70ms\",\"count\":2,\"avg\":\"35ms\",\"max\":\"35ms\",\"min\":\"34ms\"}},\"AllocateWorkersUs\":{\"sum\":\"36ms\",\"count\":1,\"avg\":\"36ms\",\"max\":\"36ms\",\"min\":\"36ms\"},\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"ExecutionTimeUs\":{\"sum\":\"6.01s\",\"count\":1,\"avg\":\"6.01s\",\"max\":\"6.01s\",\"min\":\"6.01s\"},\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"TaskRunner\":{\"Input=211130\":{\"Stage=211147\":{\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Input=Total\":{\"Stage=211147\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}},\"Stage=Total\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Output=211147\":{\"Stage=211130\":{\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Output=Total\":{\"Stage=211130\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}},\"Stage=Total\":{\"ChannelCount\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Sink=0\":{\"Stage=211147\":{\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"EgressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"EgressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopActiveTimeUs\":{\"sum\":\"3.00s\",\"count\":1,\"avg\":\"3.00s\",\"max\":\"3.00s\",\"min\":\"3.00s\"},\"PopBytes\":{\"sum\":24,\"count\":1,\"avg\":24,\"max\":24,\"min\":24},\"PopChunks\":{\"sum\":8,\"count\":1,\"avg\":8,\"max\":8,\"min\":8},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:08.55s\",\"max\":\"14:20:08.55s\",\"min\":\"14:20:08.55s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushActiveTimeUs\":{\"sum\":\"3.00s\",\"count\":1,\"avg\":\"3.00s\",\"max\":\"3.00s\",\"min\":\"3.00s\"},\"PushBytes\":{\"sum\":24,\"count\":1,\"avg\":24,\"max\":24,\"min\":24},\"PushChunks\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:08.55s\",\"max\":\"14:20:08.55s\",\"min\":\"14:20:08.55s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:07.52s\",\"max\":\"14:20:07.52s\",\"min\":\"14:20:07.52s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PushRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushWaitPeriods\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}},\"Stage=Total\":{\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"EgressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"EgressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopActiveTimeUs\":{\"sum\":\"3.00s\",\"count\":1,\"avg\":\"3.00s\",\"max\":\"3.00s\",\"min\":\"3.00s\"},\"PopBytes\":{\"sum\":24,\"count\":1,\"avg\":24,\"max\":24,\"min\":24},\"PopChunks\":{\"sum\":8,\"count\":1,\"avg\":8,\"max\":8,\"min\":8},\"PopFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:08.55s\",\"max\":\"14:20:08.55s\",\"min\":\"14:20:08.55s\"},\"PopLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushActiveTimeUs\":{\"sum\":\"3.00s\",\"count\":1,\"avg\":\"3.00s\",\"max\":\"3.00s\",\"min\":\"3.00s\"},\"PushBytes\":{\"sum\":24,\"count\":1,\"avg\":24,\"max\":24,\"min\":24},\"PushChunks\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushFirstMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:08.55s\",\"max\":\"14:20:08.55s\",\"min\":\"14:20:08.55s\"},\"PushLastMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PushPauseMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:07.52s\",\"max\":\"14:20:07.52s\",\"min\":\"14:20:07.52s\"},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushResumeMessageMs\":{\"sum\":\"N/A\",\"count\":1,\"avg\":\"14:20:11.55s\",\"max\":\"14:20:11.55s\",\"min\":\"14:20:11.55s\"},\"PushRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushWaitPeriods\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Source=PqSource\":{\"Stage=211130\":{\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"IngressChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}},\"Stage=Total\":{\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"IngressChunks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PopQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"PushWaitTimeUs\":{\"sum\":\"4.03s\",\"count\":1,\"avg\":\"4.03s\",\"max\":\"4.03s\",\"min\":\"4.03s\"}}},\"Stage=211130\":{\"BuildCpuTimeUs\":{\"sum\":\"62ms\",\"count\":1,\"avg\":\"62ms\",\"max\":\"62ms\",\"min\":\"62ms\"},\"ComputeCpuTimeUs\":{\"sum\":\"53us\",\"count\":1,\"avg\":\"53us\",\"max\":\"53us\",\"min\":\"53us\"},\"CpuTimeUs\":{\"sum\":\"66ms\",\"count\":1,\"avg\":\"66ms\",\"max\":\"66ms\",\"min\":\"66ms\"},\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MkqlMaxMemoryUsage\":{\"sum\":2031616,\"count\":1,\"avg\":2031616,\"max\":2031616,\"min\":2031616},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=211147\":{\"BuildCpuTimeUs\":{\"sum\":\"93ms\",\"count\":1,\"avg\":\"93ms\",\"max\":\"93ms\",\"min\":\"93ms\"},\"ComputeCpuTimeUs\":{\"sum\":\"58us\",\"count\":1,\"avg\":\"58us\",\"max\":\"58us\",\"min\":\"58us\"},\"CpuTimeUs\":{\"sum\":\"99ms\",\"count\":1,\"avg\":\"99ms\",\"max\":\"99ms\",\"min\":\"99ms\"},\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"EgressRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"IngressQueuedBytes\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MkqlMaxMemoryUsage\":{\"sum\":2031616,\"count\":1,\"avg\":2031616,\"max\":2031616,\"min\":2031616},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":1,\"avg\":0,\"max\":0,\"min\":0},\"Tasks\":{\"sum\":1,\"count\":1,\"avg\":1,\"max\":1,\"min\":1}},\"Stage=Total\":{\"BuildCpuTimeUs\":{\"sum\":\"0.15s\",\"count\":2,\"avg\":\"78ms\",\"max\":\"93ms\",\"min\":\"62ms\"},\"ComputeCpuTimeUs\":{\"sum\":\"111us\",\"count\":2,\"avg\":\"55us\",\"max\":\"58us\",\"min\":\"53us\"},\"CpuTimeUs\":{\"sum\":\"0.16s\",\"count\":2,\"avg\":\"83ms\",\"max\":\"99ms\",\"min\":\"66ms\"},\"EgressBytes\":{\"sum\":124,\"count\":1,\"avg\":124,\"max\":124,\"min\":124},\"EgressRows\":{\"sum\":4,\"count\":1,\"avg\":4,\"max\":4,\"min\":4},\"IngressBytes\":{\"sum\":310,\"count\":1,\"avg\":310,\"max\":310,\"min\":310},\"IngressQueuedBytes\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"IngressQueuedRows\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"MkqlMaxMemoryUsage\":{\"sum\":4063232,\"count\":2,\"avg\":2031616,\"max\":2031616,\"min\":2031616},\"MultiHop_EarlyThrownEventsCount\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"MultiHop_LateThrownEventsCount\":{\"sum\":0,\"count\":2,\"avg\":0,\"max\":0,\"min\":0},\"Tasks\":{\"sum\":2,\"count\":2,\"avg\":1,\"max\":1,\"min\":1}}},\"UniqueWorkers\":{\"sum\":2,\"count\":1,\"avg\":2,\"max\":2,\"min\":2}}}" resources { rate_limiter: READY compilation: READY topic_consumers_state: READY rate_limiter_path: "local/RateLimiter_0daf70c6-4121-4158-87c6-13d85e7af04f/rate_limiter" topic_consumers { database: "local" topic_path: "test_group_by_hop_restart_node_input" consumer_name: "ptqudslmk6ath0mgbk4q" cluster_endpoint: "localhost:11255" token_name: "cluster:default_yds" add_bearer_to_token: true } } finished_at { seconds: 1762870813 nanos: 303000000 } }
2025-11-11T14:20:13.359926Z :FQ_PINGER TRACE: pinger.cpp:393: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Forward request Private::PingTask
2025-11-11T14:20:13.452800Z :FQ_PINGER TRACE: pinger.cpp:338: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Ping response success: { action: ABORT }
2025-11-11T14:20:13.452833Z :FQ_PINGER DEBUG: pinger.cpp:379: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Query finished
2025-11-11T14:20:13.452836Z :FQ_PINGER TRACE: pinger.cpp:187: QueryId: ptqudslmk6ath0mgbk4q, Owner: c2e456c3-58156b0d-52e2332-b2a4616215 Stop Pinger
2025-11-11T14:20:14.234601Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616223, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:14.239378Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:14.239403Z :FQ_PENDING_FETCHER ERROR: pending_fetcher.cpp:259: Error with GetTask: <main>: Error: GRpc error: (14): connections to all backends failing; last error: UNKNOWN: ipv4:127.0.1.1:5653: Failed to connect to remote host: Connection refused
<main>: Error: Grpc error response on endpoint ghrun-vb3yoermsa.auto.internal:5653
2025-11-11T14:20:15.235029Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:617: RowDispatcher: Send ping to [2:7571472399481445439:2113]
2025-11-11T14:20:15.235038Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616224, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:15.235055Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:1161: RowDispatcher: TEvPrivate::TEvSendStatistic
2025-11-11T14:20:15.235407Z :FQ_ROW_DISPATCHER TRACE: row_dispatcher.cpp:623: RowDispatcher: NActors::TEvents::TEvPong
2025-11-11T14:20:15.243264Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:15.243289Z :FQ_PENDING_FETCHER ERROR: pending_fetcher.cpp:259: Error with GetTask: <main>: Error: GRpc error: (14): connections to all backends failing; last error: UNKNOWN: ipv4:127.0.1.1:5653: Failed to connect to remote host: Connection refused
<main>: Error: Grpc error response on endpoint ghrun-vb3yoermsa.auto.internal:5653
2025-11-11T14:20:16.235506Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:329: Request Private::GetTask, Owner: c2e456c3-58156b0d-52e2332-b2a4616225, Host: ghrun-vb3yoermsa, Tenant: /compute
2025-11-11T14:20:16.247171Z :FQ_PENDING_FETCHER TRACE: pending_fetcher.cpp:254: Got GetTask response from PrivateApi
2025-11-11T14:20:16.247198Z :FQ_PENDING_FETCHER ERROR: pending_fetcher.cpp:259: Error with GetTask: <main>: Error: GRpc error: (14): connections to all backends failing; last error: UNKNOWN: ipv4:127.0.1.1:5653: Failed to connect to remote host: Connection refused
<main>: Error: Grpc error response on endpoint ghrun-vb3yoermsa.auto.internal:5653
