2025-10-21T14:16:02.202785Z node 19 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[19:7563678626493731148:2079];send_to=[0:7307199536658146131:7762515];
2025-10-21T14:16:02.203031Z node 19 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-21T14:16:02.276970Z node 20 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[20:7563678624390748511:2085];send_to=[0:7307199536658146131:7762515];
2025-10-21T14:16:02.277878Z node 20 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-21T14:16:02.297346Z node 19 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/5f2y/000f6e/r3tmp/tmpZz5H0v/pdisk_1.dat
2025-10-21T14:16:02.350182Z node 20 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639239 Duration# 0.013994s
2025-10-21T14:16:02.367950Z node 19 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-21T14:16:02.388481Z node 20 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-21T14:16:02.389295Z node 20 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-21T14:16:02.594526Z node 19 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-21T14:16:02.596658Z node 19 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-21T14:16:02.636167Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(19, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-21T14:16:02.636311Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(19, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-21T14:16:02.639091Z node 20 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-21T14:16:02.642330Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-21T14:16:02.642452Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-21T14:16:02.649285Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(19, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-21T14:16:02.656909Z node 19 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 20 Cookie 20
2025-10-21T14:16:02.661219Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 24669, node 19
2025-10-21T14:16:02.754125Z node 19 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/5f2y/000f6e/r3tmp/yandex8cx7Iz.tmp
2025-10-21T14:16:02.754159Z node 19 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/5f2y/000f6e/r3tmp/yandex8cx7Iz.tmp
2025-10-21T14:16:02.754335Z node 19 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/5f2y/000f6e/r3tmp/yandex8cx7Iz.tmp
2025-10-21T14:16:02.754543Z node 19 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-21T14:16:02.817897Z INFO: TTestServer started on Port 24556 GrpcPort 24669
2025-10-21T14:16:02.991983Z node 19 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:24556
PQClient connected to localhost:24669
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-10-21T14:16:03.243562Z node 19 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-21T14:16:03.293466Z node 20 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-21T14:16:03.379553Z node 20 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-21T14:16:03.387896Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-21T14:16:03.459805Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
waiting...
waiting...
2025-10-21T14:16:07.189039Z node 19 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[19:7563678626493731148:2079];send_to=[0:7307199536658146131:7762515];
2025-10-21T14:16:07.189125Z node 19 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-21T14:16:07.275752Z node 20 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[20:7563678624390748511:2085];send_to=[0:7307199536658146131:7762515];
2025-10-21T14:16:07.275858Z node 20 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-21T14:16:09.876167Z node 20 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [20:7563678654455519941:2302], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-21T14:16:09.879757Z node 20 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=20&id=ZjA1ZjRlMjEtNjEyNjEzMGQtZmEzOGEyYy00OTMwZWJiMg==, ActorId: [20:7563678654455519939:2301], ActorState: ExecuteState, TraceId: 01k83j17tk49nkcsaqz506bejn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-21T14:16:09.880343Z node 20 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-21T14:16:10.167565Z node 19 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k83j11x6dg1jxnjpv5gratta", Request deadline has expired for 1.429144s seconds
2025-10-21T14:16:10.229324Z node 19 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [19:7563678660853470638:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-21T14:16:10.233246Z node 19 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=19&id=YjhkNjQ1YjEtY2EyOTY5MmItOWFmNDE5ZWEtYWNmNjc0ZDg=, ActorId: [19:7563678660853470636:2329], ActorState: ExecuteState, TraceId: 01k83j185s1jyx31nxx0xmtk30, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-21T14:16:10.233914Z node 19 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-21T14:16:10.257972Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-21T14:16:10.433557Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-21T14:16:10.670354Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-21T14:16:11.187298Z node 19 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710665. Ctx: { TraceId: 01k83j18vbawvpr8vt0a8788mg, Database: , SessionId: ydb://session/3?node_id=19&id=NTY1MDE0NDYtOGUzMDA0YmQtYzFiNDhjMzEtNTRlNDg0MWY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [19:7563678665148438390:3066] 
2025-10-21T14:16:17.532024Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7712: Cannot get console configs
2025-10-21T14:16:17.532059Z node 19 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:24669
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-21T14:16:17.755711Z node 19 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:24669
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710678
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-21T14:16:17.818764Z node 19 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [19:7563678690918242698:3355] connected; active server actors: 1
2025-10-21T14:16:17.819338Z node 19 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-21T14:16:17.820232Z node 19 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-21T14:16:17.831462Z node 19 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-10-21T14:16:17.846655Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2962: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-21T14:16:17.851392Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2994: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-21T14:16:17.851767Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-21T14:16:17.851811Z node 20 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-21T14:16:17.851868Z node 20 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-21T14:16:17.853782Z node 19 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 20, Generation 1
2025-10-21T14:16:17.856301Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [19:7563678690918242697:3354], now have 1 active actors on pipe
2025-10-21T14:16:17.856347Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [19:7563678690918242712:2454], now have 1 active actors on pipe
2025-10-21T14:16:17.856917Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-21T14:16:17.867716Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-21T14:16:17.880020Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [19:7563678690918242742:3394], now have 1 active actors on pipe
2025-10-21T14:16:17.882489Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-21T14:16:17.892462Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-21T14:16:17.893867Z node 20 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-21T14:16:17.893934Z node 20 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-21T14:16:17.894318Z node 20 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-21T14:16:17.894607Z node 20 :PERSQUEUE INFO: partition_init.cpp:1095: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [20:7563678688815258730:2393]
2025-10-21T14:16:17.901692Z node 20 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-21T14:16:17.901741Z node 20 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-21T14:16:17.901771Z node 20 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [20:7563678688815258730:2393]
2025-10-21T14:16:17.901810Z node 20 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-21T14:16:17.903671Z node 20 :PERSQUEUE DEBUG: partition.cpp:4312: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-21T14:16:17.903711Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:17.903832Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:17.903850Z node 20 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-21T14:16:17.903878Z node 20 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-21T14:16:17.903894Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:17.903908Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:17.903924Z node 20 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-21T14:16:17.903971Z node 20 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-21T14:16:17.904502Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-21T14:16:17.904669Z node 20 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-21T14:16:17.911364Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-21T14:16:17.911606Z node 20 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761056177923, TxId 281474976710678
2025-10-21T14:16:17.911630Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:17.911651Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:17.911856Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:17.912186Z node 20 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-21T14:16:17.920886Z node 20 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-21T14:16:17.921288Z node 20 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-21T14:16:17.921324Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:17.921341Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:17.921357Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:17.921394Z node 20 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-21T14:16:17.921847Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-21T14:16:17.921982Z node 20 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-21T14:16:17.922392Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-21T14:16:17.934778Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-21T14:16:17.934933Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-21T14:16:17.946017Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-21T14:16:18.007483Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.007522Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.007542Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:18.110414Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.110451Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.110469Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:18.159873Z node 19 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710679. Ctx: { TraceId: 01k83j1fn7f0eyv2jj7yxezmhg, Database: , SessionId: ydb://session/3?node_id=19&id=MWNjNTRiOTUtN2U5YzEzNy1hNDQzNzBhMi1jY2Q0YmIwZg==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-21T14:16:18.210907Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.210941Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.210960Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710678
    CreateStep: 1761056177923
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710678
    CreateStep: 1761056177923
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:24669
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-21T14:16:18.238597Z node 19 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-21T14:16:18.313833Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.313862Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.313884Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:18.415783Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.415818Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.415835Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:18.516587Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.516621Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.516638Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:18.617583Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.617626Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.617656Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:18.719116Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.719150Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.719176Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:24669
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-21T14:16:18.748965Z node 19 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-21T14:16:18.755617Z node 19 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-21T14:16:18.755654Z node 19 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-21T14:16:18.756150Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "12345678" }
2025-10-21T14:16:18.756301Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "12345678" from ipv6:[::1]:49448
2025-10-21T14:16:18.756334Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49448 proto=v1  topic=topic1 durationSec=0
2025-10-21T14:16:18.756346Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-21T14:16:18.758354Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-21T14:16:18.758493Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-21T14:16:18.758512Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-21T14:16:18.758520Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-21T14:16:18.758536Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [19:7563678695213210181:2474] (SourceId=12345678, PreferedPartition=(NULL)) StartKqpSession
2025-10-21T14:16:18.762231Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [19:7563678695213210181:2474] (SourceId=12345678, PreferedPartition=(NULL)) Select from the table
2025-10-21T14:16:18.819171Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.819206Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.819224Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:18.919529Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:18.919559Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:18.919576Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.021199Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.021249Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.021269Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.033294Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [19:7563678695213210181:2474] (SourceId=12345678, PreferedPartition=(NULL)) RequestPQRB
2025-10-21T14:16:19.034165Z node 19 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [19:7563678699508177524:2474] connected; active server actors: 1
2025-10-21T14:16:19.034329Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [19:7563678695213210181:2474] (SourceId=12345678, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=12345678
2025-10-21T14:16:19.034350Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [19:7563678695213210181:2474] (SourceId=12345678, PreferedPartition=(NULL)) Update the table
2025-10-21T14:16:19.074799Z node 19 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [19:7563678699508177524:2474] disconnected; active server actors: 1
2025-10-21T14:16:19.074838Z node 19 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [19:7563678699508177524:2474] disconnected no session
2025-10-21T14:16:19.128280Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.128313Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.128335Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.228372Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.228411Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.228433Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.320892Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [19:7563678695213210181:2474] (SourceId=12345678, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-21T14:16:19.320959Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [19:7563678695213210181:2474] (SourceId=12345678, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-21T14:16:19.320994Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [19:7563678695213210181:2474] (SourceId=12345678, PreferedPartition=(NULL)) Start idle
2025-10-21T14:16:19.321051Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-21T14:16:19.325671Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [19:7563678699508177549:2474], now have 1 active actors on pipe
2025-10-21T14:16:19.329126Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.329161Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.329183Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.331885Z node 19 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 20, Generation: 1
2025-10-21T14:16:19.332601Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-21T14:16:19.332650Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-21T14:16:19.332761Z node 20 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie 12345678|c7cd53f5-3153fe10-94dd7421-82da9263_0 generated for partition 0 topic 'rt3.dc1--topic1' owner 12345678
2025-10-21T14:16:19.332807Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.332832Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.332853Z node 20 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-21T14:16:19.332902Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.332970Z node 20 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-21T14:16:19.333032Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-21T14:16:19.334120Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-21T14:16:19.334151Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-21T14:16:19.334252Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-21T14:16:19.335829Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: 12345678|c7cd53f5-3153fe10-94dd7421-82da9263_0
2025-10-21T14:16:19.343499Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: 12345678|c7cd53f5-3153fe10-94dd7421-82da9263_0 grpc read done: success: 0 data: 
2025-10-21T14:16:19.343537Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: 12345678|c7cd53f5-3153fe10-94dd7421-82da9263_0 grpc read failed
2025-10-21T14:16:19.343776Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: 12345678|c7cd53f5-3153fe10-94dd7421-82da9263_0
2025-10-21T14:16:19.343803Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: 12345678|c7cd53f5-3153fe10-94dd7421-82da9263_0 is DEAD
2025-10-21T14:16:19.344233Z node 19 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
Finish: 0 
2025-10-21T14:16:19.344915Z :PreferredCluster_RemotePreferredClusterEnabledWhileSessionInitializing_SessionDiesOnlyAfterInitializationAndDelay INFO: Random seed for debugging is 1761056179344900
2025-10-21T14:16:19.346188Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [19:7563678699508177549:2474] destroyed
2025-10-21T14:16:19.346231Z node 20 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-21T14:16:19.346265Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.346280Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.346293Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.437985Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.438025Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.438045Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.538314Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.538352Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.538370Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.639653Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.639691Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.639710Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.743505Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.743545Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.743565Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.816559Z node 19 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710687. Ctx: { TraceId: 01k83j1h635kyemk722bjeznsz, Database: , SessionId: ydb://session/3?node_id=19&id=OGU0NmI0N2QtNjEwOTAwOTQtYjBlNmM5N2MtZjYwNDMxZDc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-21T14:16:19.826146Z node 19 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710688. Ctx: { TraceId: 01k83j1h635kyemk722bjeznsz, Database: , SessionId: ydb://session/3?node_id=19&id=OGU0NmI0N2QtNjEwOTAwOTQtYjBlNmM5N2MtZjYwNDMxZDc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-21T14:16:19.846651Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.846683Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.846702Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:19.883960Z node 19 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-21T14:16:19.883986Z node 19 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-21T14:16:19.947053Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:19.947078Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:19.947101Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.047473Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.047506Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.047528Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.148236Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.148270Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.148290Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.249649Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.249700Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.249722Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.346121Z node 19 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710690. Ctx: { TraceId: 01k83j1hpq45aeg9k1r9yftgb4, Database: , SessionId: ydb://session/3?node_id=19&id=NmU1YmNiYTItNTVhZWQ3NDEtNTU1ZWJmMzYtM2ZhNzViMjA=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-21T14:16:20.350797Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.350837Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.350855Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.354416Z node 19 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710691. Ctx: { TraceId: 01k83j1hpq45aeg9k1r9yftgb4, Database: , SessionId: ydb://session/3?node_id=19&id=NmU1YmNiYTItNTVhZWQ3NDEtNTU1ZWJmMzYtM2ZhNzViMjA=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-21T14:16:20.380461Z :PreferredCluster_RemotePreferredClusterEnabledWhileSessionInitializing_SessionDiesOnlyAfterInitializationAndDelay INFO: Wait for cluster tracker event
2025-10-21T14:16:20.380834Z :PreferredCluster_RemotePreferredClusterEnabledWhileSessionInitializing_SessionDiesOnlyAfterInitializationAndDelay INFO: Wait for "init_response"
2025-10-21T14:16:20.381178Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "test-message-group-id-dc2" preferred_cluster: "dc2" }
2025-10-21T14:16:20.381380Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "test-message-group-id-dc2" preferred_cluster: "dc2" from ipv6:[::1]:49448
2025-10-21T14:16:20.381406Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49448 proto=v1  topic=topic1 durationSec=0
2025-10-21T14:16:20.381420Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-21T14:16:20.383257Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-21T14:16:20.383441Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-21T14:16:20.383465Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-21T14:16:20.383481Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-21T14:16:20.383502Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) StartKqpSession
2025-10-21T14:16:20.387596Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Select from the table
2025-10-21T14:16:20.396281Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) RequestPQRB
2025-10-21T14:16:20.396978Z node 19 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [19:7563678703803145074:2516] connected; active server actors: 1
2025-10-21T14:16:20.397092Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id-dc2
2025-10-21T14:16:20.397117Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Update the table
2025-10-21T14:16:20.397879Z node 19 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [19:7563678703803145074:2516] disconnected; active server actors: 1
2025-10-21T14:16:20.397904Z node 19 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [19:7563678703803145074:2516] disconnected no session
2025-10-21T14:16:20.409505Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-21T14:16:20.409555Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-21T14:16:20.409578Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Start idle
2025-10-21T14:16:20.409615Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-21T14:16:20.411517Z node 19 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 20, Generation: 1
2025-10-21T14:16:20.411392Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [19:7563678703803145083:2516], now have 1 active actors on pipe
2025-10-21T14:16:20.413092Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-21T14:16:20.413126Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-21T14:16:20.413205Z node 20 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id-dc2|eb5d98b4-f0ec0ed8-1682780c-d28df07a_0 generated for partition 0 topic 'rt3.dc1--topic1' owner test-message-group-id-dc2
2025-10-21T14:16:20.413247Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.413266Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.413286Z node 20 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-21T14:16:20.413325Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.413362Z node 20 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-21T14:16:20.413414Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-21T14:16:20.415621Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-21T14:16:20.415665Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-21T14:16:20.415749Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-21T14:16:20.416370Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id-dc2|eb5d98b4-f0ec0ed8-1682780c-d28df07a_0
Init response: status: SUCCESS init_response { session_id: "test-message-group-id-dc2|eb5d98b4-f0ec0ed8-1682780c-d28df07a_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP }
2025-10-21T14:16:20.419651Z :PreferredCluster_RemotePreferredClusterEnabledWhileSessionInitializing_SessionDiesOnlyAfterInitializationAndDelay INFO: Session ID is "test-message-group-id-dc2|eb5d98b4-f0ec0ed8-1682780c-d28df07a_0"
2025-10-21T14:16:20.423505Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id-dc2|eb5d98b4-f0ec0ed8-1682780c-d28df07a_0 grpc read done: success: 1 data:  update_token_request [content omitted]
2025-10-21T14:16:20.423985Z :PreferredCluster_RemotePreferredClusterEnabledWhileSessionInitializing_SessionDiesOnlyAfterInitializationAndDelay INFO: Set small delay and wait for initialized session with remote preferred cluster to die
2025-10-21T14:16:20.451543Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.451575Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.451593Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.554049Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.554081Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.554099Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.655487Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.655527Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.655548Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.757025Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.757082Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.757103Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.859118Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.859156Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.859175Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:20.963494Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:20.963531Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:20.963554Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.064473Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.064504Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.064524Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.167946Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.167986Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.168007Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.268072Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.268107Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.268128Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.369467Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.369501Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.369522Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.423231Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Update the table
2025-10-21T14:16:21.473074Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.473109Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.473132Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.574344Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.574379Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.574398Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.675540Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.675582Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.675603Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.779500Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.779540Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.779561Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.879469Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.879503Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.879523Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:21.928352Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-21T14:16:21.928397Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [19:7563678703803145058:2516] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Start idle
2025-10-21T14:16:21.979213Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:21.979249Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:21.979271Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.081775Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.081817Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.081841Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.182337Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.182380Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.182402Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.282687Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.282725Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.282749Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.385160Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.385205Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.385258Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.486440Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.486482Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.486506Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.570952Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: Session preferred cluster "dc2" is enabled for at least 2.000000s and session is older than 2.000000s sessionId: test-message-group-id-dc2|eb5d98b4-f0ec0ed8-1682780c-d28df07a_0
2025-10-21T14:16:22.571390Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id-dc2|eb5d98b4-f0ec0ed8-1682780c-d28df07a_0 is DEAD
status: ABORTED
issues {
  message: "Session preferred cluster \"dc2\" is enabled for at least 2.000000s and session is older than 2.000000s"
  issue_code: 500026
  severity: 1
}
2025-10-21T14:16:22.571941Z node 19 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-21T14:16:22.575930Z node 20 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [19:7563678703803145083:2516] destroyed
2025-10-21T14:16:22.576031Z node 20 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-21T14:16:22.576101Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.576137Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.576178Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.585973Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.586011Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.586031Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.688157Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.688196Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.688217Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-21T14:16:22.788074Z node 20 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-21T14:16:22.788115Z node 20 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-21T14:16:22.788136Z node 20 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
