2025-10-27T11:20:17.314110Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7565859846838597579:2079];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:20:17.317861Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-27T11:20:17.347004Z node 6 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[6:7565859845659021910:2085];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:20:17.347918Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/ccie/001797/r3tmp/tmpa3Um6u/pdisk_1.dat
2025-10-27T11:20:17.350052Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-27T11:20:17.359548Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:20:17.373749Z node 6 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-27T11:20:17.381964Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:20:17.530847Z node 5 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-27T11:20:17.537502Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-27T11:20:17.537600Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-27T11:20:17.541063Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-27T11:20:17.541154Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-27T11:20:17.547332Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-27T11:20:17.549566Z node 5 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 6 Cookie 6
2025-10-27T11:20:17.550749Z node 5 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(6, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 14613, node 5
2025-10-27T11:20:17.626252Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/ccie/001797/r3tmp/yandexg3T6AW.tmp
2025-10-27T11:20:17.626284Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/ccie/001797/r3tmp/yandexg3T6AW.tmp
2025-10-27T11:20:17.626415Z node 5 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/ccie/001797/r3tmp/yandexg3T6AW.tmp
2025-10-27T11:20:17.626567Z node 5 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-27T11:20:17.645634Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-27T11:20:17.652300Z node 6 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-27T11:20:17.663860Z INFO: TTestServer started on Port 12167 GrpcPort 14613
TClient is connected to server localhost:12167
PQClient connected to localhost:14613
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-27T11:20:17.906449Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-27T11:20:17.957676Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
waiting...
waiting...
waiting...
2025-10-27T11:20:18.319155Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-27T11:20:18.354841Z node 6 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-27T11:20:21.348847Z node 6 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [6:7565859862838891439:2296], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-27T11:20:21.350029Z node 6 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=6&id=ZDBhNWRkZjctMjlkYzNhOTAtOWVjZjVhMDktNzU1NTc4Mjk=, ActorId: [6:7565859862838891437:2295], ActorState: ExecuteState, TraceId: 01k8jpbmh55tf67bhcept9vzax, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-27T11:20:21.350523Z node 6 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-27T11:20:21.380328Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [5:7565859864018467821:2322], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-27T11:20:21.391848Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=5&id=OWUyZTAxZTItZDk3NmNjYzAtNmZjMTg3MTQtNDYwNDY5ZjQ=, ActorId: [5:7565859864018467818:2320], ActorState: ExecuteState, TraceId: 01k8jpbmhm8xjns5jkxmb16282, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-27T11:20:21.392286Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-27T11:20:21.397650Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
2025-10-27T11:20:21.497763Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
2025-10-27T11:20:21.662127Z node 5 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-27T11:20:22.032000Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01k8jpbn08ea0jbrgcjeds76km, Database: , SessionId: ydb://session/3?node_id=5&id=ZmE0YjJkOTUtNWRlNzBlZWQtMzVjNGVlNmQtY2Y1ODQ3Nw==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [5:7565859868313435556:3025] 
2025-10-27T11:20:22.308467Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7565859846838597579:2079];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:20:22.308544Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-27T11:20:22.347163Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[6:7565859845659021910:2085];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:20:22.347257Z node 6 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 2 partitions
CallPersQueueGRPC request to localhost:14613
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:20:27.322491Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:14613
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 2
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-27T11:20:27.379409Z node 5 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [5:7565859889788272483:3261] connected; active server actors: 1
2025-10-27T11:20:27.380138Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [1, 0]
2025-10-27T11:20:27.381694Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-27T11:20:27.383349Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) (1, 72075186224037892) 
2025-10-27T11:20:27.394802Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2962: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-27T11:20:27.414288Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2994: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-27T11:20:27.414589Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-27T11:20:27.414636Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-27T11:20:27.414682Z node 6 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-27T11:20:27.415427Z node 5 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 6, Generation 1
2025-10-27T11:20:27.421919Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859889788272482:3260], now have 1 active actors on pipe
2025-10-27T11:20:27.421981Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859889788272512:2440], now have 1 active actors on pipe
2025-10-27T11:20:27.422536Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:27.430084Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:27.451507Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859889788272559:3318], now have 1 active actors on pipe
2025-10-27T11:20:27.451803Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:27.477344Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:27.483615Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitConfigStep
2025-10-27T11:20:27.483662Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-27T11:20:27.483695Z node 6 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-27T11:20:27.483714Z node 6 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-27T11:20:27.484131Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-27T11:20:27.484312Z node 6 :PERSQUEUE INFO: partition_init.cpp:1095: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [6:7565859888608695580:2371]
2025-10-27T11:20:27.487709Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitFieldsStep
2025-10-27T11:20:27.487733Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:1:Initializer] Initializing completed.
2025-10-27T11:20:27.487753Z node 6 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--topic1' partition 1 generation 1 [6:7565859888608695580:2371]
2025-10-27T11:20:27.487779Z node 6 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-27T11:20:27.491442Z node 6 :PERSQUEUE DEBUG: partition.cpp:4312: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-10-27T11:20:27.491490Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.491577Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.491588Z node 6 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:20:27.491609Z node 6 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-27T11:20:27.491622Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.491633Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.491645Z node 6 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-27T11:20:27.491682Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:20:27.491877Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-27T11:20:27.492061Z node 6 :PERSQUEUE INFO: partition_init.cpp:1095: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [6:7565859888608695581:2371]
2025-10-27T11:20:27.496538Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-27T11:20:27.496576Z node 6 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-27T11:20:27.496598Z node 6 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [6:7565859888608695581:2371]
2025-10-27T11:20:27.496623Z node 6 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-27T11:20:27.497847Z node 6 :PERSQUEUE DEBUG: partition.cpp:4312: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-27T11:20:27.497878Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.497963Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.497974Z node 6 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:27.497994Z node 6 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-27T11:20:27.498006Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.498017Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.498028Z node 6 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-27T11:20:27.498059Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:20:27.498328Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:20:27.498595Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:27.498745Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:27.511391Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:27.511543Z node 6 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761564027489, TxId 281474976715676
2025-10-27T11:20:27.511567Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.511581Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.511724Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:27.511962Z node 6 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761564027489, TxId 281474976715676
2025-10-27T11:20:27.511984Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.511994Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.512065Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:27.512186Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:27.512220Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:27.516949Z node 6 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:27.517245Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:27.517292Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.517314Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.517332Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:27.517381Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:27.517419Z node 6 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:27.517630Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:27.517645Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.517654Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.517662Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:27.517686Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:20:27.518144Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-27T11:20:27.518245Z node 6 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-27T11:20:27.518520Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:27.531390Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:27.531501Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:27.537477Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:27.590282Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.590324Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.590335Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:27.596062Z node 5 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715677. Ctx: { TraceId: 01k8jpbtgc8dfzzazc062v15s2, Database: , SessionId: ydb://session/3?node_id=5&id=ZWY1NWRhNjYtMzY2ODRmYTEtM2U5ZGY3OTYtZTcxMjdjMjU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-27T11:20:27.598373Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.598406Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.598417Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1761564027489
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1761564027489
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 2
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:14613
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:20:27.640027Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-27T11:20:27.691464Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.691503Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.691516Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:27.698313Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.698346Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.698366Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:27.791525Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.791562Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.791575Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:27.798763Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.798802Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.798825Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:27.891844Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.891884Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.891895Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:27.899468Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.899497Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.899509Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:27.993921Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:27.993964Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:27.993977Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.001956Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.001997Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.002010Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:28.094235Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.094267Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.094283Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.104549Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.104577Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.104586Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14613
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:20:28.143234Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-27T11:20:28.195733Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.195784Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.195798Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.204710Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.204762Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.204779Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:28.296329Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.296363Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.296374Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.305323Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.305357Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.305367Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:28.396680Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.396719Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.396731Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.406310Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.406353Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.406365Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:28.497019Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.497071Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.497083Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.507979Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.508030Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.508043Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:28.597367Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.597396Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.597405Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.609257Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.609312Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.609324Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:14613
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:20:28.651922Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:14613
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 1
  CmdGetOwnership {
  }
}
2025-10-27T11:20:28.658523Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-27T11:20:28.659357Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859894083240003:3408], now have 1 active actors on pipe
2025-10-27T11:20:28.659660Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:28.659718Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:20:28.659823Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|52ab07cf-1f72323-3f6d48c3-ab80d0c3_0 generated for partition 1 topic 'rt3.dc1--topic1' owner default
2025-10-27T11:20:28.659880Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.659903Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.659914Z node 6 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:20:28.659957Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.660009Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:20:28.660110Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|52ab07cf-1f72323-3f6d48c3-ab80d0c3_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:14613
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 1
  OwnerCookie: "default|52ab07cf-1f72323-3f6d48c3-ab80d0c3_0"
  CmdWrite {
    SourceId: ""
    SeqNo: 1
    Data: ""
  }
  MessageNo: 0
}
2025-10-27T11:20:28.660478Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-27T11:20:28.662542Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [5:7565859894083240003:3408] destroyed
2025-10-27T11:20:28.663303Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-27T11:20:28.663966Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859894083240005:3409], now have 1 active actors on pipe
2025-10-27T11:20:28.664473Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:28.664506Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:20:28.664828Z node 6 :PERSQUEUE WARN: event_helpers.cpp:42: tablet 72075186224037892 topic 'rt3.dc1--topic1 error: empty Data
2025-10-27T11:20:28.664888Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1238: [PQ: 72075186224037892] Handle TEvPQ::TEvError Cookie 2, Error empty Data
2025-10-27T11:20:28.664919Z node 6 :PERSQUEUE ERROR: pq_impl.cpp:202: Answer error topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0 requestId: <none> error: empty Data
2025-10-27T11:20:28.665340Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "empty Data"
ErrorCode: BAD_REQUEST
CallPersQueueGRPC request to localhost:14613
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 1
  CmdGetOwnership {
  }
}
2025-10-27T11:20:28.667401Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [5:7565859894083240005:3409] destroyed
2025-10-27T11:20:28.668142Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-27T11:20:28.668857Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859894083240007:3410], now have 1 active actors on pipe
2025-10-27T11:20:28.669395Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:28.669430Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:20:28.669535Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9fbdca38-96f3cf0c-99bce634-4117076_1 generated for partition 1 topic 'rt3.dc1--topic1' owner default
2025-10-27T11:20:28.669576Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.669593Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.669603Z node 6 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:20:28.669656Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.669698Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:20:28.669745Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:28.670257Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9fbdca38-96f3cf0c-99bce634-4117076_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:14613
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 1
  OwnerCookie: "default|9fbdca38-96f3cf0c-99bce634-4117076_1"
  CmdWrite {
    SourceId: "a"
    SeqNo: 1
    Data: ""
  }
  MessageNo: 0
}
2025-10-27T11:20:28.672222Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [5:7565859894083240007:3410] destroyed
2025-10-27T11:20:28.672982Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-27T11:20:28.673603Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859894083240009:3411], now have 1 active actors on pipe
2025-10-27T11:20:28.674126Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:28.674158Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:20:28.674217Z node 6 :PERSQUEUE WARN: event_helpers.cpp:42: tablet 72075186224037892 topic 'rt3.dc1--topic1 error: empty Data
2025-10-27T11:20:28.674258Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1238: [PQ: 72075186224037892] Handle TEvPQ::TEvError Cookie 4, Error empty Data
2025-10-27T11:20:28.674277Z node 6 :PERSQUEUE ERROR: pq_impl.cpp:202: Answer error topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0 requestId: <none> error: empty Data
2025-10-27T11:20:28.674660Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "empty Data"
ErrorCode: BAD_REQUEST
CallPersQueueGRPC request to localhost:14613
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 1
  CmdGetOwnership {
  }
}
2025-10-27T11:20:28.676630Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [5:7565859894083240009:3411] destroyed
2025-10-27T11:20:28.677298Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-27T11:20:28.677941Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859894083240011:3412], now have 1 active actors on pipe
2025-10-27T11:20:28.678366Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:28.678393Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:20:28.678479Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|925996fa-3d83fd35-f8220e26-dd78c586_2 generated for partition 1 topic 'rt3.dc1--topic1' owner default
2025-10-27T11:20:28.678511Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.678529Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.678539Z node 6 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:20:28.678579Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.678620Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:20:28.678667Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:28.679132Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|925996fa-3d83fd35-f8220e26-dd78c586_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:14613
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 1
  OwnerCookie: "default|925996fa-3d83fd35-f8220e26-dd78c586_2"
  CmdWrite {
    SourceId: ""
    SeqNo: 1
    Data: "a"
  }
  MessageNo: 0
}
2025-10-27T11:20:28.680949Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [5:7565859894083240011:3412] destroyed
2025-10-27T11:20:28.681705Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-27T11:20:28.682353Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859894083240013:3413], now have 1 active actors on pipe
2025-10-27T11:20:28.682878Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:28.682913Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:20:28.682950Z node 6 :PERSQUEUE WARN: event_helpers.cpp:42: tablet 72075186224037892 topic 'rt3.dc1--topic1 error: empty SourceId
2025-10-27T11:20:28.682994Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:1238: [PQ: 72075186224037892] Handle TEvPQ::TEvError Cookie 6, Error empty SourceId
2025-10-27T11:20:28.683013Z node 6 :PERSQUEUE ERROR: pq_impl.cpp:202: Answer error topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0 requestId: <none> error: empty SourceId
2025-10-27T11:20:28.683333Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "empty SourceId"
ErrorCode: BAD_REQUEST
CallPersQueueGRPC request to localhost:14613
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 1
  CmdGetOwnership {
  }
}
2025-10-27T11:20:28.684999Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [5:7565859894083240013:3413] destroyed
2025-10-27T11:20:28.686370Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-27T11:20:28.688720Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859894083240017:3414], now have 1 active actors on pipe
2025-10-27T11:20:28.688775Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:28.688796Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:20:28.688887Z node 6 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3e3a43aa-62df40fa-45ac26c1-a9c3f861_3 generated for partition 1 topic 'rt3.dc1--topic1' owner default
2025-10-27T11:20:28.688916Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.688933Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.688943Z node 6 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:20:28.688979Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.689019Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:20:28.689067Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:28.689605Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3e3a43aa-62df40fa-45ac26c1-a9c3f861_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:14613
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 1
  OwnerCookie: "default|3e3a43aa-62df40fa-45ac26c1-a9c3f861_3"
  CmdWrite {
    SourceId: "a"
    SeqNo: 1
    Data: "a"
  }
  MessageNo: 0
}
2025-10-27T11:20:28.691939Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [5:7565859894083240017:3414] destroyed
2025-10-27T11:20:28.693825Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-27T11:20:28.695391Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [5:7565859894083240037:3421], now have 1 active actors on pipe
2025-10-27T11:20:28.696134Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:28.696166Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:20:28.696225Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: 'a' SeqNo: 1 partNo : 0 messageNo: 0 size 1 offset: -1
2025-10-27T11:20:28.696264Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:28.696325Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.696355Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.696364Z node 6 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:20:28.696482Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId 'a' seqNo 1 partNo 0
2025-10-27T11:20:28.798042Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId 'a' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 65 count 1 nextOffset 1 batches 1
2025-10-27T11:20:28.798108Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.798581Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000001_00000000000000000000_00000_0000000001_00000? size 51 WTime 1761564028798
2025-10-27T11:20:28.798785Z node 6 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][1][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:20:28.798807Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.798819Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.798830Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:28.798875Z node 6 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:28.798983Z node 6 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 0 partNo 0 count 1 size 51
2025-10-27T11:20:28.802285Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 0 count 1 size 51 actorID [6:7565859888608695562:2371]
2025-10-27T11:20:28.802360Z node 6 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:28.802418Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:28.802452Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-10-27T11:20:28.802492Z node 6 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: 'a', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-27T11:20:28.802712Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:20:28.802740Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:949: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-27T11:20:28.802758Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.802764Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63' size 51
2025-10-27T11:20:28.802774Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.802785Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.802832Z node 6 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:20:28.802907Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:28.803029Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][1][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-27T11:20:28.803247Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][1][StateIdle] read cookie 3 added 1 blobs, size 51 count 1 last offset 0, current partition end offset: 1
2025-10-27T11:20:28.803266Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][1][StateIdle] Reading cookie 3. Send blob request.
2025-10-27T11:20:28.803313Z node 6 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 0 partno 0 count 1 parts_count 0 source 1 size 51 accessed 0 times before, last time 2025-10-27T11:20:28.000000Z
2025-10-27T11:20:28.803343Z node 6 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-27T11:20:28.803393Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:28.803463Z node 6 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:28.803541Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 33 from pos 0 cbcount 1
2025-10-27T11:20:28.803614Z node 6 :PERSQUEUE DEBUG: partition_read.cpp:999: Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp done, result 1761564028696 queuesize 0 startOffset 0
2025-10-27T11:20:28.804341Z node 6 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [5:7565859894083240037:3421] destroyed
2025-10-27T11:20:28.803596Z node 5 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "a"
    SeqNo: 1
    Offset: 0
    WriteTimestampMS: 1761564028696
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 98
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-10-27T11:20:28.898970Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.899007Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.899019Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:20:28.899071Z node 6 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:28.899083Z node 6 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:28.899091Z node 6 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
