2025-11-24T18:37:27.508883Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7576362885604856939:2260];send_to=[0:7307199536658146131:7762515];
2025-11-24T18:37:27.508899Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-24T18:37:27.537976Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7576362884958888638:2083];send_to=[0:7307199536658146131:7762515];
2025-11-24T18:37:27.538121Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-24T18:37:27.541327Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/dj2b/000244/r3tmp/tmpZ2WhRH/pdisk_1.dat
2025-11-24T18:37:27.542337Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-24T18:37:27.691530Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-24T18:37:27.718943Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-24T18:37:27.760766Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-24T18:37:27.761924Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-24T18:37:27.761950Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-24T18:37:27.767304Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-24T18:37:27.767331Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-24T18:37:27.775329Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-24T18:37:27.775648Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-24T18:37:27.775841Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 5467, node 1
2025-11-24T18:37:27.905019Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/dj2b/000244/r3tmp/yandexfbpvQU.tmp
2025-11-24T18:37:27.905035Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/dj2b/000244/r3tmp/yandexfbpvQU.tmp
2025-11-24T18:37:27.905097Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/dj2b/000244/r3tmp/yandexfbpvQU.tmp
2025-11-24T18:37:27.905143Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-24T18:37:27.925357Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-24T18:37:27.935568Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-24T18:37:28.033100Z INFO: TTestServer started on Port 20766 GrpcPort 5467
TClient is connected to server localhost:20766
PQClient connected to localhost:5467
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-24T18:37:28.155140Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-24T18:37:28.200968Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-11-24T18:37:28.497254Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7576362889899824951:2312], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-24T18:37:28.497507Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2419: SessionId: ydb://session/3?node_id=1&id=OGQ0YWEyOTYtOWM4NTkxNzgtNjI0NGZmNjktM2UwYTI3, ActorId: [1:7576362889899824949:2311], ActorState: ExecuteState, TraceId: 01kavjg4v354w64mfrfgkbz9tt, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-24T18:37:28.497900Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7576362889253856264:2293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-24T18:37:28.498022Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-24T18:37:28.498590Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2419: SessionId: ydb://session/3?node_id=2&id=OGIxZjAzZDctN2I4NjA4MWMtMmUwZDEwZDQtMmE1MDVlOTA=, ActorId: [2:7576362889253856262:2292], ActorState: ExecuteState, TraceId: 01kavjg4vqfk9h01khfm40c5e7, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-24T18:37:28.498690Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-24T18:37:28.510632Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-24T18:37:28.539829Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-24T18:37:28.575368Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-24T18:37:28.637427Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-24T18:37:28.695510Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-24T18:37:28.874034Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01kavjg58p8ew32vb32yb88gvg, Database: , SessionId: ydb://session/3?node_id=1&id=YWU2MjNkODktOWZhNWU5OWEtM2NiN2Y5ZjEtYWNkYWFmZDE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7576362889899825495:2998] 
2025-11-24T18:37:32.508702Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7576362885604856939:2260];send_to=[0:7307199536658146131:7762515];
2025-11-24T18:37:32.508735Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-24T18:37:32.538460Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7576362884958888638:2083];send_to=[0:7307199536658146131:7762515];
2025-11-24T18:37:32.538505Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:5467
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-24T18:37:33.994882Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:5467
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-24T18:37:34.028405Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7576362915669629765:3253] connected; active server actors: 1
2025-11-24T18:37:34.028519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-24T18:37:34.034422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-24T18:37:34.035747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-24T18:37:34.051892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2962: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-24T18:37:34.059612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2994: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-24T18:37:34.059771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-24T18:37:34.059782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-24T18:37:34.059799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-24T18:37:34.060402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-24T18:37:34.062254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362915669629789:2448], now have 1 active actors on pipe
2025-11-24T18:37:34.062269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362915669629764:3252], now have 1 active actors on pipe
2025-11-24T18:37:34.062467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-24T18:37:34.068378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-24T18:37:34.071102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362915669629813:3292], now have 1 active actors on pipe
2025-11-24T18:37:34.071576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-24T18:37:34.071793Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01kavjgae2dd3ghw25s0djhgfx, Database: , SessionId: ydb://session/3?node_id=1&id=YTZjZmUxOTgtZTUyOGMzOTktZGI4YzcxNS01NjQ5ZTM0ZQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-11-24T18:37:34.073807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-24T18:37:34.079703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--topic1 version0
2025-11-24T18:37:34.081405Z node 2 :PERSQUEUE DEBUG: partition.cpp:1299: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-24T18:37:34.081769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-24T18:37:34.081881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1106: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7576362915023660437:2372]
2025-11-24T18:37:34.088225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-24T18:37:34.088240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-24T18:37:34.088247Z node 2 :PERSQUEUE INFO: partition.cpp:696: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [2:7576362915023660437:2372]
2025-11-24T18:37:34.088255Z node 2 :PERSQUEUE DEBUG: partition.cpp:716: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-24T18:37:34.088569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4394: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-24T18:37:34.088624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.088635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-24T18:37:34.088655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:34.088656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.088658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:34.088659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.088693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.088694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:34.088696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.088697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:34.088698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.088707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-24T18:37:34.088838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-24T18:37:34.088878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:34.106077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-24T18:37:34.106153Z node 2 :PERSQUEUE DEBUG: partition.cpp:1404: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764009454116, TxId 281474976715677
2025-11-24T18:37:34.106161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.106165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:34.106167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.106176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2440: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-24T18:37:34.106210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:34.106212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:34.106235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.106302Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:34.113807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:34.113919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:34.113930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.113933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.113935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.113938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.113941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.113951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:34.114068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-24T18:37:34.114091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-24T18:37:34.114184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-24T18:37:34.119683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-24T18:37:34.119724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-24T18:37:34.126674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-24T18:37:34.190498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.190516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.190518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.190522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.190525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.291320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.291336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.291338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.291341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.291343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.391599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.391618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.391626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.391629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.391633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.492733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.492750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.492752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.492755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.492758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1764009454116
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715677
    CreateStep: 1764009454116
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:5467
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-24T18:37:34.588946Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-24T18:37:34.593134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.593151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.593154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.593165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.593167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.693503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.693530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.693533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.693539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.693541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.794698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.794717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.794719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.794723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.794726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.894999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.895016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.895018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.895022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.895025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:34.996170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:34.996187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.996190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:34.996193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:34.996196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:5467
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-24T18:37:35.098715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.098729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.098731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.098734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.098737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.099044Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.102125Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.102984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597256:3378], now have 1 active actors on pipe
2025-11-24T18:37:35.104141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.104178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.104223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|85d5a556-b9704473-d106150d-f810b870_0 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.104242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.104246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.104253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.104255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.104259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.104269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.104272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.104275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.104296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.104314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.104919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597256:3378] destroyed
2025-11-24T18:37:35.104430Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|85d5a556-b9704473-d106150d-f810b870_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|85d5a556-b9704473-d106150d-f810b870_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.122981Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.123299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597276:3382], now have 1 active actors on pipe
2025-11-24T18:37:35.125211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.125235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.125538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.125603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.125620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.125626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.125652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.125680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.125688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.125699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.125721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.125725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.125727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.125732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.125778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-24T18:37:35.125798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.125801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 1
2025-11-24T18:37:35.125804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.125807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 2
2025-11-24T18:37:35.126222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048790 count 1 nextOffset 1 batches 3
2025-11-24T18:37:35.126271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.126275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.126279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.126388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00002? size 1048780 WTime 1764009455126
2025-11-24T18:37:35.127456Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.127480Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.142993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.143029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.143060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.143068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.143079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-24T18:37:35.143083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.143088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 1, Offset: 0 is stored on disk
2025-11-24T18:37:35.143094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.143098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 2, Offset: 0 is stored on disk
2025-11-24T18:37:35.143173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-24T18:37:35.143180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:957: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-24T18:37:35.143183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.143185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.143197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.143200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.143202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.143212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.143230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.143283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-24T18:37:35.143303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1048780 count 1 last offset 0, current partition end offset: 1
2025-11-24T18:37:35.143306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-24T18:37:35.143317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.143321Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-24T18:37:35.143342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-24T18:37:35.143539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:35.143694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:35.143708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:35.143729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1007: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1764009455125 queuesize 0 startOffset 0
2025-11-24T18:37:35.144436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.144457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.144962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597276:3382] destroyed
2025-11-24T18:37:35.144583Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    PartNo: 0
    WriteTimestampMS: 1764009455125
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 15
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.147785Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.148327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597281:3385], now have 1 active actors on pipe
2025-11-24T18:37:35.148348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.148355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.148386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d1a0b4fb-27ad8452-f70c8896-132b6787_1 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.148398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.148401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.148407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.148409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.148413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.148440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.148443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.148446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.148467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.148485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.148675Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d1a0b4fb-27ad8452-f70c8896-132b6787_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d1a0b4fb-27ad8452-f70c8896-132b6787_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.157118Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.157391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597281:3385] destroyed
2025-11-24T18:37:35.158487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597283:3386], now have 1 active actors on pipe
2025-11-24T18:37:35.158792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.158800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.158875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.158920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.158939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.158944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.158965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.158990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.158993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.159003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.159005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.159009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.159011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.159015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.159049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-24T18:37:35.159065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.159072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-24T18:37:35.159075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.159078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-24T18:37:35.160006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-24T18:37:35.160021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.160025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.160030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.160119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1764009455159
2025-11-24T18:37:35.160304Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.160319Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.164077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.164097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.164122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.164130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.164141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-24T18:37:35.164144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.164147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-24T18:37:35.164151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.164153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-24T18:37:35.164186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.164190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.164191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.164194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.164195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.164204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.164217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.164432Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.164339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.164984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597283:3386] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1764009455158
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.168819Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.169342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597287:3389], now have 1 active actors on pipe
2025-11-24T18:37:35.169361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.169368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.169403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|248ef2b9-19dfb24e-d3a31125-87134bea_2 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.169415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.169419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.169424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.169426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.169431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.169444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.169447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.169450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.169469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.169482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.169609Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.170066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597287:3389] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|248ef2b9-19dfb24e-d3a31125-87134bea_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|248ef2b9-19dfb24e-d3a31125-87134bea_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.177129Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.178614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597290:3391], now have 1 active actors on pipe
2025-11-24T18:37:35.179129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.179140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.179329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.179825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.179840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.179848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.179888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.179917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.179922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.179936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.179940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.179946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.179949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.179956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.180002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-24T18:37:35.180018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.180021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-24T18:37:35.180024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.180026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-24T18:37:35.180299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-24T18:37:35.180313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.180316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.180320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.180436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1764009455178
2025-11-24T18:37:35.180642Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.180656Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.185157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.185202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.185229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.185237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.185249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-24T18:37:35.185253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.185257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-24T18:37:35.185263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.185267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-24T18:37:35.185312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.185316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.185318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.185321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.185323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.185335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.185354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.185388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.185538Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.186032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597290:3391] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1764009455178
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.191734Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.192564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597294:3394], now have 1 active actors on pipe
2025-11-24T18:37:35.192765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.192776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.192813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|83c69b24-8d1ebeb3-4db5b2-8aa1f276_3 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.192851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.192855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.192862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.192865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.192869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.192901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.192906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.192909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.192928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.192957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.193272Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.194009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597294:3394] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|83c69b24-8d1ebeb3-4db5b2-8aa1f276_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|83c69b24-8d1ebeb3-4db5b2-8aa1f276_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.202784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.202798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.202800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.202803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.202805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.208050Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.208387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597296:3395], now have 1 active actors on pipe
2025-11-24T18:37:35.210009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.210030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.210097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.210529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.210543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.210548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.210574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.210600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.210604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.210616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.210617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.210620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.210621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.210625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.210655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-24T18:37:35.210669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.210673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-24T18:37:35.210677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.210679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-24T18:37:35.210890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-24T18:37:35.210901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.210904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.210907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.210977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1764009455210
2025-11-24T18:37:35.211370Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.211383Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.224811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.224835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.224861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.224872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.224884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-24T18:37:35.224887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.224891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-24T18:37:35.224897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.224901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-24T18:37:35.224947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.224950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.224952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.224954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.224956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.224967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.224985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.225121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.225313Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1764009455210
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.227771Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.229462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597296:3395] destroyed
2025-11-24T18:37:35.229484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597300:3398], now have 1 active actors on pipe
2025-11-24T18:37:35.229506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.229513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.229554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ee4f2ce4-36ae879f-244cad80-d08e4713_4 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.229567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.229571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.229576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.229577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.229582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.229594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.229597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.229600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.229621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.229637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.229815Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ee4f2ce4-36ae879f-244cad80-d08e4713_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|ee4f2ce4-36ae879f-244cad80-d08e4713_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.236504Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.239376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597300:3398] destroyed
2025-11-24T18:37:35.239395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597302:3399], now have 1 active actors on pipe
2025-11-24T18:37:35.239730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.239741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.239813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.239875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.239884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.239888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.239922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.239943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.239947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.239957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.239960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.239963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.239970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.239976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.240015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-24T18:37:35.240030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.240033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-24T18:37:35.240036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.240039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-24T18:37:35.240654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-24T18:37:35.240669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.240672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.240676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.240754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1764009455240
2025-11-24T18:37:35.240940Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.240952Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.245248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.245275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.245301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.245311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.245321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-24T18:37:35.245325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.245329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-24T18:37:35.245335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.245339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-24T18:37:35.245383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.245385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.245387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.245389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.245391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.245402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.245420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.245642Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1764009455239
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 2
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.245564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.246248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597302:3399] destroyed
2025-11-24T18:37:35.246719Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.247282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597306:3402], now have 1 active actors on pipe
2025-11-24T18:37:35.247299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.247305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.247335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|f399dc3c-1d14f497-67f4c55f-f00812fe_5 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.247343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.247345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.247349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.247350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.247353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.247362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.247364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.247366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.247380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.247390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.248064Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|f399dc3c-1d14f497-67f4c55f-f00812fe_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:35.249804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597306:3402] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|f399dc3c-1d14f497-67f4c55f-f00812fe_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.255038Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.258292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597308:3403], now have 1 active actors on pipe
2025-11-24T18:37:35.258643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.258652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.258727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.258777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.258787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.258791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.258816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.258836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.258840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.258850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.258852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.258856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.258858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.258861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.258897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-24T18:37:35.258909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.258912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-24T18:37:35.258915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.258918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-24T18:37:35.259739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-24T18:37:35.259753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.259755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.259759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.259826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1764009455259
2025-11-24T18:37:35.260010Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.260024Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.270915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.270946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.270971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.270981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.270993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-24T18:37:35.270997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.271000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-24T18:37:35.271007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.271010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-24T18:37:35.271062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.271065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.271068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.271070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.271072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.271083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.271102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.271369Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.271302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1764009455258
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.272670Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.273117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597308:3403] destroyed
2025-11-24T18:37:35.273134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597314:3408], now have 1 active actors on pipe
2025-11-24T18:37:35.273146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.273152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.273328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|88a01ced-1c1e2616-60fad713-4e1db284_6 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.273345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.273348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.273354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.273356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.273361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.273373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.273376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.273380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.273398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.273413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.273494Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|88a01ced-1c1e2616-60fad713-4e1db284_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:35.275949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597314:3408] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|88a01ced-1c1e2616-60fad713-4e1db284_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.283135Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.284226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597316:3409], now have 1 active actors on pipe
2025-11-24T18:37:35.285844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.285864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.285939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.285997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.286010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.286015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.286039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.286063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.286067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.286077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.286080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.286084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.286086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.286091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.286128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-24T18:37:35.286143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.286146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-24T18:37:35.286149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.286151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-24T18:37:35.286878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-24T18:37:35.286894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.286897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.286901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.286982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1764009455285
2025-11-24T18:37:35.287170Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.287183Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.292227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.292251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.292277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.292285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.292296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-24T18:37:35.292300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.292304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-24T18:37:35.292312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.292315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-24T18:37:35.292369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.292372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.292374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.292376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.292378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.292389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.292408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.292573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.292681Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1764009455285
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.293357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597316:3409] destroyed
2025-11-24T18:37:35.293757Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.294331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597320:3412], now have 1 active actors on pipe
2025-11-24T18:37:35.294344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.294349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.294389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|f323b2e4-e3c9a644-e5d58246-cdee6b5d_7 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.294400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.294712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.294724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.294726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.294731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.294744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.294746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.294749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.294769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.294785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.294907Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.295270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597320:3412] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|f323b2e4-e3c9a644-e5d58246-cdee6b5d_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|f323b2e4-e3c9a644-e5d58246-cdee6b5d_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.301838Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.302395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597322:3413], now have 1 active actors on pipe
2025-11-24T18:37:35.302421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.302425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.302429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.302432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.302434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.303948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.303967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.304039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.304093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.304114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.304120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.304144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.304166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.304170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.304181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.304184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.304188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.304190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.304195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.304231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-24T18:37:35.304245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.304252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-24T18:37:35.304255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.304257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-24T18:37:35.304901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-24T18:37:35.304916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.304918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.304922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.304995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1764009455303
2025-11-24T18:37:35.305197Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.305209Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.309571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.309598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.309625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.309636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.309648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-24T18:37:35.309651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.309655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-24T18:37:35.309661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.309665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-24T18:37:35.309711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.309715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.309717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.309720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.309722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.309734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.309736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.309738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.309740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.309742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.309744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.309746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.309748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.309751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-11-24T18:37:35.309771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.309781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-11-24T18:37:35.309783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00002?
2025-11-24T18:37:35.309792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-24T18:37:35.309802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-24T18:37:35.309815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-24T18:37:35.309825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-24T18:37:35.309847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-24T18:37:35.309855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-24T18:37:35.309873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-24T18:37:35.309882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-11-24T18:37:35.309892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 1 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.309896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.309900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.309903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.309906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.309908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.309910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.309912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.309919Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-11-24T18:37:35.309950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-24T18:37:35.309960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000000_00000_0000000001_00002?
2025-11-24T18:37:35.309963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.309966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00002?, parameters.CurOffset=0
2025-11-24T18:37:35.310109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.0/3
2025-11-24T18:37:35.310118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-24T18:37:35.310125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:0 appended
2025-11-24T18:37:35.310273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.1/3
2025-11-24T18:37:35.310278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 1
2025-11-24T18:37:35.310281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:1 appended
2025-11-24T18:37:35.310295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.2/3
2025-11-24T18:37:35.310297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 2
2025-11-24T18:37:35.310553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 0 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048790 count 1 nextOffset 1 batches 3
2025-11-24T18:37:35.310561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:2 appended
2025-11-24T18:37:35.310567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-24T18:37:35.310570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.310573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-24T18:37:35.310709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.0/3
2025-11-24T18:37:35.310716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-24T18:37:35.310718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:0 appended
2025-11-24T18:37:35.311065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.1/3
2025-11-24T18:37:35.311071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-24T18:37:35.311074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:1 appended
2025-11-24T18:37:35.311109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.2/3
2025-11-24T18:37:35.311111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-24T18:37:35.311727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097545 count 2 nextOffset 2 batches 5
2025-11-24T18:37:35.311735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:2 appended
2025-11-24T18:37:35.311741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-24T18:37:35.311743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.311746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-24T18:37:35.311924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.0/3
2025-11-24T18:37:35.311930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-24T18:37:35.311932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:0 appended
2025-11-24T18:37:35.312445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.1/3
2025-11-24T18:37:35.312450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-24T18:37:35.312453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:1 appended
2025-11-24T18:37:35.312469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.2/3
2025-11-24T18:37:35.312472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-24T18:37:35.313096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146300 count 3 nextOffset 3 batches 7
2025-11-24T18:37:35.313105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:2 appended
2025-11-24T18:37:35.313111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-24T18:37:35.313113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.313116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-24T18:37:35.313286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.0/3
2025-11-24T18:37:35.313291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-24T18:37:35.313294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:0 appended
2025-11-24T18:37:35.313436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.1/3
2025-11-24T18:37:35.313439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-24T18:37:35.313442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:1 appended
2025-11-24T18:37:35.313455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.2/3
2025-11-24T18:37:35.313457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-24T18:37:35.314536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.314554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.314557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.314560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.314563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.314567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.314570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.314572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.314576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.315117Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1764009455303
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.317113Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.318028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195055 count 4 nextOffset 4 batches 9
2025-11-24T18:37:35.318049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:2 appended
2025-11-24T18:37:35.318068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-24T18:37:35.318070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.318074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-11-24T18:37:35.318237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.0/3
2025-11-24T18:37:35.318248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-24T18:37:35.318252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:0 appended
2025-11-24T18:37:35.318422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.1/3
2025-11-24T18:37:35.318427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-24T18:37:35.318429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:1 appended
2025-11-24T18:37:35.318446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.2/3
2025-11-24T18:37:35.318448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-24T18:37:35.319004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243810 count 5 nextOffset 5 batches 11
2025-11-24T18:37:35.319011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:2 appended
2025-11-24T18:37:35.319014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-24T18:37:35.319015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.319018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-24T18:37:35.319151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.0/3
2025-11-24T18:37:35.319157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-24T18:37:35.319159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:0 appended
2025-11-24T18:37:35.319298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.1/3
2025-11-24T18:37:35.319301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-24T18:37:35.319303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:1 appended
2025-11-24T18:37:35.319317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.2/3
2025-11-24T18:37:35.319319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-24T18:37:35.319500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292565 count 6 nextOffset 6 batches 13
2025-11-24T18:37:35.319508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:2 appended
2025-11-24T18:37:35.319513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-24T18:37:35.319515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.319517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-24T18:37:35.319660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.0/3
2025-11-24T18:37:35.319665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-24T18:37:35.319668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:0 appended
2025-11-24T18:37:35.319814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.1/3
2025-11-24T18:37:35.319819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-24T18:37:35.319820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:1 appended
2025-11-24T18:37:35.319832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.2/3
2025-11-24T18:37:35.319834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-24T18:37:35.320224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341320 count 7 nextOffset 7 batches 15
2025-11-24T18:37:35.320231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:2 appended
2025-11-24T18:37:35.320236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-24T18:37:35.320237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.320240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-24T18:37:35.320389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.0/3
2025-11-24T18:37:35.320393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-24T18:37:35.320396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:0 appended
2025-11-24T18:37:35.320905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.1/3
2025-11-24T18:37:35.320915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-24T18:37:35.320918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:1 appended
2025-11-24T18:37:35.320936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.2/3
2025-11-24T18:37:35.320939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-24T18:37:35.333080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 7 partNo 2 result is x0000000000_00000000000000000000_00000_0000000007_00016 size 8365339
2025-11-24T18:37:35.333104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000000_00000_0000000007_00016 new key d0000000000_00000000000000000000_00000_0000000007_00016 size 8365339 WTime 1764009455332
2025-11-24T18:37:35.333149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 1 NewHead: Offset 7 PartNo 2 PackedSize 24736 count 1 nextOffset 8 batches 1
2025-11-24T18:37:35.333159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:2 appended
2025-11-24T18:37:35.333233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 0 endOffset 0 curOffset 8 d0000000000_00000000000000000007_00002_0000000001_00000| size 24726 WTime 1764009455332
2025-11-24T18:37:35.333288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597322:3413] destroyed
2025-11-24T18:37:35.333297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597326:3416], now have 1 active actors on pipe
2025-11-24T18:37:35.333322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.333328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.333342Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.333354Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 7 size 8365339
2025-11-24T18:37:35.333361Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 2 count 1 size 24726
2025-11-24T18:37:35.333393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d9c1c160-9206ecc2-5f634f67-192c8007_8 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.333404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.333406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.333414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.333416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.333420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.333432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.333434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.333437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.333456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.333503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.334105Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d9c1c160-9206ecc2-5f634f67-192c8007_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d9c1c160-9206ecc2-5f634f67-192c8007_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.346125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597326:3416] destroyed
2025-11-24T18:37:35.349888Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.350389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597331:3419], now have 1 active actors on pipe
2025-11-24T18:37:35.352112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.352137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.352224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.352278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.352287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.352291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.352318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.352343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.352346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.352357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.352361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.352364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.352366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.352371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.352408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-24T18:37:35.352422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.352425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-24T18:37:35.352431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.352433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-24T18:37:35.352699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-24T18:37:35.352714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.352717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.352720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.352823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1764009455352
2025-11-24T18:37:35.353014Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.353025Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.371250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 7 size 8365339 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.371265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 24726 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.371284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.371370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:35.371373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.371997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365339
2025-11-24T18:37:35.372008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-24T18:37:35.375238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.375265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.375292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.375302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.375314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-24T18:37:35.375318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.375323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-24T18:37:35.375329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.375333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-24T18:37:35.375380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.375384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.375385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.375388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.375391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.375570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.375597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.375610Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.375618Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00002?(+) to d0000000000_00000000000000000000_00000_0000000001_00002?(+)
2025-11-24T18:37:35.375621Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-24T18:37:35.375622Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-24T18:37:35.375625Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-24T18:37:35.375626Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-11-24T18:37:35.375628Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-11-24T18:37:35.375629Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-24T18:37:35.375631Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-24T18:37:35.375903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.376243Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1764009455352
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 22
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.377607Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.378152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597331:3419] destroyed
2025-11-24T18:37:35.378164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597337:3424], now have 1 active actors on pipe
2025-11-24T18:37:35.378173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.378177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.378204Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|aa986c3d-31e894c5-f6f7f51b-1dc6b936_9 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.378212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:35.380529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.380541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.380547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.380550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.380555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.380559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.380564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.380569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.380600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.380618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.380630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.380638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.380645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.380648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.380652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.380665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.380667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.380670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.380689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.380698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.380710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.380904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.380918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.380923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.380932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.380936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.380939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.380944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.380948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.381098Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|aa986c3d-31e894c5-f6f7f51b-1dc6b936_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|aa986c3d-31e894c5-f6f7f51b-1dc6b936_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.388080Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.389825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597337:3424] destroyed
2025-11-24T18:37:35.389843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597339:3425], now have 1 active actors on pipe
2025-11-24T18:37:35.390170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.390181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.390248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.390305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.390315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.390321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.390349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.390385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.390389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.390399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.390402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.390407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.390409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.390414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.390453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-24T18:37:35.390467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.390471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-24T18:37:35.390474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.390477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-24T18:37:35.391404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-24T18:37:35.391428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.391431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.391435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.392001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1764009455391
2025-11-24T18:37:35.392172Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.392187Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.398079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.398104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.398131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.398139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.398152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-11-24T18:37:35.398155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.398159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-24T18:37:35.398166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.398169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-24T18:37:35.398214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.398217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.398219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.398222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.398224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.398236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.398255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.398424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.398532Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.401847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597339:3425] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1764009455389
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 8
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.402881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.402894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.402896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.402900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.402904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.405111Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.405724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597344:3429], now have 1 active actors on pipe
2025-11-24T18:37:35.405940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.405951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.405986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|fa34737a-ef7fded7-5ff76650-426264fb_10 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.405998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.406002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.406008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.406009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.406014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.406027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.406030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.406034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.406055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.406072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.406501Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.407117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597344:3429] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|fa34737a-ef7fded7-5ff76650-426264fb_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|fa34737a-ef7fded7-5ff76650-426264fb_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.415118Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.415748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597346:3430], now have 1 active actors on pipe
2025-11-24T18:37:35.417420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.417449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.417531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.417582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.417591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.417594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.417624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.417649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.417654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.417665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.417667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.417671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.417673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.417678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.417714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-24T18:37:35.417730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.417733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-24T18:37:35.417740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.417743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-24T18:37:35.417978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-24T18:37:35.417988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.417991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.417996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.418085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1764009455417
2025-11-24T18:37:35.418268Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.418279Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.424512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.424536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.424577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.424586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.424596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-24T18:37:35.424600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.424603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-24T18:37:35.424609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.424613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-24T18:37:35.424658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.424661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.424663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.424665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.424667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.424682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.424702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.424940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.425156Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.425826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597346:3430] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1764009455417
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.426498Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.426886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597350:3433], now have 1 active actors on pipe
2025-11-24T18:37:35.427076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.427084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.427115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|7b1e9893-f646d15d-eecbbbf7-cde3107d_11 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.427125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.427129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.427134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.427135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.427139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.427150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.427162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.427165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.427184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.427198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.427334Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.427781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597350:3433] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|7b1e9893-f646d15d-eecbbbf7-cde3107d_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|7b1e9893-f646d15d-eecbbbf7-cde3107d_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.435481Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.435972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597354:3436], now have 1 active actors on pipe
2025-11-24T18:37:35.437115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.437132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.437214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.437251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.437257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.437261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.437276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.437294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.437297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.437306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.437308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.437310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.437312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.437316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.437350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-24T18:37:35.437363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.437366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-24T18:37:35.437369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.437372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-24T18:37:35.437602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-24T18:37:35.437624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.437628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.437631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.437677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1764009455433
2025-11-24T18:37:35.437835Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.437843Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.441715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.441739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.441763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.441772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.441782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-24T18:37:35.441785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.441788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-24T18:37:35.441793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.441796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-24T18:37:35.441838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.441840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.441845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.441848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.441852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.441863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.441879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.442009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.442094Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.445707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597354:3436] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1764009455433
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.447985Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.448675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597358:3439], now have 1 active actors on pipe
2025-11-24T18:37:35.448910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.448919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.448956Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|4c1d4ea7-14756227-14b938a9-be605588_12 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.448968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.448972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.448978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.448980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.448995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.449009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.449011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.449014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.449034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.449052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.449739Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.450396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597358:3439] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|4c1d4ea7-14756227-14b938a9-be605588_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|4c1d4ea7-14756227-14b938a9-be605588_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.459643Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.460920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597360:3440], now have 1 active actors on pipe
2025-11-24T18:37:35.462810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.462832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.462918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.462976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.462985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.462989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.463015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.463037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.463041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.463052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.463055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.463058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.463060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.463065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.463102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-24T18:37:35.463115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.463122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-24T18:37:35.463125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.463127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-24T18:37:35.463404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-24T18:37:35.463423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.463426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.463428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.463497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1764009455463
2025-11-24T18:37:35.463654Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.463672Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.471822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.471851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.471879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.471886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.471904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-24T18:37:35.471910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.471917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-24T18:37:35.471923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.471928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-24T18:37:35.471975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.471979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.471981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.471984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.471986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.471999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.472018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.472123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.472157Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1764009455462
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.472640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597360:3440] destroyed
2025-11-24T18:37:35.473131Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.473575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597364:3443], now have 1 active actors on pipe
2025-11-24T18:37:35.475251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.475277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.475316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ee919c3b-90bcdf3b-e2c180e4-3bb6e16e_13 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.475328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.475332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.475338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.475340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.475345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.475358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.475360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.475363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.475382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.475399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.482208Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ee919c3b-90bcdf3b-e2c180e4-3bb6e16e_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:35.482755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597364:3443] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|ee919c3b-90bcdf3b-e2c180e4-3bb6e16e_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.491409Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.492282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597366:3444], now have 1 active actors on pipe
2025-11-24T18:37:35.494106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.494127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.494208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.494266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.494278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.494283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.494309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.494333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.494340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.494350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.494352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.494357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.494360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.494388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.494424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-24T18:37:35.494445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.494448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-24T18:37:35.494451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.494456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-24T18:37:35.494691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-24T18:37:35.494703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.494706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.494709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.494792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1764009455494
2025-11-24T18:37:35.494966Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.494978Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.499880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.499906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.499932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.499949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.499964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-24T18:37:35.499972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.499977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-24T18:37:35.499986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.499991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-24T18:37:35.500036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.500040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.500042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.500044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.500046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.500056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.500073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.500350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.501224Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1764009455494
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-24T18:37:35.501702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597366:3444] destroyed
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.503075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.503089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.503091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.503096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.503098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.503902Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.504474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597370:3447], now have 1 active actors on pipe
2025-11-24T18:37:35.504496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.504503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.504535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ee3f2525-2f6ff05f-e09a6a0c-798788a7_14 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.504544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.504547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.504553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.504555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.504559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.504573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.504576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.504578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.504595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.504616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.505157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597370:3447] destroyed
2025-11-24T18:37:35.504755Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ee3f2525-2f6ff05f-e09a6a0c-798788a7_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|ee3f2525-2f6ff05f-e09a6a0c-798788a7_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.511542Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.513501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597373:3449], now have 1 active actors on pipe
2025-11-24T18:37:35.513847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.513857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.513928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.513974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.513982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.513987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.514010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.514033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.514037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.514048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.514051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.514056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.514058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.514063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.514097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-24T18:37:35.514112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.514115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-24T18:37:35.514120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.514126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-24T18:37:35.514358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-24T18:37:35.514380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.514383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.514386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.514459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1764009455514
2025-11-24T18:37:35.514663Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.514675Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.519869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.519900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.519929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.519941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.519957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-24T18:37:35.519965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.519969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-24T18:37:35.519975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.519979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-24T18:37:35.520025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.520031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.520034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.520036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.520039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.520050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.520072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.520194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.520275Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1764009455513
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.520916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597373:3449] destroyed
2025-11-24T18:37:35.523870Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.526166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597379:3453], now have 1 active actors on pipe
2025-11-24T18:37:35.526928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.526943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.526985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|aaf5a141-2b3786c5-c96b9de6-6e034a2a_15 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.527004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.527008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.527015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.527017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.527021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.527034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.527037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.527040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.527061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.527097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.527253Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|aaf5a141-2b3786c5-c96b9de6-6e034a2a_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:35.528009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597379:3453] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|aaf5a141-2b3786c5-c96b9de6-6e034a2a_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.536669Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.538977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597383:3455], now have 1 active actors on pipe
2025-11-24T18:37:35.539308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.539327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.539402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.539465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.539479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.539484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.539505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.539533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.539541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.539553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.539560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.539565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.539566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.539571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.539605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-24T18:37:35.539635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.539638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-24T18:37:35.539641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.539644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-24T18:37:35.540199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-24T18:37:35.540219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.540222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.540225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.540295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1764009455539
2025-11-24T18:37:35.540481Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.540492Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.548708Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.546550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.546587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.546618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.546629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.546642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-24T18:37:35.546646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.546651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-24T18:37:35.546658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.546662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-24T18:37:35.546734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.546737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.546739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.546742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.546744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.546776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.546779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000009_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.546782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.546784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.546786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000012_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.546788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.546790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.546792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000015_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.546794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-11-24T18:37:35.546815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.546825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-11-24T18:37:35.546827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-24T18:37:35.546837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000009_00000_0000000001_00002?
2025-11-24T18:37:35.546846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000001_00002?
2025-11-24T18:37:35.546855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00000_0000000001_00002?
2025-11-24T18:37:35.546874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000012_00000_0000000001_00002?
2025-11-24T18:37:35.546890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00000_0000000001_00002?
2025-11-24T18:37:35.546898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000001_00002?
2025-11-24T18:37:35.546906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000015_00000_0000000001_00002?
2025-11-24T18:37:35.546914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-11-24T18:37:35.546924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.546927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.546931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.546934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.546938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.546941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.546944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.546946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.546961Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-11-24T18:37:35.546994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-24T18:37:35.547005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-24T18:37:35.547008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.547021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-24T18:37:35.547149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.0/3
2025-11-24T18:37:35.547158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-24T18:37:35.547164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:0 appended
2025-11-24T18:37:35.547300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.1/3
2025-11-24T18:37:35.547306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-24T18:37:35.547309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:1 appended
2025-11-24T18:37:35.547334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.2/3
2025-11-24T18:37:35.547337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-24T18:37:35.547559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-24T18:37:35.547565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:2 appended
2025-11-24T18:37:35.547570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000009_00000_0000000001_00002?
2025-11-24T18:37:35.547572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.547575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000009_00000_0000000001_00002?, parameters.CurOffset=9
2025-11-24T18:37:35.547701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 9.0/3
2025-11-24T18:37:35.547705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-24T18:37:35.547707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 9:0 appended
2025-11-24T18:37:35.548166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 9.1/3
2025-11-24T18:37:35.548172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-24T18:37:35.548177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 9:1 appended
2025-11-24T18:37:35.548194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 9.2/3
2025-11-24T18:37:35.548197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-24T18:37:35.548398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.548411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.548415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.548417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.548420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.548423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.548426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.548429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.548431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.548760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2097545 count 2 nextOffset 10 batches 5
2025-11-24T18:37:35.548768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 9:2 appended
2025-11-24T18:37:35.548774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000010_00000_0000000001_00002?
2025-11-24T18:37:35.548775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.548778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000010_00000_0000000001_00002?, parameters.CurOffset=10
2025-11-24T18:37:35.548916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 10.0/3
2025-11-24T18:37:35.548922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-24T18:37:35.548925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 10:0 appended
2025-11-24T18:37:35.549403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 10.1/3
2025-11-24T18:37:35.549408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1764009455539
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.551464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 10:1 appended
2025-11-24T18:37:35.551500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 10.2/3
2025-11-24T18:37:35.551507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-24T18:37:35.552222Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.552474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 3146300 count 3 nextOffset 11 batches 7
2025-11-24T18:37:35.552490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 10:2 appended
2025-11-24T18:37:35.552496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000011_00000_0000000001_00002?
2025-11-24T18:37:35.552501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.552504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000011_00000_0000000001_00002?, parameters.CurOffset=11
2025-11-24T18:37:35.552646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 11.0/3
2025-11-24T18:37:35.552652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-24T18:37:35.552656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 11:0 appended
2025-11-24T18:37:35.552782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 11.1/3
2025-11-24T18:37:35.552786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-24T18:37:35.552788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 11:1 appended
2025-11-24T18:37:35.552800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 11.2/3
2025-11-24T18:37:35.552802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-24T18:37:35.553029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4195055 count 4 nextOffset 12 batches 9
2025-11-24T18:37:35.553035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 11:2 appended
2025-11-24T18:37:35.553039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000012_00000_0000000001_00002?
2025-11-24T18:37:35.553041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.553044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000012_00000_0000000001_00002?, parameters.CurOffset=12
2025-11-24T18:37:35.553163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 12.0/3
2025-11-24T18:37:35.553168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-24T18:37:35.553171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 12:0 appended
2025-11-24T18:37:35.553313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 12.1/3
2025-11-24T18:37:35.553318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-24T18:37:35.553320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 12:1 appended
2025-11-24T18:37:35.553333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 12.2/3
2025-11-24T18:37:35.553336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-24T18:37:35.553518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 5243810 count 5 nextOffset 13 batches 11
2025-11-24T18:37:35.553525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 12:2 appended
2025-11-24T18:37:35.553529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000013_00000_0000000001_00002?
2025-11-24T18:37:35.553534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.553537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000013_00000_0000000001_00002?, parameters.CurOffset=13
2025-11-24T18:37:35.553676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 13.0/3
2025-11-24T18:37:35.553681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-24T18:37:35.553684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 13:0 appended
2025-11-24T18:37:35.553818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 13.1/3
2025-11-24T18:37:35.553822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-24T18:37:35.553824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 13:1 appended
2025-11-24T18:37:35.553834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 13.2/3
2025-11-24T18:37:35.553837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-24T18:37:35.554041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 6292565 count 6 nextOffset 14 batches 13
2025-11-24T18:37:35.554046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 13:2 appended
2025-11-24T18:37:35.554050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000014_00000_0000000001_00002?
2025-11-24T18:37:35.554052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.554055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000014_00000_0000000001_00002?, parameters.CurOffset=14
2025-11-24T18:37:35.554187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 14.0/3
2025-11-24T18:37:35.554193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-24T18:37:35.554195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 14:0 appended
2025-11-24T18:37:35.554507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 14.1/3
2025-11-24T18:37:35.554511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-24T18:37:35.554514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 14:1 appended
2025-11-24T18:37:35.554526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 14.2/3
2025-11-24T18:37:35.554528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-24T18:37:35.554699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 7341320 count 7 nextOffset 15 batches 15
2025-11-24T18:37:35.554704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 14:2 appended
2025-11-24T18:37:35.554707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000015_00000_0000000001_00002?
2025-11-24T18:37:35.554709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.554711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000015_00000_0000000001_00002?, parameters.CurOffset=15
2025-11-24T18:37:35.554841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 15.0/3
2025-11-24T18:37:35.554845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-24T18:37:35.554847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 15:0 appended
2025-11-24T18:37:35.554973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 15.1/3
2025-11-24T18:37:35.554979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-24T18:37:35.559866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 15 partNo 1 result is x0000000000_00000000000000000007_00002_0000000008_00015 size 7878063
2025-11-24T18:37:35.559883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 15:1 appended
2025-11-24T18:37:35.559903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 15.2/3
2025-11-24T18:37:35.559910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-24T18:37:35.559923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000007_00002_0000000008_00015 new key d0000000000_00000000000000000007_00002_0000000008_00015 size 7878063 WTime 1764009455559
2025-11-24T18:37:35.560056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 15 partNo 2 FormedBlobsCount 1 NewHead: Offset 15 PartNo 1 PackedSize 536763 count 1 nextOffset 16 batches 2
2025-11-24T18:37:35.560064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 15:2 appended
2025-11-24T18:37:35.560126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 7 endOffset 8 curOffset 16 d0000000000_00000000000000000015_00001_0000000001_00001| size 536753 WTime 1764009455559
2025-11-24T18:37:35.560251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597383:3455] destroyed
2025-11-24T18:37:35.560261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597390:3458], now have 1 active actors on pipe
2025-11-24T18:37:35.560282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.560288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.560303Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.560314Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 2 count 8 size 7878063
2025-11-24T18:37:35.560321Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 1 count 1 size 536753
2025-11-24T18:37:35.560354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|42d9f784-6ae2e1a-8a5a463b-ced6fe82_16 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.560364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.560367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.560372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.560374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.560379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.560390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.560393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.560397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.560419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.561487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.561750Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|42d9f784-6ae2e1a-8a5a463b-ced6fe82_16"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:35.575410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597390:3458] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|42d9f784-6ae2e1a-8a5a463b-ced6fe82_16"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 16
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.585554Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.589619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597393:3460], now have 1 active actors on pipe
2025-11-24T18:37:35.591366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.591392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.591465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.591539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.591549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.591554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.591579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.591600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.591604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.591613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.591615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.591618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.591620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.591625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.591661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 0
2025-11-24T18:37:35.591677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.591680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 1
2025-11-24T18:37:35.591682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.591685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 2
2025-11-24T18:37:35.592447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 16 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 1048790 count 1 nextOffset 17 batches 3
2025-11-24T18:37:35.592463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.592466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.592470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.592560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 16,1 HeadOffset 16 endOffset 16 curOffset 17 d0000000000_00000000000000000016_00000_0000000001_00002? size 1048780 WTime 1764009455592
2025-11-24T18:37:35.592749Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.592764Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.602350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.602405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.602430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.602443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.602454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 0, Offset: 16 is stored on disk
2025-11-24T18:37:35.602458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.602462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 1, Offset: 16 is stored on disk
2025-11-24T18:37:35.602467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.602471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 2, Offset: 16 is stored on disk
2025-11-24T18:37:35.602529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.602533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.602535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.602537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.602539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.602550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:178: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-11-24T18:37:35.602570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.602793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.603086Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 16
    Offset: 16
    PartNo: 0
    WriteTimestampMS: 1764009455591
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.604467Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.604458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.604477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.604481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.604484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.604487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.604521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597393:3460] destroyed
2025-11-24T18:37:35.605204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597402:3467], now have 1 active actors on pipe
2025-11-24T18:37:35.605227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.605234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.605271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b6d9b1ee-1e290285-dec22d9f-1aa111ff_17 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.605281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.605286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.605292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.605294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.605299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.605312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.605315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.605318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.605337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.605352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.605513Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b6d9b1ee-1e290285-dec22d9f-1aa111ff_17"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:35.609164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597402:3467] destroyed
2025-11-24T18:37:35.609317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 8 size 7878063 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.609323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 536753 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.609340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.609488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.609491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.609494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.609496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.609500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.609535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.609542Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.609549Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-24T18:37:35.609551Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000009_00000_0000000001_00002?(+) to d0000000000_00000000000000000009_00000_0000000001_00002?(+)
2025-11-24T18:37:35.609553Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000001_00002?(+) to d0000000000_00000000000000000010_00000_0000000001_00002?(+)
2025-11-24T18:37:35.609555Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00000_0000000001_00002?(+) to d0000000000_00000000000000000011_00000_0000000001_00002?(+)
2025-11-24T18:37:35.609557Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000012_00000_0000000001_00002?(+) to d0000000000_00000000000000000012_00000_0000000001_00002?(+)
2025-11-24T18:37:35.609559Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00000_0000000001_00002?(+) to d0000000000_00000000000000000013_00000_0000000001_00002?(+)
2025-11-24T18:37:35.609561Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00000_0000000001_00002?(+) to d0000000000_00000000000000000014_00000_0000000001_00002?(+)
2025-11-24T18:37:35.609566Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000015_00000_0000000001_00002?(+) to d0000000000_00000000000000000015_00000_0000000001_00002?(+)
2025-11-24T18:37:35.609568Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00002_0000000001_00000|(+) to d0000000000_00000000000000000007_00002_0000000001_00000|(+)
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b6d9b1ee-1e290285-dec22d9f-1aa111ff_17"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 17
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.609999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2025-11-24T18:37:35.610010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 1 parts 1 suffix '124' size 536753
2025-11-24T18:37:35.615241Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.617239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597405:3469], now have 1 active actors on pipe
2025-11-24T18:37:35.617636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.617647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.617722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.617772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.617779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.617783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.617834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 9 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 10 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 11 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 12 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 13 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 14 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 15 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.617901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.617921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.617925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:35.617929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.617930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.617935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.617939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.617943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.617947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.617952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.617957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.617961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-24T18:37:35.617962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.617973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.617977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.617987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.617989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.617993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.617995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.617999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.618028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 0
2025-11-24T18:37:35.618044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.618046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 1
2025-11-24T18:37:35.618050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.618052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 2
2025-11-24T18:37:35.618301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 17 partNo 2 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1048790 count 1 nextOffset 18 batches 3
2025-11-24T18:37:35.618313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.618316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.618319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.620359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 17,1 HeadOffset 17 endOffset 17 curOffset 18 d0000000000_00000000000000000017_00000_0000000001_00002? size 1048780 WTime 1764009455619
2025-11-24T18:37:35.620547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.620691Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.620704Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.627786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.627820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.627847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.627856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.627869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 0, Offset: 17 is stored on disk
2025-11-24T18:37:35.627873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.627881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 1, Offset: 17 is stored on disk
2025-11-24T18:37:35.627888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.627895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 2, Offset: 17 is stored on disk
2025-11-24T18:37:35.627945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.627948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.627950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.627953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.627955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.627969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.627990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.628059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.628171Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.628519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597405:3469] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 17
    Offset: 17
    PartNo: 0
    WriteTimestampMS: 1764009455617
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 9
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.629386Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.629939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597410:3473], now have 1 active actors on pipe
2025-11-24T18:37:35.629957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.629963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.629998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|154ff1f9-888bc5ce-f37525f0-2bce0fce_18 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.630008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.630011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.630017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.630019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.630024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.630037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.630040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.630043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.630060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.630073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.631592Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.632441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597410:3473] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|154ff1f9-888bc5ce-f37525f0-2bce0fce_18"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|154ff1f9-888bc5ce-f37525f0-2bce0fce_18"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 18
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.638078Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.642527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597412:3474], now have 1 active actors on pipe
2025-11-24T18:37:35.644024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.644051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.644135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.644190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.644199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.644204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.644227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.644260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.644264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.644273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.644280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.644286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.644288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.644294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.644331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 0
2025-11-24T18:37:35.644344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.644347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 1
2025-11-24T18:37:35.644350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.644353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 2
2025-11-24T18:37:35.644597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 18 partNo 2 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 1048790 count 1 nextOffset 19 batches 3
2025-11-24T18:37:35.644609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.644612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.644615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.644689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 18,1 HeadOffset 18 endOffset 18 curOffset 19 d0000000000_00000000000000000018_00000_0000000001_00002? size 1048780 WTime 1764009455643
2025-11-24T18:37:35.644832Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.644843Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.652860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.652888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.652932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.652942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.652954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 0, Offset: 18 is stored on disk
2025-11-24T18:37:35.652957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.652961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 1, Offset: 18 is stored on disk
2025-11-24T18:37:35.652970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.652974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 2, Offset: 18 is stored on disk
2025-11-24T18:37:35.653021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.653025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.653027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.653029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.653031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.653045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.653064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.653338Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.653240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.654086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597412:3474] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 18
    Offset: 18
    PartNo: 0
    WriteTimestampMS: 1764009455643
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 8
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.654922Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.655535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597416:3477], now have 1 active actors on pipe
2025-11-24T18:37:35.655555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.655561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.655596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|76d35f8a-1500c4fe-7635ea34-d715e6ec_19 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.655606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.655610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.655615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.655617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.655624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.655636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.655639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.655642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.655660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.655675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.656613Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.657145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597416:3477] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|76d35f8a-1500c4fe-7635ea34-d715e6ec_19"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|76d35f8a-1500c4fe-7635ea34-d715e6ec_19"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 19
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.664039Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.665816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597418:3478], now have 1 active actors on pipe
2025-11-24T18:37:35.667620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.667640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.667707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.667761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.667770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.667774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.667794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.667817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.667820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.667831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.667836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.667840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.667842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.667846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.667903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 0
2025-11-24T18:37:35.667917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.667920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 1
2025-11-24T18:37:35.667923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.667925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 2
2025-11-24T18:37:35.668184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 19 partNo 2 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1048790 count 1 nextOffset 20 batches 3
2025-11-24T18:37:35.668197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.668200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.668203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.668273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 19,1 HeadOffset 19 endOffset 19 curOffset 20 d0000000000_00000000000000000019_00000_0000000001_00002? size 1048780 WTime 1764009455667
2025-11-24T18:37:35.668420Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.668431Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 19 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.678240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 19 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.678267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.678296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.678304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.678315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 0, Offset: 19 is stored on disk
2025-11-24T18:37:35.678319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.678326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 1, Offset: 19 is stored on disk
2025-11-24T18:37:35.678331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.678336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 2, Offset: 19 is stored on disk
2025-11-24T18:37:35.678405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.678408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.678410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.678413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.678418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.678432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.678453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.678631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.678862Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.682495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597418:3478] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 19
    Offset: 19
    PartNo: 0
    WriteTimestampMS: 1764009455667
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 9
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.685555Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.686295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597423:3482], now have 1 active actors on pipe
2025-11-24T18:37:35.686316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.686323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.686356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|16409098-f2c8519-5c6d761a-c175af6c_20 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.686382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.686386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.686391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.686395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.686399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.686412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.686415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.686418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.686439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.686454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.686640Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.687238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597423:3482] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|16409098-f2c8519-5c6d761a-c175af6c_20"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|16409098-f2c8519-5c6d761a-c175af6c_20"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 20
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.696486Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.699154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597425:3483], now have 1 active actors on pipe
2025-11-24T18:37:35.699501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.699511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.699588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.699644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.699654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.699658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.699679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.699702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.699705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.699718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.699721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.699725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.699727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.699733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.699768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 0
2025-11-24T18:37:35.699782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.699784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 1
2025-11-24T18:37:35.699788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.699793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 2
2025-11-24T18:37:35.700046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 20 partNo 2 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 1048790 count 1 nextOffset 21 batches 3
2025-11-24T18:37:35.700057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.700060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.700064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.700137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 20,1 HeadOffset 20 endOffset 20 curOffset 21 d0000000000_00000000000000000020_00000_0000000001_00002? size 1048780 WTime 1764009455699
2025-11-24T18:37:35.700315Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.700327Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.708352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:35.710501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.710527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.710553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.710564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.710578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 0, Offset: 20 is stored on disk
2025-11-24T18:37:35.710582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.710585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 1, Offset: 20 is stored on disk
2025-11-24T18:37:35.710591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.710595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 2, Offset: 20 is stored on disk
2025-11-24T18:37:35.710639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.710643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.710645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.710649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.710651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.710663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.710684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.710829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.710957Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.713535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597425:3483] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 20
    Offset: 20
    PartNo: 0
    WriteTimestampMS: 1764009455698
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.724072Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.724671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597429:3486], now have 1 active actors on pipe
2025-11-24T18:37:35.725143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.725156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.725216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a68fe85f-7746e018-92dab200-63bbbce0_21 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.725230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.725237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.725243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.725244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.725249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.725263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.725266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.725269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.725290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.725309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.725475Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.726205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597429:3486] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a68fe85f-7746e018-92dab200-63bbbce0_21"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|a68fe85f-7746e018-92dab200-63bbbce0_21"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 21
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.744361Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.754295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597431:3487], now have 1 active actors on pipe
2025-11-24T18:37:35.755776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.755800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.755865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.755923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.755932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.755937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.755963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.755993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.755997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.756009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.756012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.756015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.756017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.756023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.756061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 0
2025-11-24T18:37:35.756076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.756079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 1
2025-11-24T18:37:35.756082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.756085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 2
2025-11-24T18:37:35.756363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 21 partNo 2 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1048790 count 1 nextOffset 22 batches 3
2025-11-24T18:37:35.756376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.756383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.756386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.756458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 21,1 HeadOffset 21 endOffset 21 curOffset 22 d0000000000_00000000000000000021_00000_0000000001_00002? size 1048780 WTime 1764009455755
2025-11-24T18:37:35.756608Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.756621Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.763354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.763387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.763419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.763432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.763443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 0, Offset: 21 is stored on disk
2025-11-24T18:37:35.763447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.763452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 1, Offset: 21 is stored on disk
2025-11-24T18:37:35.763457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.763460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 2, Offset: 21 is stored on disk
2025-11-24T18:37:35.763508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.763511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.763512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.763514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.763517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.763531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.763550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.763699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.763876Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.765221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597431:3487] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 21
    Offset: 21
    PartNo: 0
    WriteTimestampMS: 1764009455755
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.779811Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.780311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597448:3495], now have 1 active actors on pipe
2025-11-24T18:37:35.780598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.780609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.780656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b5836e53-28b3baa4-1b9043a2-b9ba5d42_22 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.780668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.780672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.780679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.780681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.780686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.780699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.780702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.780706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.780726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.780744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.781024Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.782315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597448:3495] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b5836e53-28b3baa4-1b9043a2-b9ba5d42_22"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b5836e53-28b3baa4-1b9043a2-b9ba5d42_22"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 22
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.796466Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.808873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597451:3497], now have 1 active actors on pipe
2025-11-24T18:37:35.810125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.810139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.810142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.810146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.810148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.810553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.810566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.810655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.810722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.810732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.810737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.810756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.810777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.810780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.810790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.810792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.810796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.810798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.810802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.810840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 0
2025-11-24T18:37:35.810857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.810861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 1
2025-11-24T18:37:35.810864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.810867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 2
2025-11-24T18:37:35.811151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 22 partNo 2 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1048790 count 1 nextOffset 23 batches 3
2025-11-24T18:37:35.811164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.811166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.811169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.811238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 22,1 HeadOffset 22 endOffset 22 curOffset 23 d0000000000_00000000000000000022_00000_0000000001_00002? size 1048780 WTime 1764009455811
2025-11-24T18:37:35.811385Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.811398Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.823003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.823037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.823068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.823078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.823090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 0, Offset: 22 is stored on disk
2025-11-24T18:37:35.823096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.823100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 1, Offset: 22 is stored on disk
2025-11-24T18:37:35.823106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.823111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 2, Offset: 22 is stored on disk
2025-11-24T18:37:35.823165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.823169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.823171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.823175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.823177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.823192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.823212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.823374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.823499Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 22
    Offset: 22
    PartNo: 0
    WriteTimestampMS: 1764009455810
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.831627Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.834705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597451:3497] destroyed
2025-11-24T18:37:35.834728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597458:3500], now have 1 active actors on pipe
2025-11-24T18:37:35.834746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.834753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.834793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|616eb55b-ed91b456-2d3726f5-705cfd50_23 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.834804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.834808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.834814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.834817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.834820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.834833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.834836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.834844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.834863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.834877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|616eb55b-ed91b456-2d3726f5-705cfd50_23"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:35.835037Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.835608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597458:3500] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|616eb55b-ed91b456-2d3726f5-705cfd50_23"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 23
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.842457Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.845220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597460:3501], now have 1 active actors on pipe
2025-11-24T18:37:35.846691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.846711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.846779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.846825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.846834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.846839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.846863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.846886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.846890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.846901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.846903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.846907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.846909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.846916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.846953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 0
2025-11-24T18:37:35.846965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.846968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 1
2025-11-24T18:37:35.846972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.846975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 2
2025-11-24T18:37:35.847204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 23 partNo 2 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1048790 count 1 nextOffset 24 batches 3
2025-11-24T18:37:35.847215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.847217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.847221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.847295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 23,1 HeadOffset 23 endOffset 23 curOffset 24 d0000000000_00000000000000000023_00000_0000000001_00002? size 1048780 WTime 1764009455847
2025-11-24T18:37:35.847928Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.847941Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.855140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.855168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.855192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.855200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.855211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 0, Offset: 23 is stored on disk
2025-11-24T18:37:35.855214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.855218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 1, Offset: 23 is stored on disk
2025-11-24T18:37:35.855225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.855231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 2, Offset: 23 is stored on disk
2025-11-24T18:37:35.855273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.855277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.855279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.855282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.855284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.855297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.855299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.855301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000018_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.855304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000019_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.855306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.855308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000021_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.855311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.855313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00000_0000000001_00002? (1048780)
2025-11-24T18:37:35.855316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-11-24T18:37:35.855336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.855349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-11-24T18:37:35.855352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000001_00002?
2025-11-24T18:37:35.855362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00000_0000000001_00002?
2025-11-24T18:37:35.855371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000018_00000_0000000001_00002?
2025-11-24T18:37:35.855382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000019_00000_0000000001_00002?
2025-11-24T18:37:35.855393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00000_0000000001_00002?
2025-11-24T18:37:35.855407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000021_00000_0000000001_00002?
2025-11-24T18:37:35.855414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000001_00002?
2025-11-24T18:37:35.855422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000023_00000_0000000001_00002?
2025-11-24T18:37:35.855431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-11-24T18:37:35.855441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.855444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.855447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 18 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.855450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 19 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.855453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.855456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 21 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.855459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 22 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.855461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:35.855468Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-11-24T18:37:35.855498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-24T18:37:35.855509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000016_00000_0000000001_00002?
2025-11-24T18:37:35.855512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.855514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000016_00000_0000000001_00002?, parameters.CurOffset=16
2025-11-24T18:37:35.855653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 16.0/3
2025-11-24T18:37:35.855662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 0
2025-11-24T18:37:35.855669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 16:0 appended
2025-11-24T18:37:35.855814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 16.1/3
2025-11-24T18:37:35.855827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 1
2025-11-24T18:37:35.855829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 16:1 appended
2025-11-24T18:37:35.855843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 16.2/3
2025-11-24T18:37:35.855846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 2
2025-11-24T18:37:35.856075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 16 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 1048790 count 1 nextOffset 17 batches 3
2025-11-24T18:37:35.856083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 16:2 appended
2025-11-24T18:37:35.856089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000017_00000_0000000001_00002?
2025-11-24T18:37:35.856092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.856097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000017_00000_0000000001_00002?, parameters.CurOffset=17
2025-11-24T18:37:35.856242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 17.0/3
2025-11-24T18:37:35.856248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 0
2025-11-24T18:37:35.856250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 17:0 appended
2025-11-24T18:37:35.856383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 17.1/3
2025-11-24T18:37:35.856386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 1
2025-11-24T18:37:35.856388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 17:1 appended
2025-11-24T18:37:35.856401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 17.2/3
2025-11-24T18:37:35.856403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 2
2025-11-24T18:37:35.857019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 17 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2097545 count 2 nextOffset 18 batches 5
2025-11-24T18:37:35.857025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 17:2 appended
2025-11-24T18:37:35.857029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000018_00000_0000000001_00002?
2025-11-24T18:37:35.857031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.857034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000018_00000_0000000001_00002?, parameters.CurOffset=18
2025-11-24T18:37:35.857165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 18.0/3
2025-11-24T18:37:35.857171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 0
2025-11-24T18:37:35.857173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 18:0 appended
2025-11-24T18:37:35.857673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 18.1/3
2025-11-24T18:37:35.857681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 1
2025-11-24T18:37:35.857683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 18:1 appended
2025-11-24T18:37:35.857694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 18.2/3
2025-11-24T18:37:35.857696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 2
2025-11-24T18:37:35.858526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.858539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.858543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.858546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.858549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.858553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.858557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.858560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.858563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:35.859090Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 23
    Offset: 23
    PartNo: 0
    WriteTimestampMS: 1764009455846
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.861164Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.864145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 18 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 3146300 count 3 nextOffset 19 batches 7
2025-11-24T18:37:35.864172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 18:2 appended
2025-11-24T18:37:35.864179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000019_00000_0000000001_00002?
2025-11-24T18:37:35.864183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.864187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000019_00000_0000000001_00002?, parameters.CurOffset=19
2025-11-24T18:37:35.864343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 19.0/3
2025-11-24T18:37:35.864357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 0
2025-11-24T18:37:35.864362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 19:0 appended
2025-11-24T18:37:35.864490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 19.1/3
2025-11-24T18:37:35.864495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 1
2025-11-24T18:37:35.864501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 19:1 appended
2025-11-24T18:37:35.864516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 19.2/3
2025-11-24T18:37:35.864518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 2
2025-11-24T18:37:35.865131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 19 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4195055 count 4 nextOffset 20 batches 9
2025-11-24T18:37:35.865137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 19:2 appended
2025-11-24T18:37:35.865143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000020_00000_0000000001_00002?
2025-11-24T18:37:35.865145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.865150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000020_00000_0000000001_00002?, parameters.CurOffset=20
2025-11-24T18:37:35.865484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 20.0/3
2025-11-24T18:37:35.865494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 0
2025-11-24T18:37:35.865497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 20:0 appended
2025-11-24T18:37:35.865625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 20.1/3
2025-11-24T18:37:35.865630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 1
2025-11-24T18:37:35.865632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 20:1 appended
2025-11-24T18:37:35.865645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 20.2/3
2025-11-24T18:37:35.865647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 2
2025-11-24T18:37:35.865826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 20 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 5243810 count 5 nextOffset 21 batches 11
2025-11-24T18:37:35.865832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 20:2 appended
2025-11-24T18:37:35.865835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000021_00000_0000000001_00002?
2025-11-24T18:37:35.865837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.865840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000021_00000_0000000001_00002?, parameters.CurOffset=21
2025-11-24T18:37:35.865969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 21.0/3
2025-11-24T18:37:35.865973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 0
2025-11-24T18:37:35.865975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 21:0 appended
2025-11-24T18:37:35.866116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 21.1/3
2025-11-24T18:37:35.866127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 1
2025-11-24T18:37:35.866130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 21:1 appended
2025-11-24T18:37:35.866148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 21.2/3
2025-11-24T18:37:35.866151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 2
2025-11-24T18:37:35.866321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 21 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 6292565 count 6 nextOffset 22 batches 13
2025-11-24T18:37:35.866326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 21:2 appended
2025-11-24T18:37:35.866329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000022_00000_0000000001_00002?
2025-11-24T18:37:35.866333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.866336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000022_00000_0000000001_00002?, parameters.CurOffset=22
2025-11-24T18:37:35.866478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 22.0/3
2025-11-24T18:37:35.866483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 0
2025-11-24T18:37:35.866485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 22:0 appended
2025-11-24T18:37:35.866964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 22.1/3
2025-11-24T18:37:35.866969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 1
2025-11-24T18:37:35.866971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 22:1 appended
2025-11-24T18:37:35.866983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 22.2/3
2025-11-24T18:37:35.866986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 2
2025-11-24T18:37:35.867452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 22 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 7341320 count 7 nextOffset 23 batches 15
2025-11-24T18:37:35.867456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 22:2 appended
2025-11-24T18:37:35.867459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000023_00000_0000000001_00002?
2025-11-24T18:37:35.867460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:35.867462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000023_00000_0000000001_00002?, parameters.CurOffset=23
2025-11-24T18:37:35.867579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 23.0/3
2025-11-24T18:37:35.867583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 0
2025-11-24T18:37:35.873776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 23 partNo 0 result is x0000000000_00000000000000000015_00001_0000000008_00015 size 7878063
2025-11-24T18:37:35.873798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 23:0 appended
2025-11-24T18:37:35.873931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 23.1/3
2025-11-24T18:37:35.873938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 1
2025-11-24T18:37:35.873941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 23:1 appended
2025-11-24T18:37:35.873958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 23.2/3
2025-11-24T18:37:35.873961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 2
2025-11-24T18:37:35.873977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000015_00001_0000000008_00015 new key d0000000000_00000000000000000015_00001_0000000008_00015 size 7878063 WTime 1764009455873
2025-11-24T18:37:35.874226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 23 partNo 2 FormedBlobsCount 1 NewHead: Offset 23 PartNo 0 PackedSize 1048790 count 1 nextOffset 24 batches 3
2025-11-24T18:37:35.874238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 23:2 appended
2025-11-24T18:37:35.874293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 23,1 HeadOffset 15 endOffset 16 curOffset 24 d0000000000_00000000000000000023_00000_0000000001_00002| size 1048780 WTime 1764009455873
2025-11-24T18:37:35.874484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597460:3501] destroyed
2025-11-24T18:37:35.874495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597465:3505], now have 1 active actors on pipe
2025-11-24T18:37:35.874521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.874526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.874540Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.874552Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 1 count 8 size 7878063
2025-11-24T18:37:35.874561Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.875558Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d231d52a-4c354e8a-63cde2ef-d48f000c_24"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d231d52a-4c354e8a-63cde2ef-d48f000c_24"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 24
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.875167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d231d52a-4c354e8a-63cde2ef-d48f000c_24 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.875185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.875189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.884523Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.875195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.875197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.875201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.875213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.875216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.875219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.875239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.875292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.887959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597465:3505] destroyed
2025-11-24T18:37:35.887979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597467:3506], now have 1 active actors on pipe
2025-11-24T18:37:35.888625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.888635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.888785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.889177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.889198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.889203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.889238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.889260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.889265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.889275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.889277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.889281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.889284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.889289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.889325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 0
2025-11-24T18:37:35.889338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.889344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 1
2025-11-24T18:37:35.889347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.889350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 2
2025-11-24T18:37:35.890080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 24 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 1048790 count 1 nextOffset 25 batches 3
2025-11-24T18:37:35.890092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.890094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.890098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.890169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 24,1 HeadOffset 24 endOffset 24 curOffset 25 d0000000000_00000000000000000024_00000_0000000001_00002? size 1048780 WTime 1764009455889
2025-11-24T18:37:35.890307Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.890319Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.899917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 24 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.899950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.899982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.899991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.900006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 0, Offset: 24 is stored on disk
2025-11-24T18:37:35.900010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.900015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 1, Offset: 24 is stored on disk
2025-11-24T18:37:35.900022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.900025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 2, Offset: 24 is stored on disk
2025-11-24T18:37:35.900071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.900075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.900077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.900079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.900082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.900096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:178: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-11-24T18:37:35.900125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.900278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.900394Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 24
    Offset: 24
    PartNo: 0
    WriteTimestampMS: 1764009455888
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.901583Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.903027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597467:3506] destroyed
2025-11-24T18:37:35.903051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597472:3510], now have 1 active actors on pipe
2025-11-24T18:37:35.903069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.903076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.903115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9ec4042d-15643b91-9604f1aa-b4e2532f_25 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.903127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.903132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.903137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.903139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.903144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.903157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.903160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.903163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.903193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.903210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.903395Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9ec4042d-15643b91-9604f1aa-b4e2532f_25"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|9ec4042d-15643b91-9604f1aa-b4e2532f_25"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 25
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.910161Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.916090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597472:3510] destroyed
2025-11-24T18:37:35.916114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597474:3511], now have 1 active actors on pipe
2025-11-24T18:37:35.916131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.916135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.916137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.916140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.916142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.916681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.916694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.916791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.916853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.916868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.916873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.916923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.916943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.916946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.916957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.916961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.916964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.916966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.916971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.917032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 0
2025-11-24T18:37:35.917053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.917057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 1
2025-11-24T18:37:35.917061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.917064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 2
2025-11-24T18:37:35.917313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 25 partNo 2 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 1048790 count 1 nextOffset 26 batches 3
2025-11-24T18:37:35.917327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.917329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.917335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.917409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 25,1 HeadOffset 25 endOffset 25 curOffset 26 d0000000000_00000000000000000025_00000_0000000001_00002? size 1048780 WTime 1764009455913
2025-11-24T18:37:35.917583Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.917597Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.924988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 8 size 7878063 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.925014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.925032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.925194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365339
2025-11-24T18:37:35.925201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0' size 7878063
2025-11-24T18:37:35.925206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '124' size 1048780
2025-11-24T18:37:35.925251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:35.925257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.925269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8365339 cause it's been evicted from L2. Actual L1 size: 13
2025-11-24T18:37:35.925274Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-11-24T18:37:35.925346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.925358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.925383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.925392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.925404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 0, Offset: 25 is stored on disk
2025-11-24T18:37:35.925408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.925412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 1, Offset: 25 is stored on disk
2025-11-24T18:37:35.925421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.925426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 2, Offset: 25 is stored on disk
2025-11-24T18:37:35.925453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.925455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.925457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.925459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.925461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.925488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.925505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.925511Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.925519Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000001_00002?(+) to d0000000000_00000000000000000016_00000_0000000001_00002?(+)
2025-11-24T18:37:35.925520Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00000_0000000001_00002?(+) to d0000000000_00000000000000000017_00000_0000000001_00002?(+)
2025-11-24T18:37:35.925522Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000001_00002?(+) to d0000000000_00000000000000000018_00000_0000000001_00002?(+)
2025-11-24T18:37:35.925524Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000019_00000_0000000001_00002?(+) to d0000000000_00000000000000000019_00000_0000000001_00002?(+)
2025-11-24T18:37:35.925527Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00000_0000000001_00002?(+) to d0000000000_00000000000000000020_00000_0000000001_00002?(+)
2025-11-24T18:37:35.925529Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00000_0000000001_00002?(+) to d0000000000_00000000000000000021_00000_0000000001_00002?(+)
2025-11-24T18:37:35.925531Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000001_00002?(+) to d0000000000_00000000000000000022_00000_0000000001_00002?(+)
2025-11-24T18:37:35.925534Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000001_00002?(+) to d0000000000_00000000000000000023_00000_0000000001_00002?(+)
2025-11-24T18:37:35.925536Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000015_00001_0000000001_00001|(+) to d0000000000_00000000000000000015_00001_0000000001_00001|(+)
2025-11-24T18:37:35.925982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.926244Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 25
    Offset: 25
    PartNo: 0
    WriteTimestampMS: 1764009455913
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 8
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.927454Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.928486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597474:3511] destroyed
2025-11-24T18:37:35.928570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597481:3517], now have 1 active actors on pipe
2025-11-24T18:37:35.928584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.928591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.928629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 16 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 17 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 18 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 19 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 20 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 21 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 22 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 23 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 15 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.928697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d89ec5fe-5b0aad1f-2d532df3-a6a809ca_26 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.928708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:35.928712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.928726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.928737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.928741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.928745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.928748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.928752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.928766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.928768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.928770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.928800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.928807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.928819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.929007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.929025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.929030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.929034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.929038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.929043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.929048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.929053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.929058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 1 parts 1 suffix '124' size 536753
2025-11-24T18:37:35.929366Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d89ec5fe-5b0aad1f-2d532df3-a6a809ca_26"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d89ec5fe-5b0aad1f-2d532df3-a6a809ca_26"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 26
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.936599Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.937224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597481:3517] destroyed
2025-11-24T18:37:35.938227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597485:3518], now have 1 active actors on pipe
2025-11-24T18:37:35.939677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.939696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.939771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.939817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.939825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.939830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.939883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.939904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.939908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.939918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.939920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.939924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.939927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.939932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.939962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 0
2025-11-24T18:37:35.939973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.939976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 1
2025-11-24T18:37:35.939978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.939982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 2
2025-11-24T18:37:35.940231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 26 partNo 2 FormedBlobsCount 0 NewHead: Offset 26 PartNo 0 PackedSize 1048790 count 1 nextOffset 27 batches 3
2025-11-24T18:37:35.940244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.940247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.940250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.940325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 26,1 HeadOffset 26 endOffset 26 curOffset 27 d0000000000_00000000000000000026_00000_0000000001_00002? size 1048780 WTime 1764009455940
2025-11-24T18:37:35.940497Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.940509Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 26 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.945141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 26 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.945194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.945219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.945228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.945241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 0, Offset: 26 is stored on disk
2025-11-24T18:37:35.945245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.945248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 1, Offset: 26 is stored on disk
2025-11-24T18:37:35.945254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.945260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 2, Offset: 26 is stored on disk
2025-11-24T18:37:35.945303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.945306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.945308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.945311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.945313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.945324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.945342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.945491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.945624Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.946247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597485:3518] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 26
    Offset: 26
    PartNo: 0
    WriteTimestampMS: 1764009455939
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.947011Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.947348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597490:3524], now have 1 active actors on pipe
2025-11-24T18:37:35.947518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.947526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.947557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|90caeb78-d27b9f74-6afd3457-bf6f4a56_27 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.947566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.947569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.947575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.947579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.947583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.947595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.947598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.947600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.947617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.947629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.947759Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.948180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597490:3524] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|90caeb78-d27b9f74-6afd3457-bf6f4a56_27"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|90caeb78-d27b9f74-6afd3457-bf6f4a56_27"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 27
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.955101Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.956145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597495:3525], now have 1 active actors on pipe
2025-11-24T18:37:35.956941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.956958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.957031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.957073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.957082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.957087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.957108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.957130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.957134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.957144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.957146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.957150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.957154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.957159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.957206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 0
2025-11-24T18:37:35.957219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.957221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 1
2025-11-24T18:37:35.957224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.957227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 2
2025-11-24T18:37:35.957488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 27 partNo 2 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 1048790 count 1 nextOffset 28 batches 3
2025-11-24T18:37:35.957499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.957502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.957506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.957575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 27,1 HeadOffset 27 endOffset 27 curOffset 28 d0000000000_00000000000000000027_00000_0000000001_00002? size 1048780 WTime 1764009455957
2025-11-24T18:37:35.957734Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.957748Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.961093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.961116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.961141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.961150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.961160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 0, Offset: 27 is stored on disk
2025-11-24T18:37:35.961163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.961167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 1, Offset: 27 is stored on disk
2025-11-24T18:37:35.961174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.961178Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 2, Offset: 27 is stored on disk
2025-11-24T18:37:35.961234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.961237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.961239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.961241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.961243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.961255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.961272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.961415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.961497Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.962142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597495:3525] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 27
    Offset: 27
    PartNo: 0
    WriteTimestampMS: 1764009455956
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.963597Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.963990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597500:3531], now have 1 active actors on pipe
2025-11-24T18:37:35.964010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.964016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.964050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|49cb9a2e-71231472-b2d62d18-e3249531_28 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.964062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.964066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.964072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.964074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.964078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.964093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.964098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.964101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.964133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.964147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.964433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597500:3531] destroyed
CallPersQueueGRPC response:
2025-11-24T18:37:35.964244Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|49cb9a2e-71231472-b2d62d18-e3249531_28"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|49cb9a2e-71231472-b2d62d18-e3249531_28"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 28
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.970762Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.971966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597502:3532], now have 1 active actors on pipe
2025-11-24T18:37:35.973035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.973058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.973135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.973220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.973235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.973246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.973271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.973299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.973309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.973319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.973322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.973328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.973330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.973335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.973377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 0
2025-11-24T18:37:35.973396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.973403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 1
2025-11-24T18:37:35.973407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.973410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 2
2025-11-24T18:37:35.973666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 28 partNo 2 FormedBlobsCount 0 NewHead: Offset 28 PartNo 0 PackedSize 1048790 count 1 nextOffset 29 batches 3
2025-11-24T18:37:35.973693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.973696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.973700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.973781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 28,1 HeadOffset 28 endOffset 28 curOffset 29 d0000000000_00000000000000000028_00000_0000000001_00002? size 1048780 WTime 1764009455973
2025-11-24T18:37:35.973933Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.973952Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 0 count 1 size 1048780
2025-11-24T18:37:35.978011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:35.978051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:35.978090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:35.978110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.978125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 0, Offset: 28 is stored on disk
2025-11-24T18:37:35.978129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.978135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 1, Offset: 28 is stored on disk
2025-11-24T18:37:35.978142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:35.978150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 2, Offset: 28 is stored on disk
2025-11-24T18:37:35.978203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.978215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.978233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.978236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:35.978237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.978252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:35.978298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.978432Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:35.978345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:35.978849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597502:3532] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 28
    Offset: 28
    PartNo: 0
    WriteTimestampMS: 1764009455972
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:35.979899Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.980356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597506:3535], now have 1 active actors on pipe
2025-11-24T18:37:35.980386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.980393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.980451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|901f5672-84c25e36-d8dfe0e4-24a3190c_29 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:35.980461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.980465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.980470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:35.980475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.980479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.980491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:35.980494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:35.980497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.980520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:35.980536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:35.980702Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|901f5672-84c25e36-d8dfe0e4-24a3190c_29"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:35.981149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597506:3535] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|901f5672-84c25e36-d8dfe0e4-24a3190c_29"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 29
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:35.989011Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:35.989863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362919964597508:3536], now have 1 active actors on pipe
2025-11-24T18:37:35.992739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:35.992768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:35.992848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:35.992898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:35.992910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:35.992915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:35.992937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:35.992978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:35.992982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.992992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.992997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:35.993000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:35.993002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:35.993006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.993053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 0
2025-11-24T18:37:35.993068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.993070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 1
2025-11-24T18:37:35.993074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:35.993076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 2
2025-11-24T18:37:35.993358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 29 partNo 2 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 1048790 count 1 nextOffset 30 batches 3
2025-11-24T18:37:35.993369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:35.993372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:35.993375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:35.993444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 29,1 HeadOffset 29 endOffset 29 curOffset 30 d0000000000_00000000000000000029_00000_0000000001_00002? size 1048780 WTime 1764009455992
2025-11-24T18:37:35.993595Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:35.993607Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 29 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.000505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 29 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.000543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.000584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.000592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.000606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 0, Offset: 29 is stored on disk
2025-11-24T18:37:36.000612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.000618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 1, Offset: 29 is stored on disk
2025-11-24T18:37:36.000625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.000629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 2, Offset: 29 is stored on disk
2025-11-24T18:37:36.000676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.000679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.000681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.000684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.000687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.000702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.000724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.000916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.001025Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 29
    Offset: 29
    PartNo: 0
    WriteTimestampMS: 1764009455992
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 8
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.001656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362919964597508:3536] destroyed
2025-11-24T18:37:36.002334Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.002752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564808:3539], now have 1 active actors on pipe
2025-11-24T18:37:36.002887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.002897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.002938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a8d92a30-35f4f1cc-7aca168-6cab41c7_30 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.002947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.002951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.002958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.002960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.002965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.002976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.002979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.002982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.002999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.003013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.003630Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a8d92a30-35f4f1cc-7aca168-6cab41c7_30"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|a8d92a30-35f4f1cc-7aca168-6cab41c7_30"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 30
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.006848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564808:3539] destroyed
2025-11-24T18:37:36.011460Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.012096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564810:3540], now have 1 active actors on pipe
2025-11-24T18:37:36.013811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.013834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.013961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.014043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.014056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.014062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.014088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.014112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.014117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.014131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.014134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.014138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.014141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.014147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.014186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 0
2025-11-24T18:37:36.014202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.014205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 1
2025-11-24T18:37:36.014209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.014212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 2
2025-11-24T18:37:36.014920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 30 partNo 2 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1048790 count 1 nextOffset 31 batches 3
2025-11-24T18:37:36.014937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.014941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.014945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.015028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 30,1 HeadOffset 30 endOffset 30 curOffset 31 d0000000000_00000000000000000030_00000_0000000001_00002? size 1048780 WTime 1764009456014
2025-11-24T18:37:36.015399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:36.015408Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.015423Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.021878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.021913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.021959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.021970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.021984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 0, Offset: 30 is stored on disk
2025-11-24T18:37:36.021988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.021992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 1, Offset: 30 is stored on disk
2025-11-24T18:37:36.021998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.022002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 2, Offset: 30 is stored on disk
2025-11-24T18:37:36.022034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.022036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.022037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.022040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.022041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.022052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.022072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.022269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.022417Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 30
    Offset: 30
    PartNo: 0
    WriteTimestampMS: 1764009456014
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.024289Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.024765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564810:3540] destroyed
2025-11-24T18:37:36.024780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564815:3544], now have 1 active actors on pipe
2025-11-24T18:37:36.024790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.024795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.024826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|7d4f2549-ce184d8c-6d130d7a-3506e37f_31 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.024835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.024839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.024843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.024845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.024848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.024857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.024860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.024862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.024879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.024891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.025064Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|7d4f2549-ce184d8c-6d130d7a-3506e37f_31"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:36.026464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564815:3544] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|7d4f2549-ce184d8c-6d130d7a-3506e37f_31"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 31
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.031826Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.032270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564817:3545], now have 1 active actors on pipe
2025-11-24T18:37:36.042288Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 31
    Offset: 31
    PartNo: 0
    WriteTimestampMS: 1764009456034
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
>>>>> 1
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 0
    Count: 16
    ReadTimestampMs: 0
  }
}
2025-11-24T18:37:36.034295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.034313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.034458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.034518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.034530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.034540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.034563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.034591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.034595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.034606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.034608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.034613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.034615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.034620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.034659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 0
2025-11-24T18:37:36.034671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.034674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 1
2025-11-24T18:37:36.034678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.034680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 2
2025-11-24T18:37:36.035296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 31 partNo 2 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 1048790 count 1 nextOffset 32 batches 3
2025-11-24T18:37:36.035311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.035315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.035319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.035399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 31,1 HeadOffset 31 endOffset 31 curOffset 32 d0000000000_00000000000000000031_00000_0000000001_00002? size 1048780 WTime 1764009456035
2025-11-24T18:37:36.035736Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.035751Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 31 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.040525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 31 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.040545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.040575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.040582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.040594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 0, Offset: 31 is stored on disk
2025-11-24T18:37:36.040600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.040605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 1, Offset: 31 is stored on disk
2025-11-24T18:37:36.040613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.040617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 2, Offset: 31 is stored on disk
2025-11-24T18:37:36.040657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.040660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.040662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.040665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.040667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.040681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000024_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.040685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.040688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000026_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.040691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.040694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.040698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000029_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.040701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.040703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000031_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.040708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-11-24T18:37:36.040727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.040738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-11-24T18:37:36.040741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000024_00000_0000000001_00002?
2025-11-24T18:37:36.040748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000001_00002?
2025-11-24T18:37:36.040753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000026_00000_0000000001_00002?
2025-11-24T18:37:36.040760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000001_00002?
2025-11-24T18:37:36.040765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00000_0000000001_00002?
2025-11-24T18:37:36.040775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000029_00000_0000000001_00002?
2025-11-24T18:37:36.040779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000001_00002?
2025-11-24T18:37:36.040784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000031_00000_0000000001_00002?
2025-11-24T18:37:36.040789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-11-24T18:37:36.040798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 24 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:36.040800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:36.040804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 26 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:36.040806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:36.040809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 28 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:36.040811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 29 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.040816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.040818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 31 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.040823Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-11-24T18:37:36.040850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-24T18:37:36.040856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000024_00000_0000000001_00002?
2025-11-24T18:37:36.040858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.040860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000024_00000_0000000001_00002?, parameters.CurOffset=24
2025-11-24T18:37:36.040995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 24.0/3
2025-11-24T18:37:36.041001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 0
2025-11-24T18:37:36.041007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 24:0 appended
2025-11-24T18:37:36.041139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 24.1/3
2025-11-24T18:37:36.041141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 1
2025-11-24T18:37:36.041143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 24:1 appended
2025-11-24T18:37:36.041155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 24.2/3
2025-11-24T18:37:36.041156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 2
2025-11-24T18:37:36.041416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 24 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 1048790 count 1 nextOffset 25 batches 3
2025-11-24T18:37:36.041422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 24:2 appended
2025-11-24T18:37:36.041427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000025_00000_0000000001_00002?
2025-11-24T18:37:36.041429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.041432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000025_00000_0000000001_00002?, parameters.CurOffset=25
2025-11-24T18:37:36.041576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 25.0/3
2025-11-24T18:37:36.041581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 0
2025-11-24T18:37:36.041582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 25:0 appended
2025-11-24T18:37:36.041725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 25.1/3
2025-11-24T18:37:36.041729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 1
2025-11-24T18:37:36.041731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 25:1 appended
2025-11-24T18:37:36.041757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 25.2/3
2025-11-24T18:37:36.041761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 2
2025-11-24T18:37:36.042115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.042126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.042130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.042134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.042137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.042142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.042145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.042148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.042152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.044378Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.045428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 25 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 2097545 count 2 nextOffset 26 batches 5
2025-11-24T18:37:36.045445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 25:2 appended
2025-11-24T18:37:36.045455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000026_00000_0000000001_00002?
2025-11-24T18:37:36.045457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.045462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000026_00000_0000000001_00002?, parameters.CurOffset=26
2025-11-24T18:37:36.045618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 26.0/3
2025-11-24T18:37:36.045633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 0
2025-11-24T18:37:36.045637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 26:0 appended
2025-11-24T18:37:36.046141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 26.1/3
2025-11-24T18:37:36.046147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 1
2025-11-24T18:37:36.046149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 26:1 appended
2025-11-24T18:37:36.046165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 26.2/3
2025-11-24T18:37:36.046168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 2
2025-11-24T18:37:36.046698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 26 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 3146300 count 3 nextOffset 27 batches 7
2025-11-24T18:37:36.046714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 26:2 appended
2025-11-24T18:37:36.046720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000027_00000_0000000001_00002?
2025-11-24T18:37:36.046722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.046726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000027_00000_0000000001_00002?, parameters.CurOffset=27
2025-11-24T18:37:36.046862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 27.0/3
2025-11-24T18:37:36.046874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 0
2025-11-24T18:37:36.046876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 27:0 appended
2025-11-24T18:37:36.047010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 27.1/3
2025-11-24T18:37:36.047012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 1
2025-11-24T18:37:36.047013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 27:1 appended
2025-11-24T18:37:36.047023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 27.2/3
2025-11-24T18:37:36.047025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 2
2025-11-24T18:37:36.047209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 27 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 4195055 count 4 nextOffset 28 batches 9
2025-11-24T18:37:36.047213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 27:2 appended
2025-11-24T18:37:36.047216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000028_00000_0000000001_00002?
2025-11-24T18:37:36.047218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.047221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000028_00000_0000000001_00002?, parameters.CurOffset=28
2025-11-24T18:37:36.047369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 28.0/3
2025-11-24T18:37:36.047372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 0
2025-11-24T18:37:36.047373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 28:0 appended
2025-11-24T18:37:36.047527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 28.1/3
2025-11-24T18:37:36.047532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 1
2025-11-24T18:37:36.047534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 28:1 appended
2025-11-24T18:37:36.047547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 28.2/3
2025-11-24T18:37:36.047549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 2
2025-11-24T18:37:36.047730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 28 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 5243810 count 5 nextOffset 29 batches 11
2025-11-24T18:37:36.047737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 28:2 appended
2025-11-24T18:37:36.047739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000029_00000_0000000001_00002?
2025-11-24T18:37:36.047740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.047742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000029_00000_0000000001_00002?, parameters.CurOffset=29
2025-11-24T18:37:36.047873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 29.0/3
2025-11-24T18:37:36.047876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 0
2025-11-24T18:37:36.047877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 29:0 appended
2025-11-24T18:37:36.048007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 29.1/3
2025-11-24T18:37:36.048009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 1
2025-11-24T18:37:36.048010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 29:1 appended
2025-11-24T18:37:36.048018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 29.2/3
2025-11-24T18:37:36.048020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 2
2025-11-24T18:37:36.048748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 29 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 6292565 count 6 nextOffset 30 batches 13
2025-11-24T18:37:36.048762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 29:2 appended
2025-11-24T18:37:36.048767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000030_00000_0000000001_00002?
2025-11-24T18:37:36.048768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.048771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000030_00000_0000000001_00002?, parameters.CurOffset=30
2025-11-24T18:37:36.048912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 30.0/3
2025-11-24T18:37:36.048924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 0
2025-11-24T18:37:36.048927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 30:0 appended
2025-11-24T18:37:36.049479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 30.1/3
2025-11-24T18:37:36.049490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 1
2025-11-24T18:37:36.049493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 30:1 appended
2025-11-24T18:37:36.049508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 30.2/3
2025-11-24T18:37:36.049510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 2
2025-11-24T18:37:36.051640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 30 partNo 2 result is x0000000000_00000000000000000023_00000_0000000007_00016 size 8365364
2025-11-24T18:37:36.051664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000023_00000_0000000007_00016 new key d0000000000_00000000000000000023_00000_0000000007_00016 size 8365364 WTime 1764009456051
2025-11-24T18:37:36.051693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 30 partNo 2 FormedBlobsCount 1 NewHead: Offset 30 PartNo 2 PackedSize 24736 count 1 nextOffset 31 batches 1
2025-11-24T18:37:36.051698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 30:2 appended
2025-11-24T18:37:36.051702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000031_00000_0000000001_00002?
2025-11-24T18:37:36.051704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.051708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000031_00000_0000000001_00002?, parameters.CurOffset=31
2025-11-24T18:37:36.051843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 31.0/3
2025-11-24T18:37:36.051847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 0
2025-11-24T18:37:36.051849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 31:0 appended
2025-11-24T18:37:36.051991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 31.1/3
2025-11-24T18:37:36.051993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 1
2025-11-24T18:37:36.051995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 31:1 appended
2025-11-24T18:37:36.052006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 31.2/3
2025-11-24T18:37:36.052009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 2
2025-11-24T18:37:36.052202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 31 partNo 2 FormedBlobsCount 0 NewHead: Offset 30 PartNo 2 PackedSize 1073491 count 2 nextOffset 32 batches 3
2025-11-24T18:37:36.052208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 31:2 appended
2025-11-24T18:37:36.052262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 30,2 HeadOffset 23 endOffset 24 curOffset 32 d0000000000_00000000000000000030_00002_0000000002_00002| size 1073481 WTime 1764009456052
2025-11-24T18:37:36.052475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564817:3545] destroyed
2025-11-24T18:37:36.052486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564821:3548], now have 1 active actors on pipe
2025-11-24T18:37:36.052528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.052535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.052558Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.052570Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 7 size 8365364
2025-11-24T18:37:36.052576Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 2 count 2 size 1073481
2025-11-24T18:37:36.052681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 16 size 26214400 endOffset 32 max time lag 0ms effective offset 0
2025-11-24T18:37:36.052893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 3 blobs, size 25145475 count 24 last offset 15, current partition end offset: 32
2025-11-24T18:37:36.052910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-24T18:37:36.052925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 7 parts_count 16 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.052931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 2 count 8 parts_count 15 source 1 size 7878063 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:36.052934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 0 times before, last time 2025-11-24T18:37:35.000000Z
2025-11-24T18:37:36.052947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 1 of 3 from KV
2025-11-24T18:37:36.053317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0'
2025-11-24T18:37:36.053321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-11-24T18:37:36.053328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 7 parts_count 16
2025-11-24T18:37:36.077594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 7 size 8365364 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.077611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 2 size 1073481 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.077626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.077867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.077873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.077875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.077880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.077883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.077917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.077928Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.077936Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000024_00000_0000000001_00002?(+) to d0000000000_00000000000000000024_00000_0000000001_00002?(+)
2025-11-24T18:37:36.077939Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000001_00002?(+) to d0000000000_00000000000000000025_00000_0000000001_00002?(+)
2025-11-24T18:37:36.077942Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000026_00000_0000000001_00002?(+) to d0000000000_00000000000000000026_00000_0000000001_00002?(+)
2025-11-24T18:37:36.077944Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000001_00002?(+) to d0000000000_00000000000000000027_00000_0000000001_00002?(+)
2025-11-24T18:37:36.077946Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00000_0000000001_00002?(+) to d0000000000_00000000000000000028_00000_0000000001_00002?(+)
2025-11-24T18:37:36.077949Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000029_00000_0000000001_00002?(+) to d0000000000_00000000000000000029_00000_0000000001_00002?(+)
2025-11-24T18:37:36.077951Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00000_0000000001_00002?(+) to d0000000000_00000000000000000030_00000_0000000001_00002?(+)
2025-11-24T18:37:36.077954Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000031_00000_0000000001_00002?(+) to d0000000000_00000000000000000031_00000_0000000001_00002?(+)
2025-11-24T18:37:36.077956Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000001_00002|(+) to d0000000000_00000000000000000023_00000_0000000001_00002|(+)
2025-11-24T18:37:36.078315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '124' size 1048780
2025-11-24T18:37:36.078324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2025-11-24T18:37:36.078331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.078345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 2 parts 2 suffix '124' size 1073481
2025-11-24T18:37:36.079174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 23 size 1048780 cause it's been evicted from L2. Actual L1 size: 12
2025-11-24T18:37:36.079181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 24 size 1048780 cause it's been evicted from L2. Actual L1 size: 11
2025-11-24T18:37:36.079187Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-11-24T18:37:36.079280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 25 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.079286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 26 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.079292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 27 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.079296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 28 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.079301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 29 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.079306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 30 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.079310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 31 count 1 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.079329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.079349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.079357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.079359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.079360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.079362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.079363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.079370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.079481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.079488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.079491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.079495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.079499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.079502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.079506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.084088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-11-24T18:37:36.084102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-11-24T18:37:36.084113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 7 size 8365339 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.084167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2025-11-24T18:37:36.084174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365339
2025-11-24T18:37:36.084189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 3 blobs
2025-11-24T18:37:36.084376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.084533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.084769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.084926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.085079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.085247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.085402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.085554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.085718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.085867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.086028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.086178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.086336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.087075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.087125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.087598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-11-24T18:37:36.087649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.087813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.087992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.088364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.088551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.088778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.088986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.089375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.089560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.090165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.090393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.090695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.090886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.091134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.091323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.091348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.091528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.091753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.091781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.091888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 7878063 cause it's been evicted from L2. Actual L1 size: 4
2025-11-24T18:37:36.091898Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-11-24T18:37:36.091969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.118442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.118463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.118467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.118471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.118474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.133685Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:36.162526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564821:3548] destroyed
CallPersQueueGRPC response:
2025-11-24T18:37:36.218026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.218053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.218056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.218060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.218062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 32
    Result {
      Offset: 0
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 2
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 16
    Count: 16
    ReadTimestampMs: 0
  }
}
2025-11-24T18:37:36.282519Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.285785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564876:3574], now have 1 active actors on pipe
2025-11-24T18:37:36.285852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.285861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.285916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 16 partno 0 count 16 size 26214400 endOffset 32 max time lag 0ms effective offset 16
2025-11-24T18:37:36.286238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 2 blobs, size 9438782 count 16 last offset 23, current partition end offset: 32
2025-11-24T18:37:36.286243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-24T18:37:36.286265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 1 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.286270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 7 parts_count 16 source 1 size 8365364 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.286295Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 2 blobs are from cache.
2025-11-24T18:37:36.286343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 2 blobs
2025-11-24T18:37:36.286847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.287093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.287270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.287594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.287760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.288090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.288261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.288467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.288640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.288908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.289078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.289351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.289521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.289683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 22 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.289703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 22 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.289898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.290047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.290061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.290210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.290601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-11-24T18:37:36.290611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0'
2025-11-24T18:37:36.294764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.295001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.295155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.295340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.295505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.295688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.295850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.296034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.296211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.296395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.296565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.296586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.296896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-11-24T18:37:36.297030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.318485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.318500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.318504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.318508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.318511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.340013Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:36.360639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564876:3574] destroyed
CallPersQueueGRPC response:
2025-11-24T18:37:36.422176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.422204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.422207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.422211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.422214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 32
    Result {
      Offset: 16
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.522329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.522348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.522351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.522354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.522377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.523385Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.524505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564881:3578], now have 1 active actors on pipe
2025-11-24T18:37:36.524548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.524556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.524598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5bfc9c7b-bf880d11-8a4f6085-c17f5036_32 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.524616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.524621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.524626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.524629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.524637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.524650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.524653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.524656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.524675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.524691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.524771Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:36.525581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564881:3578] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5bfc9c7b-bf880d11-8a4f6085-c17f5036_32"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|5bfc9c7b-bf880d11-8a4f6085-c17f5036_32"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 32
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.533953Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.534386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564888:3582], now have 1 active actors on pipe
2025-11-24T18:37:36.536117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.536139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.536231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.536293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.536305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.536311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.536334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.536360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.536364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.536374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.536379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.536385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.536387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.536394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.536427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 0
2025-11-24T18:37:36.536440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.536443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 1
2025-11-24T18:37:36.536447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.536450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 2
2025-11-24T18:37:36.536699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 32 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 1048790 count 1 nextOffset 33 batches 3
2025-11-24T18:37:36.536712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.536715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.536719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.536801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 32,1 HeadOffset 32 endOffset 32 curOffset 33 d0000000000_00000000000000000032_00000_0000000001_00002? size 1048780 WTime 1764009456536
2025-11-24T18:37:36.536992Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.537007Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.557694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.557734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.557771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.557780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.557798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 0, Offset: 32 is stored on disk
2025-11-24T18:37:36.557803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.557811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 1, Offset: 32 is stored on disk
2025-11-24T18:37:36.557818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.557824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 2, Offset: 32 is stored on disk
2025-11-24T18:37:36.557875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.557879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.557881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.557885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.557888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.557901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.557922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.558055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.558566Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:36.559487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564888:3582] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 32
    Offset: 32
    PartNo: 0
    WriteTimestampMS: 1764009456536
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 18
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.561783Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.562542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564896:3586], now have 1 active actors on pipe
2025-11-24T18:37:36.562568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.562577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.562618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|7742b8cb-f200f0eb-69d2ea7a-89af4972_33 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.562631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.562636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.562643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.562648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.562653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.562667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.562670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.562675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.562698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.562718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.562947Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:36.563664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564896:3586] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|7742b8cb-f200f0eb-69d2ea7a-89af4972_33"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|7742b8cb-f200f0eb-69d2ea7a-89af4972_33"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 33
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.590156Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.590678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564898:3587], now have 1 active actors on pipe
2025-11-24T18:37:36.592071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.592095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.592183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.592232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.592245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.592251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.592274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.592301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.592306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.592319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.592324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.592329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.592331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.592338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.592389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 0
2025-11-24T18:37:36.592405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.592408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 1
2025-11-24T18:37:36.592412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.592414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 2
2025-11-24T18:37:36.592689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 33 partNo 2 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 1048790 count 1 nextOffset 34 batches 3
2025-11-24T18:37:36.592702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.592705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.592709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.592789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 33,1 HeadOffset 33 endOffset 33 curOffset 34 d0000000000_00000000000000000033_00000_0000000001_00002? size 1048780 WTime 1764009456592
2025-11-24T18:37:36.592978Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.592993Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.603974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 33 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.604014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.604048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.604058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.604072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 0, Offset: 33 is stored on disk
2025-11-24T18:37:36.604079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.604085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 1, Offset: 33 is stored on disk
2025-11-24T18:37:36.604092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.604097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 2, Offset: 33 is stored on disk
2025-11-24T18:37:36.604163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.604167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.604168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.604172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.604175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.604190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.604221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.604498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.604960Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 33
    Offset: 33
    PartNo: 0
    WriteTimestampMS: 1764009456591
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.607057Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.607386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564898:3587] destroyed
2025-11-24T18:37:36.607407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564902:3590], now have 1 active actors on pipe
2025-11-24T18:37:36.607511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.607527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.607589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8086a3b0-cfeccc8-b6e66b07-bcf1f011_34 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.607606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.607610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.607617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.607619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.607624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.607638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.607641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.607645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.607667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.607688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.607837Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8086a3b0-cfeccc8-b6e66b07-bcf1f011_34"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|8086a3b0-cfeccc8-b6e66b07-bcf1f011_34"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 34
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.616491Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.618044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564902:3590] destroyed
2025-11-24T18:37:36.618067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564905:3592], now have 1 active actors on pipe
2025-11-24T18:37:36.618425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.618438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.618527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.618583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.618597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.618603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.618631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.618654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.618659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.618693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.618696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.618700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.618702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.618710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.618750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 0
2025-11-24T18:37:36.618764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.618768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 1
2025-11-24T18:37:36.618771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.618774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 2
2025-11-24T18:37:36.619039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 34 partNo 2 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 1048790 count 1 nextOffset 35 batches 3
2025-11-24T18:37:36.619051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.619054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.619058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.619136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 34,1 HeadOffset 34 endOffset 34 curOffset 35 d0000000000_00000000000000000034_00000_0000000001_00002? size 1048780 WTime 1764009456615
2025-11-24T18:37:36.619359Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.619373Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 34 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.623307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:36.639563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 34 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.639607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.639644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.639658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.639673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 0, Offset: 34 is stored on disk
2025-11-24T18:37:36.639677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.639683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 1, Offset: 34 is stored on disk
2025-11-24T18:37:36.639692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.639696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 2, Offset: 34 is stored on disk
2025-11-24T18:37:36.639755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.639759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.639762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.639766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.639769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.639785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.639808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.641141Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:36.640127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.641873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564905:3592] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 34
    Offset: 34
    PartNo: 0
    WriteTimestampMS: 1764009456615
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.642976Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.647909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564910:3596], now have 1 active actors on pipe
2025-11-24T18:37:36.647991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.648002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.648074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|aef0084e-f33af1e4-9a8a5ce8-1b0840f_35 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.648093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.648098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.648105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.648107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.648122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.648138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.648141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.648146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.648172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.648208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.648766Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|aef0084e-f33af1e4-9a8a5ce8-1b0840f_35"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:36.649645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564910:3596] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|aef0084e-f33af1e4-9a8a5ce8-1b0840f_35"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 35
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.657887Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.679172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564912:3597], now have 1 active actors on pipe
2025-11-24T18:37:36.680836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.680866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.680944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.680998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.681010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.681016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.681042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.681070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.681075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.681088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.681090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.681095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.681097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.681104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.681143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 0
2025-11-24T18:37:36.681158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.681162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 1
2025-11-24T18:37:36.681165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.681168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 2
2025-11-24T18:37:36.681418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 35 partNo 2 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 1048790 count 1 nextOffset 36 batches 3
2025-11-24T18:37:36.681431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.681435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.681438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.681533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 35,1 HeadOffset 35 endOffset 35 curOffset 36 d0000000000_00000000000000000035_00000_0000000001_00002? size 1048780 WTime 1764009456678
2025-11-24T18:37:36.681718Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.681732Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.689631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.689661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.689693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.689700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.689714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 0, Offset: 35 is stored on disk
2025-11-24T18:37:36.689718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.689724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 1, Offset: 35 is stored on disk
2025-11-24T18:37:36.689731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.689736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 2, Offset: 35 is stored on disk
2025-11-24T18:37:36.689783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.689787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.689790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.689793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.689795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.689809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.689829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.689890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.690066Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 35
    Offset: 35
    PartNo: 0
    WriteTimestampMS: 1764009456678
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.691617Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.692097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564912:3597] destroyed
2025-11-24T18:37:36.692120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564916:3600], now have 1 active actors on pipe
2025-11-24T18:37:36.692133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.692140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.692177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6df333ab-e8a6d779-c9282ca3-7b6c007_36 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.692189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.692192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.692198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.692200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.692215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.692233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.692241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.692245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.692264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.692281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.692435Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6df333ab-e8a6d779-c9282ca3-7b6c007_36"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|6df333ab-e8a6d779-c9282ca3-7b6c007_36"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 36
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.699725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564916:3600] destroyed
2025-11-24T18:37:36.701138Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.701835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564919:3601], now have 1 active actors on pipe
2025-11-24T18:37:36.703087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.703110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.703196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.703243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.703254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.703260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.703283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.703308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.703312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.703322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.703326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.703330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.703332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.703338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.703370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 0
2025-11-24T18:37:36.703384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.703387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 1
2025-11-24T18:37:36.703390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.703393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 2
2025-11-24T18:37:36.703659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 36 partNo 2 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 1048790 count 1 nextOffset 37 batches 3
2025-11-24T18:37:36.703671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.703675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.703678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.703762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 36,1 HeadOffset 36 endOffset 36 curOffset 37 d0000000000_00000000000000000036_00000_0000000001_00002? size 1048780 WTime 1764009456703
2025-11-24T18:37:36.703947Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.703963Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.712609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.712646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.712680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.712692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.712709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 0, Offset: 36 is stored on disk
2025-11-24T18:37:36.712716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.712723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 1, Offset: 36 is stored on disk
2025-11-24T18:37:36.712732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.712738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 2, Offset: 36 is stored on disk
2025-11-24T18:37:36.712790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.712795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.712797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.712801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.712804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.712820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.712845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.713077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.713225Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 36
    Offset: 36
    PartNo: 0
    WriteTimestampMS: 1764009456703
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 9
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.714933Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.715495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564919:3601] destroyed
2025-11-24T18:37:36.715512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564923:3605], now have 1 active actors on pipe
2025-11-24T18:37:36.715527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.715536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.715571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|86038714-b4620a29-934b8864-6f69e31e_37 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.715583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.715587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.715593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.715595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.715600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.715612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.715615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.715620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.715639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.715657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.715820Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|86038714-b4620a29-934b8864-6f69e31e_37"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:36.716882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564923:3605] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|86038714-b4620a29-934b8864-6f69e31e_37"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 37
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.723637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.723664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.723667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.723671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.723676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.726886Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.731568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564926:3607], now have 1 active actors on pipe
2025-11-24T18:37:36.733366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.733395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.733490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.733543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.733556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.733561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.733586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.733611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.733616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.733628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.733631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.733636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.733638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.733644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.733682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 0
2025-11-24T18:37:36.733697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.733700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 1
2025-11-24T18:37:36.733705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.733708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 2
2025-11-24T18:37:36.733975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 37 partNo 2 FormedBlobsCount 0 NewHead: Offset 37 PartNo 0 PackedSize 1048790 count 1 nextOffset 38 batches 3
2025-11-24T18:37:36.733987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.733991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.733995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.734077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 37,1 HeadOffset 37 endOffset 37 curOffset 38 d0000000000_00000000000000000037_00000_0000000001_00002? size 1048780 WTime 1764009456733
2025-11-24T18:37:36.734257Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.734271Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 37 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.739926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 37 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.739955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.739985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.739993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.740007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 0, Offset: 37 is stored on disk
2025-11-24T18:37:36.740010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.740015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 1, Offset: 37 is stored on disk
2025-11-24T18:37:36.740024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.740029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 2, Offset: 37 is stored on disk
2025-11-24T18:37:36.740087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.740092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.740095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.740099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.740101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.740113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.740132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.740281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.740388Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 37
    Offset: 37
    PartNo: 0
    WriteTimestampMS: 1764009456733
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 2
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.741960Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.742512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564926:3607] destroyed
2025-11-24T18:37:36.742531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564930:3610], now have 1 active actors on pipe
2025-11-24T18:37:36.742542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.742550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.742583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|30ae2351-5623741c-d0718d47-8af11a92_38 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.742592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.742596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.742602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.742604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.742608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.742620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.742623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.742626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.742645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.742662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.742820Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|30ae2351-5623741c-d0718d47-8af11a92_38"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|30ae2351-5623741c-d0718d47-8af11a92_38"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 38
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.746826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564930:3610] destroyed
2025-11-24T18:37:36.756942Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.766191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564932:3611], now have 1 active actors on pipe
2025-11-24T18:37:36.768678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.768706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.768810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.768861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.768873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.768879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.768904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.768929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.768933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.768944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.768947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.768951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.768954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.768960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.768997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 0
2025-11-24T18:37:36.770766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.770793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 1
2025-11-24T18:37:36.770801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.770805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 2
2025-11-24T18:37:36.771094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 38 partNo 2 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 1048790 count 1 nextOffset 39 batches 3
2025-11-24T18:37:36.771118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.771121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.771126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.771219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 38,1 HeadOffset 38 endOffset 38 curOffset 39 d0000000000_00000000000000000038_00000_0000000001_00002? size 1048780 WTime 1764009456771
2025-11-24T18:37:36.771420Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.771434Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.783193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 38 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.783226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.783260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.783267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.783280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 0, Offset: 38 is stored on disk
2025-11-24T18:37:36.783285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.783291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 1, Offset: 38 is stored on disk
2025-11-24T18:37:36.783298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.783304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 2, Offset: 38 is stored on disk
2025-11-24T18:37:36.783361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.783367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.783370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.783374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.783377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.783391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.783413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.783663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 38
    Offset: 38
    PartNo: 0
    WriteTimestampMS: 1764009456767
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 3
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:36.783934Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-24T18:37:36.784629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564932:3611] destroyed
2025-11-24T18:37:36.785388Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.786048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564943:3617], now have 1 active actors on pipe
2025-11-24T18:37:36.786177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.786189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.786224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cfd6b597-c4474856-7e119d90-f2c68aad_39 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-24T18:37:36.786235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.786240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.786246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-24T18:37:36.786248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.786253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.786266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-24T18:37:36.786269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-24T18:37:36.786272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.786292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-24T18:37:36.786309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.789143Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cfd6b597-c4474856-7e119d90-f2c68aad_39"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:5467
2025-11-24T18:37:36.790091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564943:3617] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|cfd6b597-c4474856-7e119d90-f2c68aad_39"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 39
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:36.802340Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.803293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564951:3620], now have 1 active actors on pipe
2025-11-24T18:37:36.806986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.807015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.807099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 0 messageNo: 0 size: 511959
2025-11-24T18:37:36.807151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 1 messageNo: 0 size: 511959
2025-11-24T18:37:36.807165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 2 messageNo: 0 size: 24658
2025-11-24T18:37:36.807171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-24T18:37:36.807193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-24T18:37:36.807217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.807222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.811315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.811334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2383: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-24T18:37:36.811343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-24T18:37:36.811347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.811353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.811396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 0
2025-11-24T18:37:36.811414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.811418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 1
2025-11-24T18:37:36.811423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2447: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-24T18:37:36.811427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 2
2025-11-24T18:37:36.811738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 39 partNo 2 FormedBlobsCount 0 NewHead: Offset 39 PartNo 0 PackedSize 1048790 count 1 nextOffset 40 batches 3
2025-11-24T18:37:36.811752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-24T18:37:36.811755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-24T18:37:36.811760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.811850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 39,1 HeadOffset 39 endOffset 39 curOffset 40 d0000000000_00000000000000000039_00000_0000000001_00002? size 1048780 WTime 1764009456811
2025-11-24T18:37:36.812035Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.812054Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 0 count 1 size 1048780
2025-11-24T18:37:36.816901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 39 count 1 size 1048780 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.816931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.816963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.816971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.816984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 0, Offset: 39 is stored on disk
2025-11-24T18:37:36.816989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.816993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 1, Offset: 39 is stored on disk
2025-11-24T18:37:36.817004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-24T18:37:36.817008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 2, Offset: 39 is stored on disk
2025-11-24T18:37:36.817051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.817055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.817057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.817061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.817064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.817077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.817081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.817084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.817087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.817090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.817093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000037_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.817097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.817099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00002? (1048780)
2025-11-24T18:37:36.817102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-11-24T18:37:36.817124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.817139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-11-24T18:37:36.817142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000001_00002?
2025-11-24T18:37:36.817153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000001_00002?
2025-11-24T18:37:36.817163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00000_0000000001_00002?
2025-11-24T18:37:36.817176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00002?
2025-11-24T18:37:36.817202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000001_00002?
2025-11-24T18:37:36.817220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000037_00000_0000000001_00002?
2025-11-24T18:37:36.817232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00000_0000000001_00002?
2025-11-24T18:37:36.817240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00002?
2025-11-24T18:37:36.817250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-11-24T18:37:36.817262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 32 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.817267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 33 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.817270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 34 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.817274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 35 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.817278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 36 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.817282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 37 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.817285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 38 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.817289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 39 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.817298Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-11-24T18:37:36.817327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-24T18:37:36.817337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000032_00000_0000000001_00002?
2025-11-24T18:37:36.817339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.817344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000032_00000_0000000001_00002?, parameters.CurOffset=32
2025-11-24T18:37:36.817484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 32.0/3
2025-11-24T18:37:36.817494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 0
2025-11-24T18:37:36.817501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 32:0 appended
2025-11-24T18:37:36.817668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 32.1/3
2025-11-24T18:37:36.817672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 1
2025-11-24T18:37:36.817675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 32:1 appended
2025-11-24T18:37:36.817694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 32.2/3
2025-11-24T18:37:36.817698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 2
2025-11-24T18:37:36.817926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 32 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 1048790 count 1 nextOffset 33 batches 3
2025-11-24T18:37:36.817932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 32:2 appended
2025-11-24T18:37:36.817938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000033_00000_0000000001_00002?
2025-11-24T18:37:36.817940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.817943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000033_00000_0000000001_00002?, parameters.CurOffset=33
2025-11-24T18:37:36.818092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 33.0/3
2025-11-24T18:37:36.818098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 0
2025-11-24T18:37:36.818101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 33:0 appended
2025-11-24T18:37:36.818240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 33.1/3
2025-11-24T18:37:36.818245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 1
2025-11-24T18:37:36.818248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 33:1 appended
2025-11-24T18:37:36.818264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 33.2/3
2025-11-24T18:37:36.818267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 2
2025-11-24T18:37:36.818506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 33 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 2097545 count 2 nextOffset 34 batches 5
2025-11-24T18:37:36.818514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 33:2 appended
2025-11-24T18:37:36.818519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000034_00000_0000000001_00002?
2025-11-24T18:37:36.818521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.818524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000034_00000_0000000001_00002?, parameters.CurOffset=34
2025-11-24T18:37:36.818661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 34.0/3
2025-11-24T18:37:36.818666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 0
2025-11-24T18:37:36.818671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 34:0 appended
2025-11-24T18:37:36.818809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 34.1/3
2025-11-24T18:37:36.818813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 1
2025-11-24T18:37:36.818815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 34:1 appended
2025-11-24T18:37:36.818830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 34.2/3
2025-11-24T18:37:36.818833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 2
2025-11-24T18:37:36.819019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 34 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 3146300 count 3 nextOffset 35 batches 7
2025-11-24T18:37:36.819023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 34:2 appended
2025-11-24T18:37:36.819028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000035_00000_0000000001_00002?
2025-11-24T18:37:36.819030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.819034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000035_00000_0000000001_00002?, parameters.CurOffset=35
2025-11-24T18:37:36.819181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 35.0/3
2025-11-24T18:37:36.819187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 0
2025-11-24T18:37:36.819189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 35:0 appended
2025-11-24T18:37:36.819329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 35.1/3
2025-11-24T18:37:36.819334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 1
2025-11-24T18:37:36.819336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 35:1 appended
2025-11-24T18:37:36.819350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 35.2/3
2025-11-24T18:37:36.819353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 2
2025-11-24T18:37:36.820014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 35 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 4195055 count 4 nextOffset 36 batches 9
2025-11-24T18:37:36.820022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 35:2 appended
2025-11-24T18:37:36.820028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000036_00000_0000000001_00002?
2025-11-24T18:37:36.820030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.820034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000036_00000_0000000001_00002?, parameters.CurOffset=36
2025-11-24T18:37:36.820170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 36.0/3
2025-11-24T18:37:36.820176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 0
2025-11-24T18:37:36.820179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 36:0 appended
2025-11-24T18:37:36.820309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 36.1/3
2025-11-24T18:37:36.820313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 1
2025-11-24T18:37:36.820315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 36:1 appended
2025-11-24T18:37:36.820324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 36.2/3
2025-11-24T18:37:36.820327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 2
2025-11-24T18:37:36.821013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 36 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 5243810 count 5 nextOffset 37 batches 11
2025-11-24T18:37:36.821020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 36:2 appended
2025-11-24T18:37:36.821025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000037_00000_0000000001_00002?
2025-11-24T18:37:36.821026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.821034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000037_00000_0000000001_00002?, parameters.CurOffset=37
2025-11-24T18:37:36.821163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 37.0/3
2025-11-24T18:37:36.821168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 0
2025-11-24T18:37:36.821171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 37:0 appended
2025-11-24T18:37:36.821324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 37.1/3
2025-11-24T18:37:36.821328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 1
2025-11-24T18:37:36.821332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 37:1 appended
2025-11-24T18:37:36.821343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 37.2/3
2025-11-24T18:37:36.821347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 2
2025-11-24T18:37:36.821530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 37 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 6292565 count 6 nextOffset 38 batches 13
2025-11-24T18:37:36.821536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 37:2 appended
2025-11-24T18:37:36.821540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000038_00000_0000000001_00002?
2025-11-24T18:37:36.821542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.821545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000038_00000_0000000001_00002?, parameters.CurOffset=38
2025-11-24T18:37:36.821677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 38.0/3
2025-11-24T18:37:36.821682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 0
2025-11-24T18:37:36.821685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 38:0 appended
2025-11-24T18:37:36.821815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 38.1/3
2025-11-24T18:37:36.821819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 1
2025-11-24T18:37:36.823279Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:36.823073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 2 parts 2 suffix '124' size 1073481
2025-11-24T18:37:36.823088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.823107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.823110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.823113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.823120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.823124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.823128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.823132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63'
2025-11-24T18:37:36.823135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63'
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 39
    Offset: 39
    PartNo: 0
    WriteTimestampMS: 1764009456811
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 4
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
>>>>> 3
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 0
    Count: 16
    ReadTimestampMs: 0
  }
}
2025-11-24T18:37:36.828559Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:36.834773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 38 partNo 1 result is x0000000000_00000000000000000030_00002_0000000008_00015 size 7878063
2025-11-24T18:37:36.834796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 38:1 appended
2025-11-24T18:37:36.834829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 38.2/3
2025-11-24T18:37:36.834837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 2
2025-11-24T18:37:36.834856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000030_00002_0000000008_00015 new key d0000000000_00000000000000000030_00002_0000000008_00015 size 7878063 WTime 1764009456832
2025-11-24T18:37:36.835007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 38 partNo 2 FormedBlobsCount 1 NewHead: Offset 38 PartNo 1 PackedSize 536763 count 1 nextOffset 39 batches 2
2025-11-24T18:37:36.835015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 38:2 appended
2025-11-24T18:37:36.835023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000039_00000_0000000001_00002?
2025-11-24T18:37:36.835031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-24T18:37:36.835037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000039_00000_0000000001_00002?, parameters.CurOffset=39
2025-11-24T18:37:36.835172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 39.0/3
2025-11-24T18:37:36.835179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 0
2025-11-24T18:37:36.835182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 39:0 appended
2025-11-24T18:37:36.835319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 39.1/3
2025-11-24T18:37:36.835324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 1
2025-11-24T18:37:36.835326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 39:1 appended
2025-11-24T18:37:36.835341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 39.2/3
2025-11-24T18:37:36.835345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 2
2025-11-24T18:37:36.835570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 39 partNo 2 FormedBlobsCount 0 NewHead: Offset 38 PartNo 1 PackedSize 1585518 count 2 nextOffset 40 batches 4
2025-11-24T18:37:36.835576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 39:2 appended
2025-11-24T18:37:36.835640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 38,2 HeadOffset 30 endOffset 32 curOffset 40 d0000000000_00000000000000000038_00001_0000000002_00003| size 1585508 WTime 1764009456832
2025-11-24T18:37:36.836102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 1073481 cause it's been evicted from L2. Actual L1 size: 11
2025-11-24T18:37:36.836109Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-11-24T18:37:36.836130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564951:3620] destroyed
2025-11-24T18:37:36.836146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.836149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.836152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.836158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.836161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.836182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362924259564958:3623], now have 1 active actors on pipe
2025-11-24T18:37:36.836221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:36.836229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:36.836250Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.836263Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 2 count 8 size 7878063
2025-11-24T18:37:36.836272Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 1 count 2 size 1585508
2025-11-24T18:37:36.836380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 16 size 26214400 endOffset 40 max time lag 0ms effective offset 0
2025-11-24T18:37:36.836436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 3 blobs, size 24121465 count 23 last offset 15, current partition end offset: 40
2025-11-24T18:37:36.836439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-24T18:37:36.836455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 7 parts_count 16 source 0 size 8365339 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.836459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 2 count 8 parts_count 15 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.836463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 2 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:36.836478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 6. Have to read 1 of 3 from KV
2025-11-24T18:37:36.837173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0'
2025-11-24T18:37:36.837203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-11-24T18:37:36.837211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 2 count 8 parts_count 15
2025-11-24T18:37:36.911557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-11-24T18:37:36.911576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-11-24T18:37:36.911591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 8 size 7878063 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.911823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 3 blobs
2025-11-24T18:37:36.911851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2025-11-24T18:37:36.911867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2025-11-24T18:37:36.912055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.912200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.912378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.912529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.912695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.912821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.913000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.913125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.913299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.913433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.913591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.913719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.913868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.914012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.914032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.914292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-11-24T18:37:36.914329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.915793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.915971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.916135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.916282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.917650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.917794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.917948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.918099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.918251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.918418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.919845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.920432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.920613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:36.920767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.920788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.920909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.921114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:36.921134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:36.921256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 23 size 8365364 cause it's been evicted from L2. Actual L1 size: 11
2025-11-24T18:37:36.921264Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-11-24T18:37:36.921412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:36.921452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 8 size 7878063 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.921459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 38 count 2 size 1585508 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:36.924769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.924784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.924791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.924798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.924803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.924808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.924813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.924827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0' size 7878063
2025-11-24T18:37:36.924835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-24T18:37:36.924840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365339
2025-11-24T18:37:36.924844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 1 count 2 parts 3 suffix '124' size 1585508
2025-11-24T18:37:36.927986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.928274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.928281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.928284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.928287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.928290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.928331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.928350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 38 size 1048780 cause it's been evicted from L2. Actual L1 size: 12
2025-11-24T18:37:36.928355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 34 size 1048780 cause it's been evicted from L2. Actual L1 size: 11
2025-11-24T18:37:36.928359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 35 size 1048780 cause it's been evicted from L2. Actual L1 size: 10
2025-11-24T18:37:36.928366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8365339 cause it's been evicted from L2. Actual L1 size: 9
2025-11-24T18:37:36.928369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 1048780 cause it's been evicted from L2. Actual L1 size: 8
2025-11-24T18:37:36.928372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 37 size 1048780 cause it's been evicted from L2. Actual L1 size: 7
2025-11-24T18:37:36.928374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 39 size 1048780 cause it's been evicted from L2. Actual L1 size: 6
2025-11-24T18:37:36.928377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 36 size 1048780 cause it's been evicted from L2. Actual L1 size: 5
2025-11-24T18:37:36.928379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 33 size 1048780 cause it's been evicted from L2. Actual L1 size: 4
2025-11-24T18:37:36.928384Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-11-24T18:37:36.928404Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-24T18:37:36.928415Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00000_0000000001_00002?(+) to d0000000000_00000000000000000032_00000_0000000001_00002?(+)
2025-11-24T18:37:36.928418Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000033_00000_0000000001_00002?(+) to d0000000000_00000000000000000033_00000_0000000001_00002?(+)
2025-11-24T18:37:36.928420Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000034_00000_0000000001_00002?(+) to d0000000000_00000000000000000034_00000_0000000001_00002?(+)
2025-11-24T18:37:36.928423Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000035_00000_0000000001_00002?(+) to d0000000000_00000000000000000035_00000_0000000001_00002?(+)
2025-11-24T18:37:36.928425Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000036_00000_0000000001_00002?(+) to d0000000000_00000000000000000036_00000_0000000001_00002?(+)
2025-11-24T18:37:36.928427Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000037_00000_0000000001_00002?(+) to d0000000000_00000000000000000037_00000_0000000001_00002?(+)
2025-11-24T18:37:36.928429Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000038_00000_0000000001_00002?(+) to d0000000000_00000000000000000038_00000_0000000001_00002?(+)
2025-11-24T18:37:36.928431Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000039_00000_0000000001_00002?(+) to d0000000000_00000000000000000039_00000_0000000001_00002?(+)
2025-11-24T18:37:36.928434Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00002_0000000002_00002|(+) to d0000000000_00000000000000000030_00002_0000000002_00002|(+)
2025-11-24T18:37:36.940530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-24T18:37:36.945643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2113: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-24T18:37:36.945676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-24T18:37:36.945689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:36.945693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.945696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:36.945699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:36.945702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:36.945713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-24T18:37:36.985146Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:37.016912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362924259564958:3623] destroyed
CallPersQueueGRPC response:
2025-11-24T18:37:37.040675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.040700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.040703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.040707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.040710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 0
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 4
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 16
    Count: 16
    ReadTimestampMs: 0
  }
}
2025-11-24T18:37:37.082839Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:37.083380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362928554532271:3638], now have 1 active actors on pipe
2025-11-24T18:37:37.083965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:37.083989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:37.084039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 16 partno 0 count 16 size 26214400 endOffset 40 max time lag 0ms effective offset 16
2025-11-24T18:37:37.084305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 3 blobs, size 16755432 count 23 last offset 30, current partition end offset: 40
2025-11-24T18:37:37.084309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-24T18:37:37.084326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 3 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:37.084331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 23 partno 0 count 7 parts_count 16 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:37.084335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 2 count 8 parts_count 15 source 1 size 7878063 accessed 0 times before, last time 2025-11-24T18:37:36.000000Z
2025-11-24T18:37:37.084355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 7. Have to read 1 of 3 from KV
2025-11-24T18:37:37.084719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-11-24T18:37:37.084730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0'
2025-11-24T18:37:37.084738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 23 partno 0 count 7 parts_count 16
2025-11-24T18:37:37.103739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-11-24T18:37:37.103760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-11-24T18:37:37.103776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 23 count 7 size 8365364 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:37.103858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 3 blobs
2025-11-24T18:37:37.104352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.104509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.104700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.104872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.105047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.105228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.105393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.105539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.105703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.105866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.106029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.106184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.106350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.106689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2025-11-24T18:37:37.106702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2025-11-24T18:37:37.109966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 22 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.110013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 22 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:37.110317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.110471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.110491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:37.110621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.110759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.110909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.111048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.111200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.111344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.111500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.111953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.112137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.112621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.112780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.112916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.112938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:37.127992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-11-24T18:37:37.128238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.128375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 31 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.128393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 31 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:37.128544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 7878063 cause it's been evicted from L2. Actual L1 size: 4
2025-11-24T18:37:37.128553Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-11-24T18:37:37.128619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:37.140803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.140818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.140820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.140824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.140826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:37.150533Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:37.162868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362928554532271:3638] destroyed
CallPersQueueGRPC response:
2025-11-24T18:37:37.246920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.246944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.246946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.246950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.246953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 16
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 5
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 9
    Count: 12
    ReadTimestampMs: 0
  }
}
2025-11-24T18:37:37.251357Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:37.255717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362928554532291:3651], now have 1 active actors on pipe
2025-11-24T18:37:37.256010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:37.256022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:37.256067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 partno 0 count 12 size 26214400 endOffset 40 max time lag 0ms effective offset 9
2025-11-24T18:37:37.256109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 2 blobs, size 7878063 count 14 last offset 15, current partition end offset: 40
2025-11-24T18:37:37.256113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-11-24T18:37:37.256125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 2 count 8 parts_count 15 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:37.256132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 4 times before, last time 2025-11-24T18:37:37.000000Z
2025-11-24T18:37:37.256147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 8. Have to read 1 of 2 from KV
2025-11-24T18:37:37.256300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-11-24T18:37:37.256311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 2 count 8 parts_count 15
2025-11-24T18:37:37.274771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-11-24T18:37:37.274792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-11-24T18:37:37.274804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 8 size 7878063 actorID [2:7576362915023660416:2372]
2025-11-24T18:37:37.274871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 2 blobs
2025-11-24T18:37:37.275373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 1 cbcount 2
2025-11-24T18:37:37.275520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.275680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.275827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.275992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.276131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.276270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.276411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.276554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.276685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.276834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.276974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.276999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:37.277137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.277354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.277373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:37.277520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.277680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.277850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.277992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.278616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 1 count 2 parts 3 suffix '124' size 1585508
2025-11-24T18:37:37.278628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2025-11-24T18:37:37.278841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.294764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.294954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.295097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.295259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.295424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.295577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.295655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 38 size 1585508 cause it's been evicted from L2. Actual L1 size: 4
2025-11-24T18:37:37.295661Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-11-24T18:37:37.295710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:37.317413Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:37.327544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362928554532291:3651] destroyed
CallPersQueueGRPC response:
2025-11-24T18:37:37.345645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.345667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.345669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.345673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.345677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 9
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 6
CallPersQueueGRPC request to localhost:5467
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 25
    Count: 10
    ReadTimestampMs: 0
  }
}
2025-11-24T18:37:37.384133Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-24T18:37:37.384720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [1:7576362928554532325:3663], now have 1 active actors on pipe
2025-11-24T18:37:37.384893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-24T18:37:37.384909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-24T18:37:37.384970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 25 partno 0 count 10 size 26214400 endOffset 40 max time lag 0ms effective offset 25
2025-11-24T18:37:37.385252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 2 blobs, size 8390068 count 14 last offset 30, current partition end offset: 40
2025-11-24T18:37:37.385265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-11-24T18:37:37.385284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 7 parts_count 16 source 0 size 8365364 accessed 0 times before, last time 2025-11-24T18:37:37.000000Z
2025-11-24T18:37:37.385294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 2 count 8 parts_count 15 source 1 size 7878063 accessed 1 times before, last time 2025-11-24T18:37:37.000000Z
2025-11-24T18:37:37.385307Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 2 blobs are from cache.
2025-11-24T18:37:37.385350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 2 blobs
2025-11-24T18:37:37.385994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 1 cbcount 2
2025-11-24T18:37:37.386119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.386249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.386387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.386515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.386524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0'
2025-11-24T18:37:37.386530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0'
2025-11-24T18:37:37.386625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.386754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.386865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.386986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.387109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.387124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:37.387352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-11-24T18:37:37.387526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.387666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 31 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.387684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 31 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-11-24T18:37:37.387813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 32 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.387954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 32 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.388120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 32 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.388269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 33 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.388420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 33 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.388556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 34 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-11-24T18:37:37.388700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 34 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-11-24T18:37:37.388808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-24T18:37:37.405387Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-24T18:37:37.418438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [1:7576362928554532325:3663] destroyed
CallPersQueueGRPC response:
2025-11-24T18:37:37.446451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.446471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.446474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.446479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.446481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 25
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-24T18:37:37.551168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.551186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.551189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.551193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.551197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:37.650848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.650870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.650884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.650893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.650896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:37.751238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.751261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.751264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.751268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.751271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-24T18:37:37.851995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-24T18:37:37.852016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.852019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-24T18:37:37.852022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2348: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-24T18:37:37.852025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2307: [72075186224037892][Partition][0][StateIdle] Try persist
[[bad]]assertion failed at ydb/services/persqueue_v1/persqueue_ut.cpp:3295, virtual void NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCache::Execute_(NUnitTest::TTestContext &): (info9.BlobsFromDisk == 0) failed: (1 != 0) [[rst]]
[[alt1]]TBackTrace::Capture()+28 (0x1511D16C)
NUnitTest::NPrivate::RaiseError(char const*, TBasicString<char, std::__y1::char_traits<char>> const&, bool)+128 (0x152D8F00)
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCache::Execute_(NUnitTest::TTestContext&)+13647 (0x14E4B4CF)
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()::'lambda'()::operator()() const+71 (0x14F33707)
NUnitTest::TTestBase::Run(std::__y1::function<void ()>, TBasicString<char, std::__y1::char_traits<char>> const&, char const*, bool)+120 (0x152DB0D8)
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()+436 (0x14F33004)
NUnitTest::TTestFactory::Execute()+817 (0x152DB821)
NUnitTest::RunMain(int, char**)+3181 (0x152EDC6D)
??+0 (0x7FB28BC07D90)
__libc_start_main+128 (0x7FB28BC07E40)
_start+41 (0x13E8F029)
[[rst]]
