2026-03-17T14:15:46.889228Z node 24 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[24:7618228074157687718:2157];send_to=[0:7307199536658146131:7762515];
2026-03-17T14:15:46.889380Z node 24 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:85;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2026-03-17T14:15:46.890980Z node 25 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[25:7618228077554805660:2081];send_to=[0:7307199536658146131:7762515];
2026-03-17T14:15:46.891010Z node 25 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:85;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2026-03-17T14:15:46.893035Z node 24 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2026-03-17T14:15:46.893200Z node 24 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:137: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2026-03-17T14:15:46.894472Z node 25 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2026-03-17T14:15:46.894692Z node 25 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:137: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2026-03-17T14:15:46.913315Z node 24 :IMPORT WARN: schemeshard_import.cpp:466: Table profiles were not loaded
2026-03-17T14:15:46.940143Z node 24 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/8zh7/003379/r3tmp/yandexLF3xD1.tmp
2026-03-17T14:15:46.940162Z node 24 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/8zh7/003379/r3tmp/yandexLF3xD1.tmp
2026-03-17T14:15:46.940246Z node 24 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/8zh7/003379/r3tmp/yandexLF3xD1.tmp
2026-03-17T14:15:46.940291Z node 24 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2026-03-17T14:15:46.959128Z INFO: TTestServer started on Port 29899 GrpcPort 7107
PQClient connected to localhost:7107
2026-03-17T14:15:46.991111Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(24, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2026-03-17T14:15:46.991151Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(24, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2026-03-17T14:15:46.992793Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(24, (0,0,0,0)) VolatileState: Connecting -> Connected
2026-03-17T14:15:46.993172Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(25, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2026-03-17T14:15:46.993198Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(25, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2026-03-17T14:15:46.993961Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2026-03-17T14:15:46.994407Z node 24 :HIVE WARN: hive_impl.cpp:797: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 25 Cookie 25
2026-03-17T14:15:46.994663Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(25, (0,0,0,0)) VolatileState: Connecting -> Connected
2026-03-17T14:15:47.007271Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:689)
2026-03-17T14:15:47.051971Z node 25 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:137: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2026-03-17T14:15:47.148946Z node 24 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:137: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2026-03-17T14:15:47.386180Z node 24 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [24:7618228078452656205:2337], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.386214Z node 24 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:352: [WorkloadService] [Service] Failed to fetch pool: default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.386219Z node 24 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [24:7618228078452656238:2340], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.386299Z node 24 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [24:7618228078452656248:2341], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.386307Z node 24 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:352: [WorkloadService] [Service] Failed to fetch pool: default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.387043Z node 24 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [24:7618228078452656278:2344], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.387058Z node 24 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:352: [WorkloadService] [Service] Failed to fetch pool: default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.387095Z node 24 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [24:7618228078452656281:2345], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.387107Z node 24 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:352: [WorkloadService] [Service] Failed to fetch pool: default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:47.387242Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720662:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2026-03-17T14:15:47.392932Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:689)
2026-03-17T14:15:47.393132Z node 24 :KQP_WORKLOAD_SERVICE WARN: helpers.h:117: [WorkloadService] [TPoolCreatorActor] ActorId: [24:7618228078452656249:2342], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720662 completed, doublechecking }
2026-03-17T14:15:47.407481Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:689)
2026-03-17T14:15:47.430208Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:689)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
=== CheckClustersList. Subcribe to ClusterTracker from [24:7618228078452656757:3336] 
2026-03-17T14:15:47.480611Z node 24 :TX_PROXY ERROR: schemereq.cpp:631: Actor# [24:7618228078452656758:3337] txid# 281474976720667, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 45], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2026-03-17T14:15:47.892869Z node 24 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2026-03-17T14:15:47.894113Z node 25 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2026-03-17T14:15:51.888757Z node 24 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[24:7618228074157687718:2157];send_to=[0:7307199536658146131:7762515];
2026-03-17T14:15:51.888810Z node 24 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:85;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2026-03-17T14:15:51.891287Z node 25 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[25:7618228077554805660:2081];send_to=[0:7307199536658146131:7762515];
2026-03-17T14:15:51.891323Z node 25 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:85;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:7107
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2026-03-17T14:15:52.936231Z node 24 :PQ_METACACHE ERROR: msgbus_server_pq_metacache.cpp:384: Handle SchemeCache response: result# { ErrorCount: 1 DatabaseName:  DomainOwnerId: 0 Instant: 2 ResultSet [{ Path: Root/PQ/rt3.dc1--topic1 TableId: [18446744073709551615:18446744073709551615:0] RequestType: ByPath Operation: OpList RedirectRequired: true ShowPrivatePath: false SyncVersion: true Status: PathErrorUnknown Kind: KindUnknown DomainInfo <null> }] }
2026-03-17T14:15:52.936297Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:7107
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720674
  SchemeShardTabletId: 72057594046644480
  PathId: 49
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2026-03-17T14:15:52.992705Z node 24 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1669: [72075186224037893][] pipe [24:7618228099927493700:3598] connected; active server actors: 1
2026-03-17T14:15:52.992776Z node 24 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1521: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2026-03-17T14:15:52.993531Z node 24 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:765: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2026-03-17T14:15:52.995541Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:3046: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2026-03-17T14:15:52.996494Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:3078: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2026-03-17T14:15:52.996584Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:789: [PQ: 72075186224037892] no config, start with empty partitions and default config
2026-03-17T14:15:52.996597Z node 25 :PERSQUEUE NOTICE: pq_impl.cpp:928: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2026-03-17T14:15:52.996611Z node 25 :PERSQUEUE INFO: pq_impl.cpp:614: [PQ: 72075186224037892] doesn't have tx writes info
2026-03-17T14:15:52.996850Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228099927493726:2477], now have 1 active actors on pipe
2026-03-17T14:15:52.996857Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228099927493699:3597], now have 1 active actors on pipe
2026-03-17T14:15:52.994018Z node 24 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:145: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2026-03-17T14:15:52.997022Z node 24 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:399: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 25, Generation 1
2026-03-17T14:15:52.997991Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:3668: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2026-03-17T14:15:52.999343Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1060: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2026-03-17T14:15:53.010324Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461053:3643], now have 1 active actors on pipe
===Query complete
2026-03-17T14:15:53.014279Z node 25 :PERSQUEUE DEBUG: partition_init.cpp:86: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2026-03-17T14:15:53.014305Z node 25 :PERSQUEUE DEBUG: partition.cpp:1330: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2026-03-17T14:15:53.014412Z node 25 :PERSQUEUE DEBUG: partition_init.cpp:86: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2026-03-17T14:15:53.014467Z node 25 :PERSQUEUE INFO: partition_init.cpp:1175: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [25:7618228107619577439:2382]
2026-03-17T14:15:53.015245Z node 25 :PERSQUEUE DEBUG: partition_init.cpp:86: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2026-03-17T14:15:53.015257Z node 25 :PERSQUEUE DEBUG: partition_init.cpp:66: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2026-03-17T14:15:53.015263Z node 25 :PERSQUEUE INFO: partition.cpp:713: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [25:7618228107619577439:2382]
2026-03-17T14:15:53.015273Z node 25 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2026-03-17T14:15:53.015280Z node 25 :PERSQUEUE DEBUG: partition_mlp.cpp:151: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2026-03-17T14:15:53.015628Z node 25 :PERSQUEUE DEBUG: partition.cpp:4532: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2026-03-17T14:15:53.015634Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.015644Z node 25 :PERSQUEUE DEBUG: partition.cpp:2445: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2026-03-17T14:15:53.015656Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.015658Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.015661Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.015663Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.015672Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.015674Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.015676Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.015677Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.015680Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.015689Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:934: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2026-03-17T14:15:53.015698Z node 25 :PERSQUEUE DEBUG: partition_mlp.cpp:114: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2026-03-17T14:15:53.015808Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.015825Z node 25 :PERSQUEUE DEBUG: partition.cpp:1439: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1773756953052, TxId 281474976720674
2026-03-17T14:15:53.015829Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.015832Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.015834Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.015837Z node 25 :PERSQUEUE DEBUG: partition.cpp:2509: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2026-03-17T14:15:53.015898Z node 25 :PERSQUEUE DEBUG: partition.cpp:4010: [72075186224037892][Partition][0][StateIdle] Schedule reply tx done 281474976720674
2026-03-17T14:15:53.015901Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.015903Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.015905Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.015951Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.017150Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.017195Z node 25 :PERSQUEUE DEBUG: partition_mlp.cpp:151: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2026-03-17T14:15:53.017224Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.017230Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.017233Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.017234Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.017239Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.017241Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.017245Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.017356Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:400: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2026-03-17T14:15:53.017375Z node 25 :PERSQUEUE NOTICE: pq_impl.cpp:928: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 49
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720674
    CreateStep: 1773756953052
    ParentPathId: 38
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 49
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 48
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:7107
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
2026-03-17T14:15:53.024592Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.028399Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461088:3667], now have 1 active actors on pipe
2026-03-17T14:15:53.028622Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.028633Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.028663Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2815daf9-66e75cba-45b40728-8ab5fa86_0 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.028676Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.028680Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.028688Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.028691Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.028696Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.028706Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.028710Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.028714Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.028735Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.028752Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.029377Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461088:3667] destroyed
2026-03-17T14:15:53.027776Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.028887Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2815daf9-66e75cba-45b40728-8ab5fa86_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|2815daf9-66e75cba-45b40728-8ab5fa86_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.053324Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461091:3668], now have 1 active actors on pipe
2026-03-17T14:15:53.052356Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.055650Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.055674Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.099867Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.099959Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.099971Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.099976Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.101627Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.101654Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.101658Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.101673Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.101676Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.101682Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.101684Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.101690Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.101730Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2026-03-17T14:15:53.101745Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.101749Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 1
2026-03-17T14:15:53.101752Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.101756Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 2
2026-03-17T14:15:53.102000Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048790 count 1 nextOffset 1 batches 3
2026-03-17T14:15:53.102012Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.102015Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.102019Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.102091Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00002? size 1048780 WTime 1773756953100
2026-03-17T14:15:53.106382Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.106410Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.111529Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 0 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.111562Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.111592Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.111599Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.111603Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.111614Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2026-03-17T14:15:53.111618Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.111623Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 1, Offset: 0 is stored on disk
2026-03-17T14:15:53.111629Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.111634Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 2, Offset: 0 is stored on disk
2026-03-17T14:15:53.111674Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:934: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2026-03-17T14:15:53.111679Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:976: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2026-03-17T14:15:53.111683Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.111686Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.111688Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.111690Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.111692Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.111700Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.111717Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.111756Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:891: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2026-03-17T14:15:53.111771Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1116: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1048780 count 1 last offset 0, current partition end offset: 1
2026-03-17T14:15:53.111773Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1132: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2026-03-17T14:15:53.111783Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.112544Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2026-03-17T14:15:53.112560Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:580: FormAnswer for 1 blobs
2026-03-17T14:15:53.112569Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.112573Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:53.112581Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:53.112585Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 1 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:53.112606Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461091:3668] destroyed
2026-03-17T14:15:53.112614Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1026: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1773756953100 queuesize 0 startOffset 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    PartNo: 0
    WriteTimestampMS: 1773756953100
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.111824Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.114165Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.114852Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461098:3672], now have 1 active actors on pipe
2026-03-17T14:15:53.115003Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.115014Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.115056Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|95c3122b-cd29c2e2-21c79fa5-cc980831_1 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.115068Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.115073Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.115079Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.115080Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.115084Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.115094Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.115097Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.115100Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.115115Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.115128Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.115205Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|95c3122b-cd29c2e2-21c79fa5-cc980831_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:53.115981Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.115991Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.115994Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.115996Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.115999Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.118413Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461098:3672] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|95c3122b-cd29c2e2-21c79fa5-cc980831_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.125443Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.126187Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461101:3673], now have 1 active actors on pipe
2026-03-17T14:15:53.127922Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.127947Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.137858Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.137945Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.137955Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.137959Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.139396Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.139422Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.139425Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.139433Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.139435Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.139439Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.139440Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.139444Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.139477Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2026-03-17T14:15:53.139491Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.139495Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2026-03-17T14:15:53.139500Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.139503Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2026-03-17T14:15:53.139701Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2026-03-17T14:15:53.139710Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.139716Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.139718Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.139787Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1773756953139
2026-03-17T14:15:53.139975Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.139986Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.151734Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.151770Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.151794Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.151798Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.151804Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.151834Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2026-03-17T14:15:53.151837Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.151852Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2026-03-17T14:15:53.151857Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.151861Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2026-03-17T14:15:53.151884Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.151887Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.151888Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.151890Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.151895Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.151902Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.151922Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.152015Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.152645Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461101:3673] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1773756953138
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 12
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.158130Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.158984Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461106:3676], now have 1 active actors on pipe
2026-03-17T14:15:53.159013Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.159021Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.159058Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3587ae10-9492ff1-38ac51f6-9db977bd_2 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.159069Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.159073Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.159080Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.159083Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.159088Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.159099Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.159102Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.159107Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.159125Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.159144Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3587ae10-9492ff1-38ac51f6-9db977bd_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|3587ae10-9492ff1-38ac51f6-9db977bd_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.159316Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.167136Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461106:3676] destroyed
2026-03-17T14:15:53.167405Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.168109Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461109:3677], now have 1 active actors on pipe
2026-03-17T14:15:53.169572Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.169590Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.189539Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.189640Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.189705Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.189711Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.191928Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.191971Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.191976Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.191986Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.191989Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.191995Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.191998Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.192004Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.192051Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2026-03-17T14:15:53.192082Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.192086Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2026-03-17T14:15:53.192090Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.192092Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2026-03-17T14:15:53.192396Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2026-03-17T14:15:53.192411Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.192414Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.192419Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.192500Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1773756953191
2026-03-17T14:15:53.192706Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.192718Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.207507Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.207159Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.207202Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.207236Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.207245Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.207258Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2026-03-17T14:15:53.207262Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.207268Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2026-03-17T14:15:53.207274Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.207283Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2026-03-17T14:15:53.207337Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.207340Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.207343Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.207346Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.207343Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.207348Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.207358Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.207378Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.208122Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461109:3677] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1773756953191
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.210138Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.212214Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461116:3682], now have 1 active actors on pipe
2026-03-17T14:15:53.212541Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.212561Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.212604Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|23752d2c-291c3b2e-799ebcdf-6d88d0fa_3 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.212624Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.212629Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.212645Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.212648Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.212653Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.212664Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.212667Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.212671Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.212688Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.212705Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.212809Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:53.213172Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461116:3682] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|23752d2c-291c3b2e-799ebcdf-6d88d0fa_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|23752d2c-291c3b2e-799ebcdf-6d88d0fa_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.216359Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.216380Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.216384Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.216392Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.216395Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.220866Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.221504Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461119:3683], now have 1 active actors on pipe
2026-03-17T14:15:53.223286Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.223313Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.237601Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.237697Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.237708Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.237714Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.239818Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.239869Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.239877Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.239889Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.239892Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.239897Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.239900Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.239906Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.239948Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2026-03-17T14:15:53.239963Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.239970Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2026-03-17T14:15:53.239974Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.239981Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2026-03-17T14:15:53.240229Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2026-03-17T14:15:53.240241Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.240244Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.240248Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.240326Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1773756953239
2026-03-17T14:15:53.240486Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.240512Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.243981Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.244009Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.244030Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.244037Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.244044Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.244056Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2026-03-17T14:15:53.244067Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.244073Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2026-03-17T14:15:53.244084Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.244092Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2026-03-17T14:15:53.244131Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.244139Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.244145Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.244148Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.244149Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.244158Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.244176Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.244265Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.244669Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461119:3683] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1773756953239
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.246547Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.246977Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461124:3686], now have 1 active actors on pipe
2026-03-17T14:15:53.247062Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.247074Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.247239Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|920f1b79-f1d7060-9b029970-23786000_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:53.247109Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|920f1b79-f1d7060-9b029970-23786000_4 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.247125Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.247128Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.247133Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.247135Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.247140Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.247150Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.247153Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.247157Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.247171Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.247186Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.247444Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461124:3686] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|920f1b79-f1d7060-9b029970-23786000_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.254128Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.262219Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461127:3687], now have 1 active actors on pipe
2026-03-17T14:15:53.262758Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.262775Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.303561Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.303649Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.303661Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.303667Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.305857Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.305885Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.305890Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.305901Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.305904Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.305910Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.305918Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.305923Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.305966Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2026-03-17T14:15:53.305981Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.305989Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2026-03-17T14:15:53.305994Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.305997Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2026-03-17T14:15:53.308734Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2026-03-17T14:15:53.308776Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.308780Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.308786Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.308899Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1773756953308
2026-03-17T14:15:53.309093Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.309113Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.317131Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:53.327121Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.327165Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.327198Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.327206Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.327221Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2026-03-17T14:15:53.327226Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.327232Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2026-03-17T14:15:53.327238Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.327244Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2026-03-17T14:15:53.327290Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.327303Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.327307Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.327310Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.327312Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.327324Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.327347Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.327421Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.328499Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461127:3687] destroyed
2026-03-17T14:15:53.327661Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1773756953305
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 20
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.334812Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.335513Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461133:3691], now have 1 active actors on pipe
2026-03-17T14:15:53.335538Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.335545Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.335596Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2c5f6d70-5a6267ff-70d192f5-aca55624_5 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.335608Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.335612Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.335618Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.335620Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.335633Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.335644Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.335653Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.335657Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.335675Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.335701Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.335774Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2c5f6d70-5a6267ff-70d192f5-aca55624_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|2c5f6d70-5a6267ff-70d192f5-aca55624_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.339941Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461133:3691] destroyed
2026-03-17T14:15:53.344972Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.345669Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461137:3693], now have 1 active actors on pipe
2026-03-17T14:15:53.347182Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.347199Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.387096Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.387196Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.387212Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.387222Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.389080Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.389122Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.389132Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.389145Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.389150Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.389158Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.389188Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.389199Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.389264Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2026-03-17T14:15:53.389291Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.389304Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2026-03-17T14:15:53.389309Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.389314Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2026-03-17T14:15:53.389588Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2026-03-17T14:15:53.389600Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.389603Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.389607Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.389718Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1773756953386
2026-03-17T14:15:53.389920Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.389938Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.398655Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.398683Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.398720Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.398728Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.398740Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2026-03-17T14:15:53.398746Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.398753Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2026-03-17T14:15:53.398759Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.398767Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2026-03-17T14:15:53.398811Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.398814Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.398816Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.398819Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.398821Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.398831Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.398850Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.399009Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.399118Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1773756953386
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 12
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.400065Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461137:3693] destroyed
2026-03-17T14:15:53.400930Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.401608Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461143:3697], now have 1 active actors on pipe
2026-03-17T14:15:53.401807Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.401819Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.401857Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6b95fe5c-2e00a35d-a40ebae2-d8f69537_6 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.401868Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.401871Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.401877Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.401879Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.401883Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.401893Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.401896Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.401899Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.401912Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.401927Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.402050Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6b95fe5c-2e00a35d-a40ebae2-d8f69537_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:53.402381Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461143:3697] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|6b95fe5c-2e00a35d-a40ebae2-d8f69537_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.409735Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.410548Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461148:3699], now have 1 active actors on pipe
2026-03-17T14:15:53.414582Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.414605Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.431662Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.431745Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.431757Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.431763Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.433426Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.433432Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.433435Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.433439Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.433441Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.433470Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.433489Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.433492Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.433502Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.433504Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.433507Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.433509Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.433515Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.433554Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2026-03-17T14:15:53.433572Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.433576Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2026-03-17T14:15:53.433580Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.433587Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2026-03-17T14:15:53.433816Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2026-03-17T14:15:53.433828Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.433830Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.433833Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.433898Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1773756953430
2026-03-17T14:15:53.434075Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.434099Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.437975Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.437996Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.438023Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.438029Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.438041Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2026-03-17T14:15:53.438045Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.438050Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2026-03-17T14:15:53.438056Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.438060Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2026-03-17T14:15:53.438089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.438092Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.438093Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.438096Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.438098Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.438110Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.438125Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.438265Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.438380Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.438788Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461148:3699] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1773756953430
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.444653Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.445457Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461154:3703], now have 1 active actors on pipe
2026-03-17T14:15:53.445478Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.445487Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.445523Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|c00858e7-4443a772-53435cdc-12462c4b_7 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.445535Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.445538Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.445543Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.445545Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.445550Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.445559Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.445562Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.445564Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.445580Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.445595Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.445767Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|c00858e7-4443a772-53435cdc-12462c4b_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:53.447351Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461154:3703] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|c00858e7-4443a772-53435cdc-12462c4b_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.452722Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.453249Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461157:3704], now have 1 active actors on pipe
2026-03-17T14:15:53.454478Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.454493Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.468961Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.469040Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.469051Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.469058Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.470692Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.470719Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.470723Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.470732Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.470735Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.470740Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.470743Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.470748Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.470790Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2026-03-17T14:15:53.470809Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.470816Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2026-03-17T14:15:53.470823Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.470831Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2026-03-17T14:15:53.471049Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2026-03-17T14:15:53.471072Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.471075Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.471079Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.471153Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1773756953470
2026-03-17T14:15:53.471326Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.471349Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.473875Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.473897Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.473911Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.473918Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.473924Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.473934Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2026-03-17T14:15:53.473938Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.473949Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2026-03-17T14:15:53.473953Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.473957Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2026-03-17T14:15:53.473980Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.473987Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.473989Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.473991Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.473993Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.474001Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.474004Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.474006Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.474011Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.474013Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.474016Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.474019Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.474021Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.474025Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2026-03-17T14:15:53.474041Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.474057Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2026-03-17T14:15:53.474064Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00002?
2026-03-17T14:15:53.474071Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2026-03-17T14:15:53.474082Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2026-03-17T14:15:53.474100Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2026-03-17T14:15:53.474107Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2026-03-17T14:15:53.474102Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.474131Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2026-03-17T14:15:53.474144Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2026-03-17T14:15:53.474166Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2026-03-17T14:15:53.474176Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2026-03-17T14:15:53.474190Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 1 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.474194Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1773756953470
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2026-03-17T14:15:53.474444Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.474759Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.475004Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.475048Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.475324Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.475610Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.475916Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.476183Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2026-03-17T14:15:53.476193Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.476197Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.476201Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461157:3704] destroyed
2026-03-17T14:15:53.476201Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.476203Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.476206Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.476206Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461162:3707], now have 1 active actors on pipe
2026-03-17T14:15:53.476210Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.476215Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.476217Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.476217Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.476224Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.476238Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:444: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2026-03-17T14:15:53.476249Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000000_00000_0000000001_00002?
2026-03-17T14:15:53.476256Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.476259Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00002?, parameters.CurOffset=0
2026-03-17T14:15:53.476264Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 0.0/3
2026-03-17T14:15:53.476276Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2026-03-17T14:15:53.476285Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 0:0 appended
2026-03-17T14:15:53.476287Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 0.1/3
2026-03-17T14:15:53.476290Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 1
2026-03-17T14:15:53.476292Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 0:1 appended
2026-03-17T14:15:53.476293Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 0.2/3
2026-03-17T14:15:53.476296Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 2
2026-03-17T14:15:53.476507Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 0 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048790 count 1 nextOffset 1 batches 3
2026-03-17T14:15:53.476520Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 0:2 appended
2026-03-17T14:15:53.476522Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000001_00000_0000000001_00002?
2026-03-17T14:15:53.476524Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.476525Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2026-03-17T14:15:53.476527Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 1.0/3
2026-03-17T14:15:53.476530Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2026-03-17T14:15:53.476531Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 1:0 appended
2026-03-17T14:15:53.476534Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 1.1/3
2026-03-17T14:15:53.476536Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2026-03-17T14:15:53.476537Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 1:1 appended
2026-03-17T14:15:53.476539Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 1.2/3
2026-03-17T14:15:53.476541Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2026-03-17T14:15:53.476699Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097545 count 2 nextOffset 2 batches 5
2026-03-17T14:15:53.476709Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 1:2 appended
2026-03-17T14:15:53.476712Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000002_00000_0000000001_00002?
2026-03-17T14:15:53.476714Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.476716Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2026-03-17T14:15:53.476719Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 2.0/3
2026-03-17T14:15:53.476722Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2026-03-17T14:15:53.476727Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 2:0 appended
2026-03-17T14:15:53.476729Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 2.1/3
2026-03-17T14:15:53.476731Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2026-03-17T14:15:53.476732Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 2:1 appended
2026-03-17T14:15:53.476736Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 2.2/3
2026-03-17T14:15:53.476738Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2026-03-17T14:15:53.476914Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146300 count 3 nextOffset 3 batches 7
2026-03-17T14:15:53.476941Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 2:2 appended
2026-03-17T14:15:53.476944Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000003_00000_0000000001_00002?
2026-03-17T14:15:53.476946Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.476948Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2026-03-17T14:15:53.476949Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 3.0/3
2026-03-17T14:15:53.476952Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2026-03-17T14:15:53.476954Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 3:0 appended
2026-03-17T14:15:53.476955Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 3.1/3
2026-03-17T14:15:53.476956Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2026-03-17T14:15:53.476957Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 3:1 appended
2026-03-17T14:15:53.476958Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 3.2/3
2026-03-17T14:15:53.476960Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2026-03-17T14:15:53.477100Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195055 count 4 nextOffset 4 batches 9
2026-03-17T14:15:53.477107Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 3:2 appended
2026-03-17T14:15:53.477109Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000004_00000_0000000001_00002?
2026-03-17T14:15:53.477110Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.477112Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2026-03-17T14:15:53.477113Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 4.0/3
2026-03-17T14:15:53.477116Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2026-03-17T14:15:53.477117Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 4:0 appended
2026-03-17T14:15:53.477118Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 4.1/3
2026-03-17T14:15:53.477119Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2026-03-17T14:15:53.477122Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 4:1 appended
2026-03-17T14:15:53.477123Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 4.2/3
2026-03-17T14:15:53.477124Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2026-03-17T14:15:53.477264Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243810 count 5 nextOffset 5 batches 11
2026-03-17T14:15:53.477276Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 4:2 appended
2026-03-17T14:15:53.477278Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000005_00000_0000000001_00002?
2026-03-17T14:15:53.477280Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.477284Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2026-03-17T14:15:53.477286Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 5.0/3
2026-03-17T14:15:53.477290Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2026-03-17T14:15:53.477292Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 5:0 appended
2026-03-17T14:15:53.477294Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 5.1/3
2026-03-17T14:15:53.477296Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2026-03-17T14:15:53.477298Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 5:1 appended
2026-03-17T14:15:53.477300Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 5.2/3
2026-03-17T14:15:53.477302Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2026-03-17T14:15:53.477464Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292565 count 6 nextOffset 6 batches 13
2026-03-17T14:15:53.477474Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 5:2 appended
2026-03-17T14:15:53.477476Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000006_00000_0000000001_00002?
2026-03-17T14:15:53.477476Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.477478Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2026-03-17T14:15:53.477482Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 6.0/3
2026-03-17T14:15:53.477485Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2026-03-17T14:15:53.477487Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 6:0 appended
2026-03-17T14:15:53.477489Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 6.1/3
2026-03-17T14:15:53.477492Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2026-03-17T14:15:53.477493Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 6:1 appended
2026-03-17T14:15:53.477495Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 6.2/3
2026-03-17T14:15:53.477499Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2026-03-17T14:15:53.477979Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341320 count 7 nextOffset 7 batches 15
2026-03-17T14:15:53.477989Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 6:2 appended
2026-03-17T14:15:53.477992Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000007_00000_0000000001_00002?
2026-03-17T14:15:53.477993Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.477994Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2026-03-17T14:15:53.477996Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 7.0/3
2026-03-17T14:15:53.477999Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2026-03-17T14:15:53.478000Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 7:0 appended
2026-03-17T14:15:53.478001Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 7.1/3
2026-03-17T14:15:53.478003Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2026-03-17T14:15:53.478005Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 7:1 appended
2026-03-17T14:15:53.478006Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 7.2/3
2026-03-17T14:15:53.478008Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2026-03-17T14:15:53.484145Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 7 partNo 2 result is x0000000000_00000000000000000000_00000_0000000007_00016 size 8365339
2026-03-17T14:15:53.484169Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1106: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000000_00000_0000000007_00016 new key d0000000000_00000000000000000000_00000_0000000007_00016 size 8365339 WTime 1773756953480
2026-03-17T14:15:53.484200Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 1 NewHead: Offset 7 PartNo 2 PackedSize 24736 count 1 nextOffset 8 batches 1
2026-03-17T14:15:53.484205Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 7:2 appended
2026-03-17T14:15:53.484255Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:634: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 0 endOffset 0 curOffset 8 d0000000000_00000000000000000007_00002_0000000001_00000| size 24726 WTime 1773756953480
2026-03-17T14:15:53.484333Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|20ce5386-5a7e250a-e3744dc0-9f3fcdfb_8 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.484341Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.484343Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.484347Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.484349Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.484351Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.484360Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.484362Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.484363Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.484375Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.484383Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.484389Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 7 size 8365339
2026-03-17T14:15:53.484394Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 2 count 1 size 24726
2026-03-17T14:15:53.484410Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.490239Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|20ce5386-5a7e250a-e3744dc0-9f3fcdfb_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:53.494630Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461162:3707] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|20ce5386-5a7e250a-e3744dc0-9f3fcdfb_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.503115Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.503821Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461167:3709], now have 1 active actors on pipe
2026-03-17T14:15:53.505212Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.505227Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.526648Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.526721Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.526780Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.526787Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.528422Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.528448Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.528452Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.528461Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.528467Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.528473Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.528475Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.528482Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.528523Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2026-03-17T14:15:53.528539Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.528544Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2026-03-17T14:15:53.528550Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.528554Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2026-03-17T14:15:53.528781Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2026-03-17T14:15:53.528796Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.528803Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.528809Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.528885Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1773756953526
2026-03-17T14:15:53.529066Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.529079Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.531260Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:53.534750Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 0 count 7 size 8365339 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.534773Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 7 count 1 size 24726 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.534790Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.534831Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:53.534839Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.534926Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365339
2026-03-17T14:15:53.534936Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 1 parts 0 suffix '124' size 24726
2026-03-17T14:15:53.542738Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.542767Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.542797Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.542805Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.542817Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2026-03-17T14:15:53.542822Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.542827Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2026-03-17T14:15:53.542833Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.542839Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2026-03-17T14:15:53.542880Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.542884Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.542893Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.542896Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.542898Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.542906Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000000_00000_0000000001_00002?
2026-03-17T14:15:53.542911Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000001_00000_0000000001_00002?
2026-03-17T14:15:53.542914Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000002_00000_0000000001_00002?
2026-03-17T14:15:53.542917Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000003_00000_0000000001_00002?
2026-03-17T14:15:53.542920Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000004_00000_0000000001_00002?
2026-03-17T14:15:53.542923Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000005_00000_0000000001_00002?
2026-03-17T14:15:53.542926Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000006_00000_0000000001_00002?
2026-03-17T14:15:53.542930Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000007_00000_0000000001_00002?
2026-03-17T14:15:53.542955Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.542972Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.542986Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.542995Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00002?(+) to d0000000000_00000000000000000000_00000_0000000001_00002?(+)
2026-03-17T14:15:53.542997Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2026-03-17T14:15:53.542999Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2026-03-17T14:15:53.543001Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2026-03-17T14:15:53.543003Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2026-03-17T14:15:53.543006Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2026-03-17T14:15:53.543008Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2026-03-17T14:15:53.543010Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2026-03-17T14:15:53.543280Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.544661Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461167:3709] destroyed
2026-03-17T14:15:53.544749Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.544756Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.544763Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.544767Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.544772Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.544776Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.544779Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.544782Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.544796Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.544873Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.544889Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.544907Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.544921Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.544974Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.544988Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.545000Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.545013Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.543539Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1773756953526
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 16
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.546240Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:492: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2026-03-17T14:15:53.546262Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.546271Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.546274Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.546277Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.546280Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.546283Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.546293Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.546531Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.550507Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461177:3716], now have 1 active actors on pipe
2026-03-17T14:15:53.553905Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a4cbb19f-40a60438-a96fa673-374f1490_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:53.553669Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.553688Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.553726Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a4cbb19f-40a60438-a96fa673-374f1490_9 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.553736Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.553740Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.553746Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.553748Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.553752Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.553764Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.553767Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.553770Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.553784Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.553804Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.554495Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461177:3716] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|a4cbb19f-40a60438-a96fa673-374f1490_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.560684Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.561295Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461180:3718], now have 1 active actors on pipe
2026-03-17T14:15:53.562599Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.562617Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.575625Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.575708Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.575717Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.575726Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.577303Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.577327Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.577331Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.577341Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.577344Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.577349Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.577352Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.577358Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.577393Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2026-03-17T14:15:53.577406Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.577410Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2026-03-17T14:15:53.577414Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.577417Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2026-03-17T14:15:53.577659Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2026-03-17T14:15:53.577669Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.577673Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.577676Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.577748Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1773756953577
2026-03-17T14:15:53.577902Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.577916Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.588010Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.588037Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.588064Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.588073Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.588085Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2026-03-17T14:15:53.588100Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.588105Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2026-03-17T14:15:53.588111Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.588117Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2026-03-17T14:15:53.588150Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.588154Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.588156Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.588159Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.588161Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.588171Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.588188Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.588343Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.588424Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1773756953577
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.589741Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.590370Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461180:3718] destroyed
2026-03-17T14:15:53.590386Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461185:3721], now have 1 active actors on pipe
2026-03-17T14:15:53.590401Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.590409Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.590441Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|f3c6ff69-745ecbb5-3a74958f-f126e54f_10 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.590451Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.590455Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.590460Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.590463Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.590467Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.590475Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.590478Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.590481Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.590493Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.590505Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.590661Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|f3c6ff69-745ecbb5-3a74958f-f126e54f_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|f3c6ff69-745ecbb5-3a74958f-f126e54f_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.597555Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461185:3721] destroyed
2026-03-17T14:15:53.600954Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.601584Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461188:3722], now have 1 active actors on pipe
2026-03-17T14:15:53.602947Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.602967Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.618955Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.619039Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.619049Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.619057Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.620854Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.620879Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.620884Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.620894Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.620898Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.620905Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.620908Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.620914Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.620952Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2026-03-17T14:15:53.620967Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.620970Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2026-03-17T14:15:53.620985Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.620989Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2026-03-17T14:15:53.621221Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2026-03-17T14:15:53.621233Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.621236Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.621239Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.621329Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1773756953621
2026-03-17T14:15:53.621491Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.621509Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.626399Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.626424Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.626461Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.626469Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.626480Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2026-03-17T14:15:53.626485Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.626496Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2026-03-17T14:15:53.626502Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.626516Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2026-03-17T14:15:53.626551Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.626553Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.626555Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.626558Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.626560Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.626578Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.626596Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.627029Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1773756953620
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.626858Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.628635Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.629464Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461188:3722] destroyed
2026-03-17T14:15:53.629478Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461194:3726], now have 1 active actors on pipe
2026-03-17T14:15:53.629499Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.629504Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.629542Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|1e6b43c0-441b957a-342e5460-41146c85_11 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.629553Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.629556Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.629561Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.629563Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.629567Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.629576Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.629578Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.629590Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.629603Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.629617Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.629837Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|1e6b43c0-441b957a-342e5460-41146c85_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|1e6b43c0-441b957a-342e5460-41146c85_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.634018Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.634033Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.634037Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.634041Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.634043Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.634067Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461194:3726] destroyed
2026-03-17T14:15:53.637033Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.637754Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461197:3727], now have 1 active actors on pipe
2026-03-17T14:15:53.639421Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.639456Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.653558Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.653655Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.653673Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.653682Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.655929Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.655966Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.655970Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.655980Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.655982Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.655987Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.655991Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.656106Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.656158Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2026-03-17T14:15:53.656177Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.656191Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2026-03-17T14:15:53.656194Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.656197Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2026-03-17T14:15:53.656423Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2026-03-17T14:15:53.656434Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.656441Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.656444Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.656496Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1773756953656
2026-03-17T14:15:53.656641Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.656652Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.677810Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.677851Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.677881Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.677888Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.677900Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2026-03-17T14:15:53.677905Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.677916Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2026-03-17T14:15:53.677922Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.677927Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2026-03-17T14:15:53.677960Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.677963Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.677966Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.677969Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.677974Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.677982Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.677998Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.678175Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.678275Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1773756953656
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 21
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.680510Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.682628Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461197:3727] destroyed
2026-03-17T14:15:53.682656Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461203:3731], now have 1 active actors on pipe
2026-03-17T14:15:53.686413Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.686441Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.686495Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9e8a1e84-13394178-b769579c-49ae8f99_12 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.686512Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.686517Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.686524Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.686528Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.686534Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.686549Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.686552Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.686556Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.686581Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.686604Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.689794Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9e8a1e84-13394178-b769579c-49ae8f99_12"
    Status: Active
    SeqNo: 0
  }
}
2026-03-17T14:15:53.694236Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461203:3731] destroyed
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|9e8a1e84-13394178-b769579c-49ae8f99_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.701622Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.706232Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461207:3733], now have 1 active actors on pipe
2026-03-17T14:15:53.706846Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.706860Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.732620Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.732750Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.732772Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.732777Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.738887Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.738907Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.738911Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.738919Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.738923Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.738938Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.738958Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.738961Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.738972Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.738975Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.738983Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.738985Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.738991Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.739026Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2026-03-17T14:15:53.739115Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.739120Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2026-03-17T14:15:53.739129Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.739133Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2026-03-17T14:15:53.739458Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2026-03-17T14:15:53.739472Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.739475Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.739480Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.739562Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1773756953738
2026-03-17T14:15:53.739781Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.739799Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.758800Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.758837Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.758871Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.758879Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.758888Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2026-03-17T14:15:53.758892Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.758900Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2026-03-17T14:15:53.758907Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.758915Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2026-03-17T14:15:53.758944Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.758946Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.758947Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.758949Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.758950Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.758957Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.758970Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.759042Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.759149Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.759608Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461207:3733] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1773756953738
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 20
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.763007Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.763734Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461212:3736], now have 1 active actors on pipe
2026-03-17T14:15:53.763886Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.763894Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.763931Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d108a1f5-9f13f06e-5945b5f3-96e6680d_13 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.763951Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.763954Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.763959Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.763961Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.763966Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.763976Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.763979Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.763984Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.763997Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.764008Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
2026-03-17T14:15:53.764089Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d108a1f5-9f13f06e-5945b5f3-96e6680d_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:53.764610Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461212:3736] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d108a1f5-9f13f06e-5945b5f3-96e6680d_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.771119Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.771826Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461215:3737], now have 1 active actors on pipe
2026-03-17T14:15:53.773426Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.773450Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.788699Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.788782Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.788794Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.788799Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.790581Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.790613Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.790617Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.790625Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.790636Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.790641Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.790645Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.790649Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.790690Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2026-03-17T14:15:53.790704Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.790707Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2026-03-17T14:15:53.790710Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.790713Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2026-03-17T14:15:53.790926Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2026-03-17T14:15:53.790937Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.790940Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.790944Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.791019Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1773756953790
2026-03-17T14:15:53.791175Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.791197Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.807822Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.807485Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.807530Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.807562Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.807569Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.807582Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2026-03-17T14:15:53.807587Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.807592Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2026-03-17T14:15:53.807603Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.807608Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2026-03-17T14:15:53.807617Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.807646Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.807653Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.807655Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.807658Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
CallPersQueueGRPC response:
2026-03-17T14:15:53.807661Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.807671Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.807692Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.808271Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461215:3737] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1773756953790
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 16
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.809087Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.809671Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461221:3741], now have 1 active actors on pipe
2026-03-17T14:15:53.809919Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.809939Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.809972Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|290a3c5-6eec0b23-752c975b-11a616ae_14 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.809991Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.809994Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.810000Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.810002Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.810007Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.810018Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.810021Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.810024Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.810040Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.810056Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.810163Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|290a3c5-6eec0b23-752c975b-11a616ae_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:53.810669Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461221:3741] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|290a3c5-6eec0b23-752c975b-11a616ae_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.814386Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.815191Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461224:3742], now have 1 active actors on pipe
2026-03-17T14:15:53.816726Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.816741Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.830407Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.830496Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.830508Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.830512Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.832388Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.832422Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.832427Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.832436Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.832439Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.832447Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.832449Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.832453Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.832487Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2026-03-17T14:15:53.832509Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.832512Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2026-03-17T14:15:53.832516Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.832518Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2026-03-17T14:15:53.832745Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2026-03-17T14:15:53.832763Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.832771Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.832774Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.832845Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1773756953831
2026-03-17T14:15:53.833035Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.833056Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.842067Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:53.842907Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.842928Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.842955Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.842964Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.842977Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2026-03-17T14:15:53.842986Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.842991Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2026-03-17T14:15:53.842998Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.843004Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2026-03-17T14:15:53.843054Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.843057Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.843059Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.843062Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.843065Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.843087Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.843107Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.843230Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.843931Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461224:3742] destroyed
2026-03-17T14:15:53.843370Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1773756953831
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.850761Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.851420Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461230:3746], now have 1 active actors on pipe
2026-03-17T14:15:53.851618Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.851628Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.851660Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|7c4b674b-da080a4a-445c76e9-48a02c92_15 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.851671Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.851676Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.851685Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.851688Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.851692Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.851703Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.851706Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.851709Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.851725Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.851752Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.851916Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.852400Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461230:3746] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|7c4b674b-da080a4a-445c76e9-48a02c92_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|7c4b674b-da080a4a-445c76e9-48a02c92_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.861574Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.862742Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461237:3748], now have 1 active actors on pipe
2026-03-17T14:15:53.864210Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.864228Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.879413Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.879489Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.879507Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.879514Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.881693Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.881721Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.881726Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.881741Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.881743Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.881750Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.881752Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.881759Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.881806Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2026-03-17T14:15:53.881820Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.881823Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2026-03-17T14:15:53.881826Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.881833Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2026-03-17T14:15:53.882072Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2026-03-17T14:15:53.882085Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.882088Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.882092Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.882418Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1773756953882
2026-03-17T14:15:53.882607Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.882636Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.888180Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.888214Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.888243Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.888250Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.888266Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2026-03-17T14:15:53.888276Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.888281Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2026-03-17T14:15:53.888287Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.888292Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2026-03-17T14:15:53.888339Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.888348Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.888351Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.888353Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.888356Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.888368Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.888371Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000009_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.888374Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.888377Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.888380Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000012_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.888390Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.888394Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.888396Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000015_00000_0000000001_00002? (1048780)
2026-03-17T14:15:53.888399Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2026-03-17T14:15:53.888421Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.888441Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2026-03-17T14:15:53.888449Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2026-03-17T14:15:53.888460Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000009_00000_0000000001_00002?
2026-03-17T14:15:53.888471Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000001_00002?
2026-03-17T14:15:53.888486Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00000_0000000001_00002?
2026-03-17T14:15:53.888499Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000012_00000_0000000001_00002?
2026-03-17T14:15:53.888522Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00000_0000000001_00002?
2026-03-17T14:15:53.888535Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000001_00002?
2026-03-17T14:15:53.888543Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000015_00000_0000000001_00002?
2026-03-17T14:15:53.891587Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1773756953881
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.888552Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2026-03-17T14:15:53.888579Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.888882Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.889166Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.889472Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.889747Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.890003Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.890284Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.890566Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:53.890849Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2026-03-17T14:15:53.890864Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:444: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2026-03-17T14:15:53.890879Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000008_00000_0000000001_00002?
2026-03-17T14:15:53.890882Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.890886Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2026-03-17T14:15:53.890889Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 8.0/3
2026-03-17T14:15:53.890898Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2026-03-17T14:15:53.890904Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 8:0 appended
2026-03-17T14:15:53.890907Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 8.1/3
2026-03-17T14:15:53.890914Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2026-03-17T14:15:53.890917Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 8:1 appended
2026-03-17T14:15:53.890918Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 8.2/3
2026-03-17T14:15:53.890921Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2026-03-17T14:15:53.891154Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2026-03-17T14:15:53.891162Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 8:2 appended
2026-03-17T14:15:53.891166Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000009_00000_0000000001_00002?
2026-03-17T14:15:53.891168Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.891171Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000009_00000_0000000001_00002?, parameters.CurOffset=9
2026-03-17T14:15:53.891173Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 9.0/3
2026-03-17T14:15:53.891177Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2026-03-17T14:15:53.891179Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 9:0 appended
2026-03-17T14:15:53.891181Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 9.1/3
2026-03-17T14:15:53.891184Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2026-03-17T14:15:53.891186Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 9:1 appended
2026-03-17T14:15:53.891190Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 9.2/3
2026-03-17T14:15:53.891194Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2026-03-17T14:15:53.891421Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2097545 count 2 nextOffset 10 batches 5
2026-03-17T14:15:53.891425Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 9:2 appended
2026-03-17T14:15:53.891425Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.891429Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000010_00000_0000000001_00002?
2026-03-17T14:15:53.891432Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.891435Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000010_00000_0000000001_00002?, parameters.CurOffset=10
2026-03-17T14:15:53.891437Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 10.0/3
2026-03-17T14:15:53.891440Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.891441Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2026-03-17T14:15:53.891444Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.891443Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 10:0 appended
2026-03-17T14:15:53.891446Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 10.1/3
2026-03-17T14:15:53.891449Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.891451Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2026-03-17T14:15:53.891453Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 10:1 appended
2026-03-17T14:15:53.891453Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.891455Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 10.2/3
2026-03-17T14:15:53.891457Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.891458Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2026-03-17T14:15:53.891462Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.891466Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.891469Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:53.891645Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 3146300 count 3 nextOffset 11 batches 7
2026-03-17T14:15:53.891648Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 10:2 appended
2026-03-17T14:15:53.891663Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000011_00000_0000000001_00002?
2026-03-17T14:15:53.891666Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.891669Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000011_00000_0000000001_00002?, parameters.CurOffset=11
2026-03-17T14:15:53.891671Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 11.0/3
2026-03-17T14:15:53.891675Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2026-03-17T14:15:53.891677Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 11:0 appended
2026-03-17T14:15:53.891679Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 11.1/3
2026-03-17T14:15:53.891683Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2026-03-17T14:15:53.891684Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 11:1 appended
2026-03-17T14:15:53.891687Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 11.2/3
2026-03-17T14:15:53.891689Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2026-03-17T14:15:53.891897Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4195055 count 4 nextOffset 12 batches 9
2026-03-17T14:15:53.891900Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 11:2 appended
2026-03-17T14:15:53.891904Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000012_00000_0000000001_00002?
2026-03-17T14:15:53.891906Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.891913Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000012_00000_0000000001_00002?, parameters.CurOffset=12
2026-03-17T14:15:53.891916Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 12.0/3
2026-03-17T14:15:53.891919Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2026-03-17T14:15:53.891921Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 12:0 appended
2026-03-17T14:15:53.891924Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 12.1/3
2026-03-17T14:15:53.891926Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2026-03-17T14:15:53.891928Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 12:1 appended
2026-03-17T14:15:53.891931Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 12.2/3
2026-03-17T14:15:53.891933Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2026-03-17T14:15:53.892111Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 5243810 count 5 nextOffset 13 batches 11
2026-03-17T14:15:53.892114Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 12:2 appended
2026-03-17T14:15:53.892117Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000013_00000_0000000001_00002?
2026-03-17T14:15:53.892119Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.892122Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000013_00000_0000000001_00002?, parameters.CurOffset=13
2026-03-17T14:15:53.892124Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 13.0/3
2026-03-17T14:15:53.892128Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2026-03-17T14:15:53.892129Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 13:0 appended
2026-03-17T14:15:53.892138Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 13.1/3
2026-03-17T14:15:53.892140Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2026-03-17T14:15:53.892142Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 13:1 appended
2026-03-17T14:15:53.892146Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 13.2/3
2026-03-17T14:15:53.892149Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2026-03-17T14:15:53.902470Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.904202Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 6292565 count 6 nextOffset 14 batches 13
2026-03-17T14:15:53.904222Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 13:2 appended
2026-03-17T14:15:53.904232Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000014_00000_0000000001_00002?
2026-03-17T14:15:53.904235Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.904240Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000014_00000_0000000001_00002?, parameters.CurOffset=14
2026-03-17T14:15:53.904245Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 14.0/3
2026-03-17T14:15:53.904254Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2026-03-17T14:15:53.904259Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 14:0 appended
2026-03-17T14:15:53.904261Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 14.1/3
2026-03-17T14:15:53.904267Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2026-03-17T14:15:53.904270Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 14:1 appended
2026-03-17T14:15:53.904272Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 14.2/3
2026-03-17T14:15:53.904276Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2026-03-17T14:15:53.904467Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 7341320 count 7 nextOffset 15 batches 15
2026-03-17T14:15:53.904471Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 14:2 appended
2026-03-17T14:15:53.904474Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000015_00000_0000000001_00002?
2026-03-17T14:15:53.904476Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:53.904480Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000015_00000_0000000001_00002?, parameters.CurOffset=15
2026-03-17T14:15:53.904483Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 15.0/3
2026-03-17T14:15:53.904487Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2026-03-17T14:15:53.904491Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 15:0 appended
2026-03-17T14:15:53.904493Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 15.1/3
2026-03-17T14:15:53.904497Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2026-03-17T14:15:53.905697Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 15 partNo 1 result is x0000000000_00000000000000000007_00002_0000000008_00015 size 7878063
2026-03-17T14:15:53.905702Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 15:1 appended
2026-03-17T14:15:53.905705Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 15.2/3
2026-03-17T14:15:53.905708Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2026-03-17T14:15:53.905723Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1106: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000007_00002_0000000008_00015 new key d0000000000_00000000000000000007_00002_0000000008_00015 size 7878063 WTime 1773756953905
2026-03-17T14:15:53.905850Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 15 partNo 2 FormedBlobsCount 1 NewHead: Offset 15 PartNo 1 PackedSize 536763 count 1 nextOffset 16 batches 2
2026-03-17T14:15:53.905853Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 15:2 appended
2026-03-17T14:15:53.905909Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:634: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 7 endOffset 8 curOffset 16 d0000000000_00000000000000000015_00001_0000000001_00001| size 536753 WTime 1773756953905
2026-03-17T14:15:53.906022Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461237:3748] destroyed
2026-03-17T14:15:53.906032Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461244:3752], now have 1 active actors on pipe
2026-03-17T14:15:53.906057Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.906065Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.906081Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.906095Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 2 count 8 size 7878063
2026-03-17T14:15:53.906104Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 1 count 1 size 536753
2026-03-17T14:15:53.906139Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3286c22d-42ea9a53-890a750d-4f7da6d_16 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.906162Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.906168Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.906174Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.906176Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.906180Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.906189Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.906192Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.906194Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.906210Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.906261Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.906850Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.907532Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461244:3752] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3286c22d-42ea9a53-890a750d-4f7da6d_16"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|3286c22d-42ea9a53-890a750d-4f7da6d_16"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 16
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.917769Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.919033Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461252:3755], now have 1 active actors on pipe
2026-03-17T14:15:53.919777Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.919797Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.935817Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.935928Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.935948Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.935953Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.937400Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.937427Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.937433Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.937441Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.937443Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.937447Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.937448Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.937452Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.937480Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 0
2026-03-17T14:15:53.937503Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.937506Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 1
2026-03-17T14:15:53.937514Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.937516Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 2
2026-03-17T14:15:53.937745Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 16 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 1048790 count 1 nextOffset 17 batches 3
2026-03-17T14:15:53.937766Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.937769Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.937772Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.937849Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 16,1 HeadOffset 16 endOffset 16 curOffset 17 d0000000000_00000000000000000016_00000_0000000001_00002? size 1048780 WTime 1773756953934
2026-03-17T14:15:53.938499Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.938521Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.941566Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 7 count 8 size 7878063 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.941586Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 15 count 1 size 536753 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.941735Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.941856Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:53.941871Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.941925Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2026-03-17T14:15:53.941935Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 1 parts 1 suffix '124' size 536753
2026-03-17T14:15:53.942290Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:53.942912Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 16 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.942933Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.942960Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.942973Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.942985Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 0, Offset: 16 is stored on disk
2026-03-17T14:15:53.942994Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.943001Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 1, Offset: 16 is stored on disk
2026-03-17T14:15:53.943007Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.943013Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 2, Offset: 16 is stored on disk
2026-03-17T14:15:53.943046Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.943054Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.943056Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.943059Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.943061Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.943068Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000007_00002_0000000001_00000|
2026-03-17T14:15:53.943073Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000008_00000_0000000001_00002?
2026-03-17T14:15:53.943076Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000009_00000_0000000001_00002?
2026-03-17T14:15:53.943079Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000010_00000_0000000001_00002?
2026-03-17T14:15:53.943081Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000011_00000_0000000001_00002?
2026-03-17T14:15:53.943086Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000012_00000_0000000001_00002?
2026-03-17T14:15:53.943089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000013_00000_0000000001_00002?
2026-03-17T14:15:53.943091Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000014_00000_0000000001_00002?
2026-03-17T14:15:53.943094Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000015_00000_0000000001_00002?
2026-03-17T14:15:53.943114Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.943131Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.943146Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.943159Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00002_0000000001_00000|(+) to d0000000000_00000000000000000007_00002_0000000001_00000|(+)
2026-03-17T14:15:53.943162Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2026-03-17T14:15:53.943164Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000009_00000_0000000001_00002?(+) to d0000000000_00000000000000000009_00000_0000000001_00002?(+)
2026-03-17T14:15:53.943166Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000001_00002?(+) to d0000000000_00000000000000000010_00000_0000000001_00002?(+)
2026-03-17T14:15:53.943168Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00000_0000000001_00002?(+) to d0000000000_00000000000000000011_00000_0000000001_00002?(+)
2026-03-17T14:15:53.943170Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000012_00000_0000000001_00002?(+) to d0000000000_00000000000000000012_00000_0000000001_00002?(+)
2026-03-17T14:15:53.943169Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.943173Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00000_0000000001_00002?(+) to d0000000000_00000000000000000013_00000_0000000001_00002?(+)
2026-03-17T14:15:53.943175Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00000_0000000001_00002?(+) to d0000000000_00000000000000000014_00000_0000000001_00002?(+)
2026-03-17T14:15:53.943178Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000015_00000_0000000001_00002?(+) to d0000000000_00000000000000000015_00000_0000000001_00002?(+)
2026-03-17T14:15:53.943694Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461252:3755] destroyed
2026-03-17T14:15:53.944133Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944144Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944151Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 9 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944158Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 10 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944164Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 11 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944168Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 12 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944172Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 13 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944177Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 14 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944183Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 15 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.944202Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.944233Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 1 parts 0 suffix '124' size 24726
2026-03-17T14:15:53.944241Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.944261Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.944275Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.944289Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.944306Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.944318Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.944331Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.944344Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.943274Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 16
    Offset: 16
    PartNo: 0
    WriteTimestampMS: 1773756953934
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.946823Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:492: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2026-03-17T14:15:53.946851Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.946861Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.946865Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.946880Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.946884Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.946887Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.946897Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.950575Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.951197Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461274:3770], now have 1 active actors on pipe
2026-03-17T14:15:53.951288Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.951299Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.951343Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a9130599-543940fe-862d185c-dd1c5c51_17 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.951358Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.951373Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.951379Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.951381Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.951386Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.951397Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.951400Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.951404Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.951421Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.951440Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.951747Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:53.953032Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461274:3770] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a9130599-543940fe-862d185c-dd1c5c51_17"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|a9130599-543940fe-862d185c-dd1c5c51_17"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 17
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.959132Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.961193Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461283:3774], now have 1 active actors on pipe
2026-03-17T14:15:53.962382Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.962406Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.975834Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:53.975953Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:53.975971Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:53.975976Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:53.977625Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:53.977660Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.977663Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.977671Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.977674Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.977679Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:53.977682Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.977687Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.977721Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 0
2026-03-17T14:15:53.977741Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.977750Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 1
2026-03-17T14:15:53.977754Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.977757Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 2
2026-03-17T14:15:53.977998Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 17 partNo 2 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1048790 count 1 nextOffset 18 batches 3
2026-03-17T14:15:53.978022Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:53.978025Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:53.978029Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.978107Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 17,1 HeadOffset 17 endOffset 17 curOffset 18 d0000000000_00000000000000000017_00000_0000000001_00002? size 1048780 WTime 1773756953977
2026-03-17T14:15:53.978297Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:53.978319Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 1 size 1048780
2026-03-17T14:15:53.983371Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 17 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:53.983404Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:53.983424Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:53.983429Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:53.983436Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.983453Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 0, Offset: 17 is stored on disk
2026-03-17T14:15:53.983458Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.983463Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 1, Offset: 17 is stored on disk
2026-03-17T14:15:53.983468Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:53.983473Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 2, Offset: 17 is stored on disk
2026-03-17T14:15:53.983503Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.983513Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.983515Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.983518Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:53.983520Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.983531Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:53.983548Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.983622Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:53.984060Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461283:3774] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 17
    Offset: 17
    PartNo: 0
    WriteTimestampMS: 1773756953977
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:53.984732Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.985347Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461303:3781], now have 1 active actors on pipe
2026-03-17T14:15:53.985381Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.985389Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:53.985426Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|401d7ec2-e5921838-d2f48137-39b432f9_18 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:53.985440Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:53.985443Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:53.985448Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:53.985450Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:53.985454Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:53.985466Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:53.985473Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:53.985476Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:53.985491Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:53.985508Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:53.985563Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:53.985792Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461303:3781] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|401d7ec2-e5921838-d2f48137-39b432f9_18"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|401d7ec2-e5921838-d2f48137-39b432f9_18"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 18
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:53.990908Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:53.991406Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228104222461306:3782], now have 1 active actors on pipe
2026-03-17T14:15:53.992544Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:53.992560Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.002942Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.003019Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.003033Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.003038Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.004526Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.004560Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.004565Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.004577Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.004580Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.004584Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.004587Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.004593Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.004628Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 0
2026-03-17T14:15:54.004649Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.004655Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 1
2026-03-17T14:15:54.004659Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.004662Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 2
2026-03-17T14:15:54.004899Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 18 partNo 2 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 1048790 count 1 nextOffset 19 batches 3
2026-03-17T14:15:54.004909Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.004912Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.004916Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.004988Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 18,1 HeadOffset 18 endOffset 18 curOffset 19 d0000000000_00000000000000000018_00000_0000000001_00002? size 1048780 WTime 1773756954004
2026-03-17T14:15:54.005162Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.005182Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.009082Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 18 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.009116Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.009143Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.009145Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.009155Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.009169Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 0, Offset: 18 is stored on disk
2026-03-17T14:15:54.009178Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.009184Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 1, Offset: 18 is stored on disk
2026-03-17T14:15:54.009194Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.009199Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 2, Offset: 18 is stored on disk
2026-03-17T14:15:54.009236Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.009246Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.009248Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.009251Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.009254Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.009266Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.009283Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.009408Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.009817Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228104222461306:3782] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 18
    Offset: 18
    PartNo: 0
    WriteTimestampMS: 1773756954004
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.010998Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.011568Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428609:3785], now have 1 active actors on pipe
2026-03-17T14:15:54.011756Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.011768Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.011808Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|7088a389-c46317ae-c0392637-269ee9b2_19 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.011822Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.011826Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.011831Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.011833Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.011837Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.011862Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.011865Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.011871Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.011886Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.011902Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.012005Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|7088a389-c46317ae-c0392637-269ee9b2_19"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:54.012350Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428609:3785] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|7088a389-c46317ae-c0392637-269ee9b2_19"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 19
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.018996Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.019534Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428613:3787], now have 1 active actors on pipe
2026-03-17T14:15:54.020767Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.020788Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.032516Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.032596Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.032607Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.032612Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.033944Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.033982Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.033986Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.033996Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.034007Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.034012Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.034014Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.034019Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.034061Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 0
2026-03-17T14:15:54.034079Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.034084Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 1
2026-03-17T14:15:54.034092Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.034102Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 2
2026-03-17T14:15:54.034343Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 19 partNo 2 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1048790 count 1 nextOffset 20 batches 3
2026-03-17T14:15:54.034363Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.034366Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.034369Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.034445Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 19,1 HeadOffset 19 endOffset 19 curOffset 20 d0000000000_00000000000000000019_00000_0000000001_00002? size 1048780 WTime 1773756954033
2026-03-17T14:15:54.034611Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.034632Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 19 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.043062Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.042697Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:54.042804Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 19 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.042825Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.042852Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.042852Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.042869Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.042886Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 0, Offset: 19 is stored on disk
2026-03-17T14:15:54.042891Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.042896Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 1, Offset: 19 is stored on disk
2026-03-17T14:15:54.042902Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.042907Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 2, Offset: 19 is stored on disk
2026-03-17T14:15:54.042942Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.042945Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.042948Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.042951Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.042953Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.042964Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.042981Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.043657Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428613:3787] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 19
    Offset: 19
    PartNo: 0
    WriteTimestampMS: 1773756954033
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 8
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.051462Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.051955Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428618:3790], now have 1 active actors on pipe
2026-03-17T14:15:54.052076Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.052096Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.052154Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|327784d2-4f16d161-a6b4ac0f-cffbae6c_20 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.052175Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.052186Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.052193Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.052195Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.052200Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.052210Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.052222Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.052226Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.052243Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.052259Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.052361Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.052671Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428618:3790] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|327784d2-4f16d161-a6b4ac0f-cffbae6c_20"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|327784d2-4f16d161-a6b4ac0f-cffbae6c_20"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 20
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.058141Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.058614Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428621:3791], now have 1 active actors on pipe
2026-03-17T14:15:54.059921Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.059941Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.073396Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.073483Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.073494Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.073508Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.075301Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.075333Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.075342Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.075352Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.075359Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.075365Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.075367Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.075372Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.075410Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 0
2026-03-17T14:15:54.075432Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.075441Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 1
2026-03-17T14:15:54.075444Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.075447Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 2
2026-03-17T14:15:54.075695Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 20 partNo 2 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 1048790 count 1 nextOffset 21 batches 3
2026-03-17T14:15:54.075713Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.075716Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.075722Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.075796Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 20,1 HeadOffset 20 endOffset 20 curOffset 21 d0000000000_00000000000000000020_00000_0000000001_00002? size 1048780 WTime 1773756954075
2026-03-17T14:15:54.075969Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.075991Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.080469Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 20 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.080495Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.080524Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.080532Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.080546Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 0, Offset: 20 is stored on disk
2026-03-17T14:15:54.080551Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.080556Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 1, Offset: 20 is stored on disk
2026-03-17T14:15:54.080562Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.080568Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 2, Offset: 20 is stored on disk
2026-03-17T14:15:54.080614Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.080618Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.080621Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.080624Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.080626Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.080637Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.080655Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.080853Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.081367Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428621:3791] destroyed
2026-03-17T14:15:54.080945Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 20
    Offset: 20
    PartNo: 0
    WriteTimestampMS: 1773756954074
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 2
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.086603Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.087363Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428626:3794], now have 1 active actors on pipe
2026-03-17T14:15:54.087610Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.087621Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.087663Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2188c975-2d2c5f31-cba225f6-fa060fd_21 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.087679Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.087684Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.087690Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.087693Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.087698Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.087712Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.087715Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.087719Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.087738Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.087755Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.087968Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2188c975-2d2c5f31-cba225f6-fa060fd_21"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:54.088434Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428626:3794] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|2188c975-2d2c5f31-cba225f6-fa060fd_21"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 21
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.097740Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.098459Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428629:3795], now have 1 active actors on pipe
2026-03-17T14:15:54.099827Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.099866Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.136359Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.142296Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.142328Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.142335Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.144603Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.144616Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.144619Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.144623Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.144626Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.144643Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.144665Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.144673Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.144684Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.144687Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.144691Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.144693Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.144698Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.144740Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 0
2026-03-17T14:15:54.144755Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.144759Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 1
2026-03-17T14:15:54.144764Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.144768Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 2
2026-03-17T14:15:54.145104Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 21 partNo 2 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1048790 count 1 nextOffset 22 batches 3
2026-03-17T14:15:54.145118Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.145125Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.145130Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.145212Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 21,1 HeadOffset 21 endOffset 21 curOffset 22 d0000000000_00000000000000000021_00000_0000000001_00002? size 1048780 WTime 1773756954144
2026-03-17T14:15:54.145416Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.145430Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.150405Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 21 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.150446Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.150470Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.150473Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.150482Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.150495Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 0, Offset: 21 is stored on disk
2026-03-17T14:15:54.150500Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.150505Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 1, Offset: 21 is stored on disk
2026-03-17T14:15:54.150511Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.150516Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 2, Offset: 21 is stored on disk
2026-03-17T14:15:54.150551Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.150555Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.150557Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.150561Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.150566Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.150575Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.150602Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.150707Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.151089Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428629:3795] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 21
    Offset: 21
    PartNo: 0
    WriteTimestampMS: 1773756954143
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.152280Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.152856Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428636:3800], now have 1 active actors on pipe
2026-03-17T14:15:54.152959Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.152970Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.153015Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|67762e2c-97886177-b531f8d9-c31c5f7_22 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.153028Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.153037Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.153042Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.153045Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.153052Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.153060Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.153063Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.153066Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.153081Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.153095Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|67762e2c-97886177-b531f8d9-c31c5f7_22"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:54.153172Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.153400Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428636:3800] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|67762e2c-97886177-b531f8d9-c31c5f7_22"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 22
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.159988Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.160583Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428639:3801], now have 1 active actors on pipe
2026-03-17T14:15:54.161813Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.161827Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.175718Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.175803Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.175815Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.175826Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.177923Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.177955Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.177960Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.177969Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.177972Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.177978Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.177980Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.177986Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.178024Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 0
2026-03-17T14:15:54.178040Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.178044Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 1
2026-03-17T14:15:54.178048Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.178055Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 2
2026-03-17T14:15:54.178464Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 22 partNo 2 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1048790 count 1 nextOffset 23 batches 3
2026-03-17T14:15:54.178483Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.178487Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.178490Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.178566Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 22,1 HeadOffset 22 endOffset 22 curOffset 23 d0000000000_00000000000000000022_00000_0000000001_00002? size 1048780 WTime 1773756954177
2026-03-17T14:15:54.178723Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.178737Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.188718Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 22 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.188752Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.188774Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.188782Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.188791Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.188804Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 0, Offset: 22 is stored on disk
2026-03-17T14:15:54.188809Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.188814Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 1, Offset: 22 is stored on disk
2026-03-17T14:15:54.188820Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.188825Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 2, Offset: 22 is stored on disk
2026-03-17T14:15:54.188870Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.188873Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.188876Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.188882Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.188884Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.188895Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.188913Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.189022Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.189546Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428639:3801] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 22
    Offset: 22
    PartNo: 0
    WriteTimestampMS: 1773756954177
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.190306Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.190805Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428645:3805], now have 1 active actors on pipe
2026-03-17T14:15:54.190953Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.190962Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.191007Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cb6d1a44-8d17a703-b8421706-6d1a66ae_23 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.191018Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.191022Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.191027Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.191030Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.191034Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.191044Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.191047Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.191050Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.191068Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.191081Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.191159Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.191460Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428645:3805] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cb6d1a44-8d17a703-b8421706-6d1a66ae_23"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|cb6d1a44-8d17a703-b8421706-6d1a66ae_23"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 23
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.198765Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.199370Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428648:3806], now have 1 active actors on pipe
2026-03-17T14:15:54.201172Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.201195Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.212702Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.212776Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.212785Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.212789Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.214030Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.214055Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.214059Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.214069Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.214071Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.214075Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.214077Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.214081Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.214110Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 0
2026-03-17T14:15:54.214128Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.214135Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 1
2026-03-17T14:15:54.214138Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.214140Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 2
2026-03-17T14:15:54.214391Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 23 partNo 2 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1048790 count 1 nextOffset 24 batches 3
2026-03-17T14:15:54.214408Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.214410Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.214412Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.214463Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 23,1 HeadOffset 23 endOffset 23 curOffset 24 d0000000000_00000000000000000023_00000_0000000001_00002? size 1048780 WTime 1773756954214
2026-03-17T14:15:54.214594Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.214612Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.218271Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 23 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.218296Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.218325Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.218333Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.218344Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 0, Offset: 23 is stored on disk
2026-03-17T14:15:54.218348Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.218353Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 1, Offset: 23 is stored on disk
2026-03-17T14:15:54.218358Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.218363Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 2, Offset: 23 is stored on disk
2026-03-17T14:15:54.218393Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.218396Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.218400Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.218403Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.218405Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.218416Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.218420Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.218422Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000018_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.218425Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000019_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.218429Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.218431Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000021_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.218436Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.218438Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.218442Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2026-03-17T14:15:54.218458Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.218470Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2026-03-17T14:15:54.218473Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000001_00002?
2026-03-17T14:15:54.218485Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00000_0000000001_00002?
2026-03-17T14:15:54.218494Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000018_00000_0000000001_00002?
2026-03-17T14:15:54.218506Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000019_00000_0000000001_00002?
2026-03-17T14:15:54.218514Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00000_0000000001_00002?
2026-03-17T14:15:54.218532Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000021_00000_0000000001_00002?
2026-03-17T14:15:54.218539Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000001_00002?
2026-03-17T14:15:54.218547Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000023_00000_0000000001_00002?
2026-03-17T14:15:54.218557Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2026-03-17T14:15:54.218567Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 16 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:54.218866Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 17 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:54.219134Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 18 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.219394Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 19 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.219649Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 20 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.219957Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 21 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.220291Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 22 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.220606Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 23 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.221379Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.221771Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 23
    Offset: 23
    PartNo: 0
    WriteTimestampMS: 1773756954213
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.222998Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.226206Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6dd54126-a1fe1802-1d85e732-a755c063_24"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|6dd54126-a1fe1802-1d85e732-a755c063_24"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 24
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.222300Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2026-03-17T14:15:54.222324Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428648:3806] destroyed
2026-03-17T14:15:54.222335Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:444: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2026-03-17T14:15:54.222345Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000016_00000_0000000001_00002?
2026-03-17T14:15:54.222349Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.222352Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000016_00000_0000000001_00002?, parameters.CurOffset=16
2026-03-17T14:15:54.222356Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 16.0/3
2026-03-17T14:15:54.222365Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 0
2026-03-17T14:15:54.222371Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 16:0 appended
2026-03-17T14:15:54.222373Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 16.1/3
2026-03-17T14:15:54.222377Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 1
2026-03-17T14:15:54.222380Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 16:1 appended
2026-03-17T14:15:54.222381Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 16.2/3
2026-03-17T14:15:54.222385Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 2
2026-03-17T14:15:54.222634Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 16 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 1048790 count 1 nextOffset 17 batches 3
2026-03-17T14:15:54.222638Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 16:2 appended
2026-03-17T14:15:54.222642Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000017_00000_0000000001_00002?
2026-03-17T14:15:54.222647Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.222651Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000017_00000_0000000001_00002?, parameters.CurOffset=17
2026-03-17T14:15:54.222654Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 17.0/3
2026-03-17T14:15:54.222659Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 0
2026-03-17T14:15:54.222661Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 17:0 appended
2026-03-17T14:15:54.222665Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 17.1/3
2026-03-17T14:15:54.222668Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 1
2026-03-17T14:15:54.222670Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 17:1 appended
2026-03-17T14:15:54.222672Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 17.2/3
2026-03-17T14:15:54.222676Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 2
2026-03-17T14:15:54.223093Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 17 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2097545 count 2 nextOffset 18 batches 5
2026-03-17T14:15:54.223097Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 17:2 appended
2026-03-17T14:15:54.223100Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000018_00000_0000000001_00002?
2026-03-17T14:15:54.223102Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.223104Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000018_00000_0000000001_00002?, parameters.CurOffset=18
2026-03-17T14:15:54.223107Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 18.0/3
2026-03-17T14:15:54.223111Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 0
2026-03-17T14:15:54.223114Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 18:0 appended
2026-03-17T14:15:54.223116Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 18.1/3
2026-03-17T14:15:54.223119Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 1
2026-03-17T14:15:54.223121Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 18:1 appended
2026-03-17T14:15:54.223125Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 18.2/3
2026-03-17T14:15:54.223128Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 2
2026-03-17T14:15:54.223302Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 18 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 3146300 count 3 nextOffset 19 batches 7
2026-03-17T14:15:54.223306Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 18:2 appended
2026-03-17T14:15:54.223308Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000019_00000_0000000001_00002?
2026-03-17T14:15:54.223311Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.223313Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000019_00000_0000000001_00002?, parameters.CurOffset=19
2026-03-17T14:15:54.223316Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 19.0/3
2026-03-17T14:15:54.223322Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 0
2026-03-17T14:15:54.223324Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 19:0 appended
2026-03-17T14:15:54.223326Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 19.1/3
2026-03-17T14:15:54.223329Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 1
2026-03-17T14:15:54.223330Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 19:1 appended
2026-03-17T14:15:54.223333Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 19.2/3
2026-03-17T14:15:54.223336Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 2
2026-03-17T14:15:54.223370Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.223376Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.223380Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.223387Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.223390Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.223396Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.223399Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.223402Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.223538Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 19 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4195055 count 4 nextOffset 20 batches 9
2026-03-17T14:15:54.223544Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 19:2 appended
2026-03-17T14:15:54.223547Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000020_00000_0000000001_00002?
2026-03-17T14:15:54.223549Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.223552Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000020_00000_0000000001_00002?, parameters.CurOffset=20
2026-03-17T14:15:54.223555Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 20.0/3
2026-03-17T14:15:54.223563Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 0
2026-03-17T14:15:54.223565Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 20:0 appended
2026-03-17T14:15:54.223568Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 20.1/3
2026-03-17T14:15:54.223570Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 1
2026-03-17T14:15:54.223572Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 20:1 appended
2026-03-17T14:15:54.223575Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 20.2/3
2026-03-17T14:15:54.223577Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 2
2026-03-17T14:15:54.223744Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 20 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 5243810 count 5 nextOffset 21 batches 11
2026-03-17T14:15:54.223747Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 20:2 appended
2026-03-17T14:15:54.223750Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000021_00000_0000000001_00002?
2026-03-17T14:15:54.223752Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.223755Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000021_00000_0000000001_00002?, parameters.CurOffset=21
2026-03-17T14:15:54.223758Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 21.0/3
2026-03-17T14:15:54.223761Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 0
2026-03-17T14:15:54.223763Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 21:0 appended
2026-03-17T14:15:54.223765Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 21.1/3
2026-03-17T14:15:54.223773Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 1
2026-03-17T14:15:54.223775Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 21:1 appended
2026-03-17T14:15:54.223778Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 21.2/3
2026-03-17T14:15:54.223781Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 2
2026-03-17T14:15:54.223975Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 21 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 6292565 count 6 nextOffset 22 batches 13
2026-03-17T14:15:54.223980Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 21:2 appended
2026-03-17T14:15:54.223983Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000022_00000_0000000001_00002?
2026-03-17T14:15:54.223985Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.223988Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000022_00000_0000000001_00002?, parameters.CurOffset=22
2026-03-17T14:15:54.223991Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 22.0/3
2026-03-17T14:15:54.223994Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 0
2026-03-17T14:15:54.223999Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 22:0 appended
2026-03-17T14:15:54.224001Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 22.1/3
2026-03-17T14:15:54.224004Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 1
2026-03-17T14:15:54.224005Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 22:1 appended
2026-03-17T14:15:54.224008Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 22.2/3
2026-03-17T14:15:54.224013Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 2
2026-03-17T14:15:54.224167Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 22 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 7341320 count 7 nextOffset 23 batches 15
2026-03-17T14:15:54.224169Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 22:2 appended
2026-03-17T14:15:54.224172Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000023_00000_0000000001_00002?
2026-03-17T14:15:54.224174Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.224177Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000023_00000_0000000001_00002?, parameters.CurOffset=23
2026-03-17T14:15:54.224180Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 23.0/3
2026-03-17T14:15:54.224183Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 0
2026-03-17T14:15:54.225436Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 23 partNo 0 result is x0000000000_00000000000000000015_00001_0000000008_00015 size 7878063
2026-03-17T14:15:54.225453Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 23:0 appended
2026-03-17T14:15:54.225456Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 23.1/3
2026-03-17T14:15:54.225459Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 1
2026-03-17T14:15:54.225461Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 23:1 appended
2026-03-17T14:15:54.225463Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 23.2/3
2026-03-17T14:15:54.225467Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 2
2026-03-17T14:15:54.225478Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1106: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000015_00001_0000000008_00015 new key d0000000000_00000000000000000015_00001_0000000008_00015 size 7878063 WTime 1773756954225
2026-03-17T14:15:54.225687Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 23 partNo 2 FormedBlobsCount 1 NewHead: Offset 23 PartNo 0 PackedSize 1048790 count 1 nextOffset 24 batches 3
2026-03-17T14:15:54.225692Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 23:2 appended
2026-03-17T14:15:54.225752Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:634: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 23,1 HeadOffset 15 endOffset 16 curOffset 24 d0000000000_00000000000000000023_00000_0000000001_00002| size 1048780 WTime 1773756954225
2026-03-17T14:15:54.225895Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428653:3809], now have 1 active actors on pipe
2026-03-17T14:15:54.225915Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.225921Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.225936Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.225947Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 1 count 8 size 7878063
2026-03-17T14:15:54.225958Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.225989Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6dd54126-a1fe1802-1d85e732-a755c063_24 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.225998Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.226005Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.226010Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.226014Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.226017Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.226027Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.226029Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.226053Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.226068Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.226114Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.234797Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428653:3809] destroyed
2026-03-17T14:15:54.237806Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.238561Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428657:3811], now have 1 active actors on pipe
2026-03-17T14:15:54.240007Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.240031Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.260622Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.260717Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.260734Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.260740Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.262395Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.262407Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.262411Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.262415Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.262418Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.262437Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.262454Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.262457Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.262466Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.262469Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.262472Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.262474Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.262479Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.262517Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 0
2026-03-17T14:15:54.262538Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.262542Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 1
2026-03-17T14:15:54.262546Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.262552Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 2
2026-03-17T14:15:54.262801Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 24 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 1048790 count 1 nextOffset 25 batches 3
2026-03-17T14:15:54.262825Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.262829Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.262832Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.262900Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 24,1 HeadOffset 24 endOffset 24 curOffset 25 d0000000000_00000000000000000024_00000_0000000001_00002? size 1048780 WTime 1773756954262
2026-03-17T14:15:54.263246Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.263270Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.266383Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 15 count 8 size 7878063 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.266417Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 23 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.266442Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.266710Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:54.266729Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.266804Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0' size 7878063
2026-03-17T14:15:54.266821Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365339
2026-03-17T14:15:54.266826Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '124' size 1048780
2026-03-17T14:15:54.266876Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 0 size 8365339 cause it's been evicted from L2. Actual L1 size: 12
2026-03-17T14:15:54.266894Z node 25 :PERSQUEUE DEBUG: read.h:371: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, cookie 0
2026-03-17T14:15:54.268753Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 24 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.268787Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.268827Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.268846Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.268861Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 0, Offset: 24 is stored on disk
2026-03-17T14:15:54.268872Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.268878Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 1, Offset: 24 is stored on disk
2026-03-17T14:15:54.268887Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.268909Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 2, Offset: 24 is stored on disk
2026-03-17T14:15:54.268993Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.269012Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.269015Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.269021Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.269024Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.269036Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000015_00001_0000000001_00001|
2026-03-17T14:15:54.269047Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000016_00000_0000000001_00002?
2026-03-17T14:15:54.269051Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000017_00000_0000000001_00002?
2026-03-17T14:15:54.269054Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000018_00000_0000000001_00002?
2026-03-17T14:15:54.269058Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000019_00000_0000000001_00002?
2026-03-17T14:15:54.269061Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000020_00000_0000000001_00002?
2026-03-17T14:15:54.269065Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000021_00000_0000000001_00002?
2026-03-17T14:15:54.269069Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000022_00000_0000000001_00002?
2026-03-17T14:15:54.269074Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000023_00000_0000000001_00002?
2026-03-17T14:15:54.269127Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.269167Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.269188Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.269217Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000015_00001_0000000001_00001|(+) to d0000000000_00000000000000000015_00001_0000000001_00001|(+)
2026-03-17T14:15:54.269227Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000001_00002?(+) to d0000000000_00000000000000000016_00000_0000000001_00002?(+)
2026-03-17T14:15:54.269230Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00000_0000000001_00002?(+) to d0000000000_00000000000000000017_00000_0000000001_00002?(+)
2026-03-17T14:15:54.269234Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000001_00002?(+) to d0000000000_00000000000000000018_00000_0000000001_00002?(+)
2026-03-17T14:15:54.269237Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000019_00000_0000000001_00002?(+) to d0000000000_00000000000000000019_00000_0000000001_00002?(+)
2026-03-17T14:15:54.269241Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00000_0000000001_00002?(+) to d0000000000_00000000000000000020_00000_0000000001_00002?(+)
2026-03-17T14:15:54.269243Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00000_0000000001_00002?(+) to d0000000000_00000000000000000021_00000_0000000001_00002?(+)
2026-03-17T14:15:54.269246Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000001_00002?(+) to d0000000000_00000000000000000022_00000_0000000001_00002?(+)
2026-03-17T14:15:54.269249Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000001_00002?(+) to d0000000000_00000000000000000023_00000_0000000001_00002?(+)
2026-03-17T14:15:54.269614Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.269730Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.270182Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428657:3811] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 24
    Offset: 24
    PartNo: 0
    WriteTimestampMS: 1773756954262
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.270426Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 15 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270444Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 16 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270452Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 17 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270457Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 18 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270464Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 19 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270471Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 20 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270476Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 21 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270482Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 22 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270489Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 23 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.270510Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.270529Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.270530Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 1 parts 1 suffix '124' size 536753
2026-03-17T14:15:54.270545Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.270547Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.270551Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.270554Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.270558Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.270562Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.270566Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.270573Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.270585Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.270607Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.270633Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.270648Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.270662Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.270675Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.270840Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.271675Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.271355Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428665:3817], now have 1 active actors on pipe
2026-03-17T14:15:54.271502Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.271512Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.271550Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|41457c05-b7661696-7b0cb90d-de388dac_25 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.271561Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.271565Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.271571Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.271574Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.271579Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.271593Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.271596Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.271600Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.271618Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.271634Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|41457c05-b7661696-7b0cb90d-de388dac_25"
    Status: Active
    SeqNo: 0
  }
}
2026-03-17T14:15:54.271944Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428665:3817] destroyed
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|41457c05-b7661696-7b0cb90d-de388dac_25"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 25
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.278662Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.282331Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428669:3819], now have 1 active actors on pipe
2026-03-17T14:15:54.285790Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.285824Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.300979Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.301069Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.301081Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.301087Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.302992Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.303022Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.303027Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.303038Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.303041Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.303046Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.303050Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.303057Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.303091Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 0
2026-03-17T14:15:54.303110Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.303115Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 1
2026-03-17T14:15:54.303118Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.303122Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 2
2026-03-17T14:15:54.303368Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 25 partNo 2 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 1048790 count 1 nextOffset 26 batches 3
2026-03-17T14:15:54.303385Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.303388Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.303392Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.303472Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 25,1 HeadOffset 25 endOffset 25 curOffset 26 d0000000000_00000000000000000025_00000_0000000001_00002? size 1048780 WTime 1773756954303
2026-03-17T14:15:54.303625Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.303639Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.308478Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 25 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.308517Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.308625Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.308637Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.308648Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 0, Offset: 25 is stored on disk
2026-03-17T14:15:54.308653Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.308658Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 1, Offset: 25 is stored on disk
2026-03-17T14:15:54.308664Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.308669Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 2, Offset: 25 is stored on disk
2026-03-17T14:15:54.308726Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.308730Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.308732Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.308737Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.308739Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.308751Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.308771Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.310490Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.310294Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.311301Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428669:3819] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 25
    Offset: 25
    PartNo: 0
    WriteTimestampMS: 1773756954302
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.314039Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.322233Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428676:3824], now have 1 active actors on pipe
2026-03-17T14:15:54.322287Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.322297Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.322357Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b2be1dc4-ee7e353c-c2fc8bf-271240ff_26 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.322373Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.322378Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.322385Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.322389Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.322394Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.322409Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.322412Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.322416Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.322437Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.322463Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.336157Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b2be1dc4-ee7e353c-c2fc8bf-271240ff_26"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:54.338420Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428676:3824] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b2be1dc4-ee7e353c-c2fc8bf-271240ff_26"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 26
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.343715Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.345212Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428679:3825], now have 1 active actors on pipe
2026-03-17T14:15:54.346992Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.347019Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.362239Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.362328Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.362344Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.362350Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.364204Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.364212Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.364215Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.364219Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.364222Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.364239Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.364257Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.364261Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.364271Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.364278Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.364282Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.364285Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.364289Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.364327Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 0
2026-03-17T14:15:54.364340Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.364344Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 1
2026-03-17T14:15:54.364348Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.364350Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 2
2026-03-17T14:15:54.364584Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 26 partNo 2 FormedBlobsCount 0 NewHead: Offset 26 PartNo 0 PackedSize 1048790 count 1 nextOffset 27 batches 3
2026-03-17T14:15:54.364595Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.364599Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.364602Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.364681Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 26,1 HeadOffset 26 endOffset 26 curOffset 27 d0000000000_00000000000000000026_00000_0000000001_00002? size 1048780 WTime 1773756954364
2026-03-17T14:15:54.364828Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.364841Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 26 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.386673Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 26 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.386704Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.386741Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.386750Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.386763Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 0, Offset: 26 is stored on disk
2026-03-17T14:15:54.386769Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.386776Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 1, Offset: 26 is stored on disk
2026-03-17T14:15:54.386783Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.386787Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 2, Offset: 26 is stored on disk
2026-03-17T14:15:54.386839Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.386843Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.386845Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.386849Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.386851Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.386860Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.386879Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.387034Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.388172Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 26
    Offset: 26
    PartNo: 0
    WriteTimestampMS: 1773756954364
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 22
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.389179Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428679:3825] destroyed
2026-03-17T14:15:54.389712Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.390446Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428685:3829], now have 1 active actors on pipe
2026-03-17T14:15:54.390647Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.390662Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.390706Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6a18a482-b554c5a2-ef746bfe-e310e89f_27 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.390729Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.390733Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.390740Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.390748Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.390754Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.390767Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.390770Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.390774Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.390793Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.390813Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.390983Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6a18a482-b554c5a2-ef746bfe-e310e89f_27"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|6a18a482-b554c5a2-ef746bfe-e310e89f_27"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 27
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.395383Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428685:3829] destroyed
2026-03-17T14:15:54.397975Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.398511Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428688:3830], now have 1 active actors on pipe
2026-03-17T14:15:54.399902Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.399923Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.412774Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.412858Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.412873Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.412879Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.414466Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.414497Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.414501Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.414514Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.414517Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.414522Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.414526Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.414532Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.414568Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 0
2026-03-17T14:15:54.414587Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.414590Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 1
2026-03-17T14:15:54.414595Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.414598Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 2
2026-03-17T14:15:54.414842Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 27 partNo 2 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 1048790 count 1 nextOffset 28 batches 3
2026-03-17T14:15:54.414867Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.414870Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.414874Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.414952Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 27,1 HeadOffset 27 endOffset 27 curOffset 28 d0000000000_00000000000000000027_00000_0000000001_00002? size 1048780 WTime 1773756954414
2026-03-17T14:15:54.415117Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.415142Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.422419Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 27 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.422452Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.422470Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.422490Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.422505Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.422519Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 0, Offset: 27 is stored on disk
2026-03-17T14:15:54.422528Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.422535Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 1, Offset: 27 is stored on disk
2026-03-17T14:15:54.422547Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.422553Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 2, Offset: 27 is stored on disk
2026-03-17T14:15:54.422596Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.422614Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.422616Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.422619Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.422621Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.422631Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.422649Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.422747Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 27
    Offset: 27
    PartNo: 0
    WriteTimestampMS: 1773756954414
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:54.423226Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428688:3830] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.423889Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.424307Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428696:3834], now have 1 active actors on pipe
2026-03-17T14:15:54.424450Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.424462Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.424498Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|c6895e29-3d1c85fd-b099924a-87afed87_28 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.424513Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.424517Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.424525Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.424528Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.424532Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.424650Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.424552Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.424561Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.424565Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.424579Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.424592Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|c6895e29-3d1c85fd-b099924a-87afed87_28"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
2026-03-17T14:15:54.425086Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428696:3834] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|c6895e29-3d1c85fd-b099924a-87afed87_28"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 28
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.430898Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.431459Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428699:3835], now have 1 active actors on pipe
2026-03-17T14:15:54.432635Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.432655Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.443123Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.443222Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.443238Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.443249Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.444841Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.444879Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.444887Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.444900Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.444902Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.444907Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.444910Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.444916Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.444960Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 0
2026-03-17T14:15:54.444975Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.444979Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 1
2026-03-17T14:15:54.444982Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.444985Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 2
2026-03-17T14:15:54.445233Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 28 partNo 2 FormedBlobsCount 0 NewHead: Offset 28 PartNo 0 PackedSize 1048790 count 1 nextOffset 29 batches 3
2026-03-17T14:15:54.445248Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.445252Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.445255Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.445333Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 28,1 HeadOffset 28 endOffset 28 curOffset 29 d0000000000_00000000000000000028_00000_0000000001_00002? size 1048780 WTime 1773756954445
2026-03-17T14:15:54.445510Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.445525Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.450026Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 28 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.450059Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.450085Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.450091Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.450098Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.450103Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 0, Offset: 28 is stored on disk
2026-03-17T14:15:54.450107Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.450110Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 1, Offset: 28 is stored on disk
2026-03-17T14:15:54.450114Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.450119Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 2, Offset: 28 is stored on disk
2026-03-17T14:15:54.450162Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.450171Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.450173Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.450176Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.450178Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.450189Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.450208Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.450348Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.450761Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428699:3835] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 28
    Offset: 28
    PartNo: 0
    WriteTimestampMS: 1773756954444
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.451620Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.452148Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428704:3838], now have 1 active actors on pipe
2026-03-17T14:15:54.452272Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.452282Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.452335Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|31bd61ab-c11ebcde-9323ca10-fdcae5b1_29 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.452351Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.452362Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.452367Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.452376Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.452380Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.452391Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.452395Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.452399Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.452414Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.452433Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.452500Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.452739Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428704:3838] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|31bd61ab-c11ebcde-9323ca10-fdcae5b1_29"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|31bd61ab-c11ebcde-9323ca10-fdcae5b1_29"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 29
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.462317Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.462968Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428709:3839], now have 1 active actors on pipe
2026-03-17T14:15:54.464629Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.464662Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.474855Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.474949Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.474961Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.474972Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.476778Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.476803Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.476805Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.476807Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.476809Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.476823Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.476839Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.476846Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.476855Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.476861Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.476863Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.476864Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.476867Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.476902Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 0
2026-03-17T14:15:54.476917Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.476919Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 1
2026-03-17T14:15:54.476926Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.476928Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 2
2026-03-17T14:15:54.477172Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 29 partNo 2 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 1048790 count 1 nextOffset 30 batches 3
2026-03-17T14:15:54.477194Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.477196Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.477200Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.477253Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 29,1 HeadOffset 29 endOffset 29 curOffset 30 d0000000000_00000000000000000029_00000_0000000001_00002? size 1048780 WTime 1773756954476
2026-03-17T14:15:54.477422Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.477441Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 29 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.481413Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 29 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.481460Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.481483Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.481496Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.481507Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.481521Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 0, Offset: 29 is stored on disk
2026-03-17T14:15:54.481527Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.481533Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 1, Offset: 29 is stored on disk
2026-03-17T14:15:54.481550Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.481559Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 2, Offset: 29 is stored on disk
2026-03-17T14:15:54.481602Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.481614Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.481617Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.481619Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.481621Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.481635Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.481660Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.481741Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.482091Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428709:3839] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 29
    Offset: 29
    PartNo: 0
    WriteTimestampMS: 1773756954476
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.482868Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.483246Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428714:3844], now have 1 active actors on pipe
2026-03-17T14:15:54.483305Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.483313Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.483358Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cd1074bd-1b28bdd5-3c2baf4f-36fc11e1_30 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.483369Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.483373Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.483378Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.483380Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.483385Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.483397Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.483400Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.483403Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.483499Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.483418Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.483432Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.483705Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428714:3844] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cd1074bd-1b28bdd5-3c2baf4f-36fc11e1_30"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|cd1074bd-1b28bdd5-3c2baf4f-36fc11e1_30"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 30
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.488835Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.489369Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428717:3845], now have 1 active actors on pipe
2026-03-17T14:15:54.490918Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.490948Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.501711Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.501783Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.501793Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.501798Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.503293Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.503329Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.503334Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.503345Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.503352Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.503361Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.503364Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.503371Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.503414Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 0
2026-03-17T14:15:54.503431Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.503434Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 1
2026-03-17T14:15:54.503438Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.503441Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 2
2026-03-17T14:15:54.503696Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 30 partNo 2 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1048790 count 1 nextOffset 31 batches 3
2026-03-17T14:15:54.503717Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.503722Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.503726Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.503803Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 30,1 HeadOffset 30 endOffset 30 curOffset 31 d0000000000_00000000000000000030_00000_0000000001_00002? size 1048780 WTime 1773756954503
2026-03-17T14:15:54.503994Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.504013Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.506972Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 30 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.506998Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.507019Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.507026Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.507035Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.507047Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 0, Offset: 30 is stored on disk
2026-03-17T14:15:54.507052Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.507062Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 1, Offset: 30 is stored on disk
2026-03-17T14:15:54.507068Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.507077Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 2, Offset: 30 is stored on disk
2026-03-17T14:15:54.507109Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.507120Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.507123Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.507126Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.507129Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.507139Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.507174Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.507258Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 30
    Offset: 30
    PartNo: 0
    WriteTimestampMS: 1773756954502
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.507648Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428717:3845] destroyed
2026-03-17T14:15:54.508220Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.508598Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428722:3848], now have 1 active actors on pipe
2026-03-17T14:15:54.508729Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.508748Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.508799Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|597c0249-d3d67aad-b9c3de5d-c0171833_31 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.508816Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.508819Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.508824Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.508827Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.508831Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.508848Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.508852Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.508855Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.508871Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.508892Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.508973Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|597c0249-d3d67aad-b9c3de5d-c0171833_31"
    Status: Active
    SeqNo: 0
  }
}
2026-03-17T14:15:54.509344Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428722:3848] destroyed
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|597c0249-d3d67aad-b9c3de5d-c0171833_31"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 31
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.515271Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.515893Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428725:3849], now have 1 active actors on pipe
2026-03-17T14:15:54.517324Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.517352Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.529403Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.529498Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.529515Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.529527Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.531633Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.531673Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.531677Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.531687Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.531690Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.531699Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.531701Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.531707Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.531745Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 0
2026-03-17T14:15:54.531771Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.531780Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 1
2026-03-17T14:15:54.531784Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.531788Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 2
2026-03-17T14:15:54.532066Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 31 partNo 2 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 1048790 count 1 nextOffset 32 batches 3
2026-03-17T14:15:54.532090Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.532092Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.532094Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.532145Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 31,1 HeadOffset 31 endOffset 31 curOffset 32 d0000000000_00000000000000000031_00000_0000000001_00002? size 1048780 WTime 1773756954532
2026-03-17T14:15:54.532297Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.532315Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 31 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.535135Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 31 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.535174Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.535196Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.535207Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.535213Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.535231Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 0, Offset: 31 is stored on disk
2026-03-17T14:15:54.535244Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.535249Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 1, Offset: 31 is stored on disk
2026-03-17T14:15:54.535256Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.535262Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 2, Offset: 31 is stored on disk
2026-03-17T14:15:54.535299Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.535308Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.535311Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.535316Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.535318Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.535331Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000024_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.535340Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.535343Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000026_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.535346Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.535349Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.535355Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000029_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.535357Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.535359Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000031_00000_0000000001_00002? (1048780)
2026-03-17T14:15:54.535363Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2026-03-17T14:15:54.535383Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.535403Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2026-03-17T14:15:54.535410Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000024_00000_0000000001_00002?
2026-03-17T14:15:54.535419Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000001_00002?
2026-03-17T14:15:54.535430Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000026_00000_0000000001_00002?
2026-03-17T14:15:54.535451Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000001_00002?
2026-03-17T14:15:54.535464Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00000_0000000001_00002?
2026-03-17T14:15:54.535482Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000029_00000_0000000001_00002?
2026-03-17T14:15:54.535494Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000001_00002?
2026-03-17T14:15:54.535502Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000031_00000_0000000001_00002?
2026-03-17T14:15:54.535516Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2026-03-17T14:15:54.535533Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 24 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.535502Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.535916Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 25 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 31
    Offset: 31
    PartNo: 0
    WriteTimestampMS: 1773756954531
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
>>>>> 1
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 0
    Count: 16
    ReadTimestampMs: 0
  }
}
2026-03-17T14:15:54.536238Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 26 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.536700Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 27 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.536850Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.537025Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 28 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.537351Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 29 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.537676Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 30 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.537993Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 31 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.538322Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2026-03-17T14:15:54.538350Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.538358Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.538361Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428725:3849] destroyed
2026-03-17T14:15:54.538362Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.538366Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.538370Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.538372Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428731:3853], now have 1 active actors on pipe
2026-03-17T14:15:54.538374Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.538378Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.538387Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:54.538404Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.538411Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.538443Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:444: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2026-03-17T14:15:54.538475Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000024_00000_0000000001_00002?
2026-03-17T14:15:54.538483Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.538487Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000024_00000_0000000001_00002?, parameters.CurOffset=24
2026-03-17T14:15:54.538491Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 24.0/3
2026-03-17T14:15:54.538500Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 0
2026-03-17T14:15:54.538510Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 24:0 appended
2026-03-17T14:15:54.538513Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 24.1/3
2026-03-17T14:15:54.538517Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 1
2026-03-17T14:15:54.538519Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 24:1 appended
2026-03-17T14:15:54.538521Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 24.2/3
2026-03-17T14:15:54.538525Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 2
2026-03-17T14:15:54.538753Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 24 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 1048790 count 1 nextOffset 25 batches 3
2026-03-17T14:15:54.538777Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 24:2 appended
2026-03-17T14:15:54.538781Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000025_00000_0000000001_00002?
2026-03-17T14:15:54.538783Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.538787Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000025_00000_0000000001_00002?, parameters.CurOffset=25
2026-03-17T14:15:54.538790Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 25.0/3
2026-03-17T14:15:54.538796Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 0
2026-03-17T14:15:54.538799Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 25:0 appended
2026-03-17T14:15:54.538801Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 25.1/3
2026-03-17T14:15:54.538804Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 1
2026-03-17T14:15:54.538806Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 25:1 appended
2026-03-17T14:15:54.538808Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 25.2/3
2026-03-17T14:15:54.538811Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 2
2026-03-17T14:15:54.539013Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 25 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 2097545 count 2 nextOffset 26 batches 5
2026-03-17T14:15:54.539030Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 25:2 appended
2026-03-17T14:15:54.539039Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000026_00000_0000000001_00002?
2026-03-17T14:15:54.539042Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.539046Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000026_00000_0000000001_00002?, parameters.CurOffset=26
2026-03-17T14:15:54.539054Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 26.0/3
2026-03-17T14:15:54.539061Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 0
2026-03-17T14:15:54.539070Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 26:0 appended
2026-03-17T14:15:54.539072Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 26.1/3
2026-03-17T14:15:54.539081Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 1
2026-03-17T14:15:54.539087Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 26:1 appended
2026-03-17T14:15:54.539089Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 26.2/3
2026-03-17T14:15:54.539092Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 2
2026-03-17T14:15:54.539278Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 26 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 3146300 count 3 nextOffset 27 batches 7
2026-03-17T14:15:54.539298Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 26:2 appended
2026-03-17T14:15:54.539302Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000027_00000_0000000001_00002?
2026-03-17T14:15:54.539304Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.539308Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000027_00000_0000000001_00002?, parameters.CurOffset=27
2026-03-17T14:15:54.539311Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 27.0/3
2026-03-17T14:15:54.539315Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 0
2026-03-17T14:15:54.539318Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 27:0 appended
2026-03-17T14:15:54.539320Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 27.1/3
2026-03-17T14:15:54.539323Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 1
2026-03-17T14:15:54.539325Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 27:1 appended
2026-03-17T14:15:54.539327Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 27.2/3
2026-03-17T14:15:54.539331Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 2
2026-03-17T14:15:54.539515Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 27 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 4195055 count 4 nextOffset 28 batches 9
2026-03-17T14:15:54.539536Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 27:2 appended
2026-03-17T14:15:54.539539Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000028_00000_0000000001_00002?
2026-03-17T14:15:54.539541Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.539546Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000028_00000_0000000001_00002?, parameters.CurOffset=28
2026-03-17T14:15:54.539549Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 28.0/3
2026-03-17T14:15:54.539552Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 0
2026-03-17T14:15:54.539555Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 28:0 appended
2026-03-17T14:15:54.539557Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 28.1/3
2026-03-17T14:15:54.539559Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 1
2026-03-17T14:15:54.539561Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 28:1 appended
2026-03-17T14:15:54.539564Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 28.2/3
2026-03-17T14:15:54.539566Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 2
2026-03-17T14:15:54.539741Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 28 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 5243810 count 5 nextOffset 29 batches 11
2026-03-17T14:15:54.539755Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 28:2 appended
2026-03-17T14:15:54.539758Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000029_00000_0000000001_00002?
2026-03-17T14:15:54.539760Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.539763Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000029_00000_0000000001_00002?, parameters.CurOffset=29
2026-03-17T14:15:54.539766Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 29.0/3
2026-03-17T14:15:54.539769Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 0
2026-03-17T14:15:54.539771Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 29:0 appended
2026-03-17T14:15:54.539774Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 29.1/3
2026-03-17T14:15:54.539777Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 1
2026-03-17T14:15:54.539778Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 29:1 appended
2026-03-17T14:15:54.539783Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 29.2/3
2026-03-17T14:15:54.539785Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 2
2026-03-17T14:15:54.539984Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 29 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 6292565 count 6 nextOffset 30 batches 13
2026-03-17T14:15:54.540000Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 29:2 appended
2026-03-17T14:15:54.540004Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000030_00000_0000000001_00002?
2026-03-17T14:15:54.540005Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.540009Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000030_00000_0000000001_00002?, parameters.CurOffset=30
2026-03-17T14:15:54.540012Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 30.0/3
2026-03-17T14:15:54.540016Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 0
2026-03-17T14:15:54.540019Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 30:0 appended
2026-03-17T14:15:54.540021Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 30.1/3
2026-03-17T14:15:54.540024Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 1
2026-03-17T14:15:54.540026Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 30:1 appended
2026-03-17T14:15:54.540029Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 30.2/3
2026-03-17T14:15:54.540032Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 2
2026-03-17T14:15:54.541280Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 30 partNo 2 result is x0000000000_00000000000000000023_00000_0000000007_00016 size 8365364
2026-03-17T14:15:54.541309Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1106: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000023_00000_0000000007_00016 new key d0000000000_00000000000000000023_00000_0000000007_00016 size 8365364 WTime 1773756954540
2026-03-17T14:15:54.541342Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 30 partNo 2 FormedBlobsCount 1 NewHead: Offset 30 PartNo 2 PackedSize 24736 count 1 nextOffset 31 batches 1
2026-03-17T14:15:54.541347Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 30:2 appended
2026-03-17T14:15:54.541357Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000031_00000_0000000001_00002?
2026-03-17T14:15:54.541360Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:54.541365Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000031_00000_0000000001_00002?, parameters.CurOffset=31
2026-03-17T14:15:54.541376Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 31.0/3
2026-03-17T14:15:54.541380Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 0
2026-03-17T14:15:54.541384Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 31:0 appended
2026-03-17T14:15:54.541386Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 31.1/3
2026-03-17T14:15:54.541389Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 1
2026-03-17T14:15:54.541391Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 31:1 appended
2026-03-17T14:15:54.541393Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 31.2/3
2026-03-17T14:15:54.541396Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 2
2026-03-17T14:15:54.541567Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 31 partNo 2 FormedBlobsCount 0 NewHead: Offset 30 PartNo 2 PackedSize 1073491 count 2 nextOffset 32 batches 3
2026-03-17T14:15:54.541581Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 31:2 appended
2026-03-17T14:15:54.541636Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:634: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 30,2 HeadOffset 23 endOffset 24 curOffset 32 d0000000000_00000000000000000030_00002_0000000002_00002| size 1073481 WTime 1773756954541
2026-03-17T14:15:54.541799Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.541825Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 7 size 8365364
2026-03-17T14:15:54.541833Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 2 count 2 size 1073481
2026-03-17T14:15:54.541896Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:891: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 16 size 26214400 endOffset 32 max time lag 0ms effective offset 0
2026-03-17T14:15:54.542094Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1116: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 3 blobs, size 25145475 count 24 last offset 15, current partition end offset: 32
2026-03-17T14:15:54.542111Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1132: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2026-03-17T14:15:54.542177Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:464: No blob in L1. Partition 0 offset 0 partno 0 count 7 parts_count 16 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.542183Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 7 partno 2 count 8 parts_count 15 source 1 size 7878063 accessed 0 times before, last time 2026-03-17T14:15:53.000000Z
2026-03-17T14:15:54.544455Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.556601Z node 25 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 1 of 3 from KV
2026-03-17T14:15:54.556626Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0'
2026-03-17T14:15:54.556635Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2026-03-17T14:15:54.556645Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 7 parts_count 16
2026-03-17T14:15:54.557999Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 23 count 7 size 8365364 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.558026Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 30 count 2 size 1073481 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.558049Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.558065Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '124' size 1048780
2026-03-17T14:15:54.558072Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2026-03-17T14:15:54.558077Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.558080Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 2 parts 2 suffix '124' size 1073481
2026-03-17T14:15:54.558733Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.558751Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.558754Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.558757Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.558760Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.558769Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000023_00000_0000000001_00002|
2026-03-17T14:15:54.558775Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000024_00000_0000000001_00002?
2026-03-17T14:15:54.558780Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000025_00000_0000000001_00002?
2026-03-17T14:15:54.558784Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000026_00000_0000000001_00002?
2026-03-17T14:15:54.558787Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000027_00000_0000000001_00002?
2026-03-17T14:15:54.558791Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000028_00000_0000000001_00002?
2026-03-17T14:15:54.558795Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000029_00000_0000000001_00002?
2026-03-17T14:15:54.558799Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000030_00000_0000000001_00002?
2026-03-17T14:15:54.558804Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000031_00000_0000000001_00002?
2026-03-17T14:15:54.558824Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.558838Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 23 size 1048780 cause it's been evicted from L2. Actual L1 size: 12
2026-03-17T14:15:54.558841Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 24 size 1048780 cause it's been evicted from L2. Actual L1 size: 11
2026-03-17T14:15:54.558846Z node 25 :PERSQUEUE DEBUG: read.h:371: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, cookie 0
2026-03-17T14:15:54.558875Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.558891Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000001_00002|(+) to d0000000000_00000000000000000023_00000_0000000001_00002|(+)
2026-03-17T14:15:54.558896Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000024_00000_0000000001_00002?(+) to d0000000000_00000000000000000024_00000_0000000001_00002?(+)
2026-03-17T14:15:54.558900Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000001_00002?(+) to d0000000000_00000000000000000025_00000_0000000001_00002?(+)
2026-03-17T14:15:54.558905Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000026_00000_0000000001_00002?(+) to d0000000000_00000000000000000026_00000_0000000001_00002?(+)
2026-03-17T14:15:54.558907Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000001_00002?(+) to d0000000000_00000000000000000027_00000_0000000001_00002?(+)
2026-03-17T14:15:54.558909Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00000_0000000001_00002?(+) to d0000000000_00000000000000000028_00000_0000000001_00002?(+)
2026-03-17T14:15:54.558913Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000029_00000_0000000001_00002?(+) to d0000000000_00000000000000000029_00000_0000000001_00002?(+)
2026-03-17T14:15:54.558915Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00000_0000000001_00002?(+) to d0000000000_00000000000000000030_00000_0000000001_00002?(+)
2026-03-17T14:15:54.558918Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000031_00000_0000000001_00002?(+) to d0000000000_00000000000000000031_00000_0000000001_00002?(+)
2026-03-17T14:15:54.562540Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 25 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.562577Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 26 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.562582Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 27 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.562588Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 28 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.562597Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 29 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.562601Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 30 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.562605Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:361: Deleting head blob in L1. Partition 0 offset 31 count 1 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.562626Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.562645Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.562663Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.562675Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.562687Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.562690Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.562693Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.562697Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.562709Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.562711Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.562730Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.562746Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.562769Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.562791Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.562806Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.570061Z node 25 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2026-03-17T14:15:54.570093Z node 25 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2026-03-17T14:15:54.570116Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:398: Prefetched blob in L1. Partition 0 offset 0 count 7 size 8365339 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.570182Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:580: FormAnswer for 3 blobs
2026-03-17T14:15:54.570194Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2026-03-17T14:15:54.570202Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365339
2026-03-17T14:15:54.573126Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573161Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573169Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573179Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 1 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573183Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 1 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573187Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 2 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573191Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 2 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573195Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 3 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573199Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 3 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573205Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 4 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573209Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 4 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573220Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 5 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573223Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 5 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573227Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 6 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573231Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 6 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:54.573234Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 7 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2026-03-17T14:15:54.573242Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 7 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:54.573246Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573249Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573252Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573257Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573260Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573264Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573268Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573276Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573279Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573285Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573291Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573294Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573297Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.573301Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573306Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:54.573309Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573316Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.573321Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:54.573400Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 7 size 7878063 cause it's been evicted from L2. Actual L1 size: 4
2026-03-17T14:15:54.573422Z node 25 :PERSQUEUE DEBUG: read.h:371: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, cookie 0
2026-03-17T14:15:54.573604Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.583719Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.583734Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.583737Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.583741Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.583744Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.598567Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.608322Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428731:3853] destroyed
CallPersQueueGRPC response:
2026-03-17T14:15:54.683247Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.683271Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.683274Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.683286Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.683290Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 32
    Result {
      Offset: 0
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 2
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 16
    Count: 16
    ReadTimestampMs: 0
  }
}
2026-03-17T14:15:54.692964Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.693677Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428745:3864], now have 1 active actors on pipe
2026-03-17T14:15:54.693849Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.693869Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.693935Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:891: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 16 partno 0 count 16 size 26214400 endOffset 32 max time lag 0ms effective offset 16
2026-03-17T14:15:54.694448Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1116: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 2 blobs, size 9438782 count 16 last offset 23, current partition end offset: 32
2026-03-17T14:15:54.694455Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1132: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2026-03-17T14:15:54.694483Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 1 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.694490Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 23 partno 0 count 7 parts_count 16 source 1 size 8365364 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:54.701277Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 2 blobs are from cache.
2026-03-17T14:15:54.701344Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:580: FormAnswer for 2 blobs
2026-03-17T14:15:54.701371Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701387Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701393Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701403Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701413Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701421Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701427Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701435Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701440Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701449Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701455Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701462Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 21 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701467Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 21 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701474Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 22 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701479Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 22 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:54.701487Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701503Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701510Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 23 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:54.701515Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701520Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701531Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701535Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701540Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701545Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701550Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701554Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701557Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701563Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701566Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:54.701571Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:54.701574Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:54.701577Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2026-03-17T14:15:54.701696Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.702055Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2026-03-17T14:15:54.702065Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0'
2026-03-17T14:15:54.727353Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.736279Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428745:3864] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 32
    Result {
      Offset: 16
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.780008Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.780607Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428748:3865], now have 1 active actors on pipe
2026-03-17T14:15:54.780780Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.780792Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.780838Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|193cadc1-a8e50e49-eb65eff9-1a4a46be_32 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.780856Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.780859Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.780865Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.780867Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.780870Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.780886Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.780892Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.780894Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.780911Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.780932Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.781009Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.781259Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428748:3865] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|193cadc1-a8e50e49-eb65eff9-1a4a46be_32"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|193cadc1-a8e50e49-eb65eff9-1a4a46be_32"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 32
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.783571Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.783593Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.783595Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.783599Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.783601Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.786451Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.787063Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428751:3866], now have 1 active actors on pipe
2026-03-17T14:15:54.788421Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.788444Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.798549Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.798635Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.798654Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.798664Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.800238Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.800269Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.800272Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.800280Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.800283Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.800287Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.800290Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.800294Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.800327Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 0
2026-03-17T14:15:54.800339Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.800342Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 1
2026-03-17T14:15:54.800345Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.800347Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 2
2026-03-17T14:15:54.800553Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 32 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 1048790 count 1 nextOffset 33 batches 3
2026-03-17T14:15:54.800576Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.800579Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.800581Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.800634Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 32,1 HeadOffset 32 endOffset 32 curOffset 33 d0000000000_00000000000000000032_00000_0000000001_00002? size 1048780 WTime 1773756954800
2026-03-17T14:15:54.800782Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.800804Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.804158Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 32 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.804186Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.804203Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.804211Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.804220Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.804228Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 0, Offset: 32 is stored on disk
2026-03-17T14:15:54.804232Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.804235Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 1, Offset: 32 is stored on disk
2026-03-17T14:15:54.804239Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.804243Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 2, Offset: 32 is stored on disk
2026-03-17T14:15:54.804265Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.804267Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.804269Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.804273Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.804275Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.804281Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.804294Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.804374Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.804713Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428751:3866] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 32
    Offset: 32
    PartNo: 0
    WriteTimestampMS: 1773756954799
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.805346Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.805728Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428758:3871], now have 1 active actors on pipe
2026-03-17T14:15:54.805843Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.805855Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.805882Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|1caaf1a7-72f7bb17-3ce19d03-90a9b246_33 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.805894Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.805897Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.805900Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.805902Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.805904Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.805910Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.805913Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.805914Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.805923Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.805931Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.805969Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.806176Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428758:3871] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|1caaf1a7-72f7bb17-3ce19d03-90a9b246_33"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|1caaf1a7-72f7bb17-3ce19d03-90a9b246_33"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 33
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.812489Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.812976Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428761:3872], now have 1 active actors on pipe
2026-03-17T14:15:54.813791Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.813805Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.821877Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.821953Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.821961Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.821965Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.823309Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.823338Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.823342Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.823350Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.823357Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.823360Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.823362Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.823366Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.823399Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 0
2026-03-17T14:15:54.823414Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.823421Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 1
2026-03-17T14:15:54.823424Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.823426Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 2
2026-03-17T14:15:54.823612Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 33 partNo 2 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 1048790 count 1 nextOffset 34 batches 3
2026-03-17T14:15:54.823632Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.823638Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.823640Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.823692Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 33,1 HeadOffset 33 endOffset 33 curOffset 34 d0000000000_00000000000000000033_00000_0000000001_00002? size 1048780 WTime 1773756954823
2026-03-17T14:15:54.823854Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.823868Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.826830Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 33 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.826855Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.826877Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.826877Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.826889Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.826897Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 0, Offset: 33 is stored on disk
2026-03-17T14:15:54.826904Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.826908Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 1, Offset: 33 is stored on disk
2026-03-17T14:15:54.826913Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.826915Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 2, Offset: 33 is stored on disk
2026-03-17T14:15:54.826938Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.826939Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.826942Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.826944Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.826945Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.826951Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.826965Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.827074Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.827513Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428761:3872] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 33
    Offset: 33
    PartNo: 0
    WriteTimestampMS: 1773756954822
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.828314Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.828696Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428766:3875], now have 1 active actors on pipe
2026-03-17T14:15:54.828781Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.828791Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.828822Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5f5fc2c5-80527d3c-352c6a75-2a23e70e_34 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.828834Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.828837Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.828842Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.828844Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.828848Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.828855Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.828858Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.828861Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.828871Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.828884Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.828986Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.829209Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428766:3875] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5f5fc2c5-80527d3c-352c6a75-2a23e70e_34"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|5f5fc2c5-80527d3c-352c6a75-2a23e70e_34"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 34
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.835110Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.835531Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428769:3876], now have 1 active actors on pipe
2026-03-17T14:15:54.836419Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.836435Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.846772Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.846835Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.846843Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.846852Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.848169Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.848194Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.848198Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.848206Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.848208Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.848211Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.848213Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.848217Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.848246Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 0
2026-03-17T14:15:54.848256Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.848263Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 1
2026-03-17T14:15:54.848267Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.848269Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 2
2026-03-17T14:15:54.848449Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 34 partNo 2 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 1048790 count 1 nextOffset 35 batches 3
2026-03-17T14:15:54.848463Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.848465Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.848468Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.848524Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 34,1 HeadOffset 34 endOffset 34 curOffset 35 d0000000000_00000000000000000034_00000_0000000001_00002? size 1048780 WTime 1773756954848
2026-03-17T14:15:54.848682Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.848701Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 34 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.851874Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 34 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.851903Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.851917Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.851929Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.851937Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.851948Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 0, Offset: 34 is stored on disk
2026-03-17T14:15:54.851959Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.851968Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 1, Offset: 34 is stored on disk
2026-03-17T14:15:54.851974Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.851979Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 2, Offset: 34 is stored on disk
2026-03-17T14:15:54.852009Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.852019Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.852021Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.852024Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.852026Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.852035Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.852051Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.852162Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.852516Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428769:3876] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 34
    Offset: 34
    PartNo: 0
    WriteTimestampMS: 1773756954848
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.853314Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.853710Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428775:3880], now have 1 active actors on pipe
2026-03-17T14:15:54.853823Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.853834Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.853868Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e27722fd-745253b2-3e593bc-c6c23b52_35 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.853881Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.853884Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.853889Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.853896Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.853900Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.853909Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.853912Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.853914Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.853927Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.853946Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.854005Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.854260Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428775:3880] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e27722fd-745253b2-3e593bc-c6c23b52_35"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e27722fd-745253b2-3e593bc-c6c23b52_35"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 35
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.861198Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.861740Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428781:3881], now have 1 active actors on pipe
2026-03-17T14:15:54.862907Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.862927Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.879567Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.879641Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.879651Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.879658Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.881445Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.881482Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.881486Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.881504Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.881507Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.881513Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.881515Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.881522Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.881561Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 0
2026-03-17T14:15:54.881581Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.881590Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 1
2026-03-17T14:15:54.881595Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.881598Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 2
2026-03-17T14:15:54.881816Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 35 partNo 2 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 1048790 count 1 nextOffset 36 batches 3
2026-03-17T14:15:54.881840Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.881843Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.881846Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.881931Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 35,1 HeadOffset 35 endOffset 35 curOffset 36 d0000000000_00000000000000000035_00000_0000000001_00002? size 1048780 WTime 1773756954881
2026-03-17T14:15:54.882122Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.882145Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.883916Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:54.885962Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 35 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.885989Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.886018Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.886031Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.886031Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.886048Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 0, Offset: 35 is stored on disk
2026-03-17T14:15:54.886053Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.886058Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 1, Offset: 35 is stored on disk
2026-03-17T14:15:54.886064Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.886073Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 2, Offset: 35 is stored on disk
2026-03-17T14:15:54.886110Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.886119Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.886121Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.886123Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.886125Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.886134Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.886165Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.886403Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.886861Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428781:3881] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 35
    Offset: 35
    PartNo: 0
    WriteTimestampMS: 1773756954881
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.887836Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.888411Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428786:3884], now have 1 active actors on pipe
2026-03-17T14:15:54.888565Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.888577Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.888616Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|95905ac8-d81af9fb-11999930-128ef622_36 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.888629Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.888633Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.888638Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.888641Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.888645Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.888654Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.888658Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.888667Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.888680Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.888698Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.888794Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|95905ac8-d81af9fb-11999930-128ef622_36"
    Status: Active
    SeqNo: 0
  }
}
2026-03-17T14:15:54.889170Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428786:3884] destroyed
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|95905ac8-d81af9fb-11999930-128ef622_36"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 36
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.896465Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.897088Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428789:3885], now have 1 active actors on pipe
2026-03-17T14:15:54.898596Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.898620Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.915551Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.915634Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.915651Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.915663Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.917499Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.917539Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.917543Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.917554Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.917557Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.917562Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.917575Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.917581Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.917622Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 0
2026-03-17T14:15:54.917642Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.917648Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 1
2026-03-17T14:15:54.917652Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.917656Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 2
2026-03-17T14:15:54.917880Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 36 partNo 2 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 1048790 count 1 nextOffset 37 batches 3
2026-03-17T14:15:54.917904Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.917914Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.917917Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.918000Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 36,1 HeadOffset 36 endOffset 36 curOffset 37 d0000000000_00000000000000000036_00000_0000000001_00002? size 1048780 WTime 1773756954917
2026-03-17T14:15:54.918177Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.918204Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.921999Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 36 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.922034Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.922060Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.922060Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.922066Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.922078Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 0, Offset: 36 is stored on disk
2026-03-17T14:15:54.922083Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.922089Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 1, Offset: 36 is stored on disk
2026-03-17T14:15:54.922097Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.922103Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 2, Offset: 36 is stored on disk
2026-03-17T14:15:54.922142Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.922164Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.922174Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.922176Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.922179Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.922188Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.922209Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.922334Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2026-03-17T14:15:54.922775Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428789:3885] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 36
    Offset: 36
    PartNo: 0
    WriteTimestampMS: 1773756954917
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.923565Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.924088Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428798:3890], now have 1 active actors on pipe
2026-03-17T14:15:54.924205Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.924218Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.924259Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|82b471e0-4060b686-665292d3-4af02487_37 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.924272Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.924282Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.924286Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.924288Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.924292Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.924302Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.924305Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.924308Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.924321Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.924337Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.924410Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.924715Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428798:3890] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|82b471e0-4060b686-665292d3-4af02487_37"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|82b471e0-4060b686-665292d3-4af02487_37"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 37
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.929481Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.930036Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428801:3891], now have 1 active actors on pipe
2026-03-17T14:15:54.931433Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.931455Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.948261Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.948344Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.948356Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.948362Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.950229Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.950257Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.950266Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.950277Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.950281Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.950291Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.950294Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.950300Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.950338Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 0
2026-03-17T14:15:54.950353Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.950364Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 1
2026-03-17T14:15:54.950369Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.950373Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 2
2026-03-17T14:15:54.950589Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 37 partNo 2 FormedBlobsCount 0 NewHead: Offset 37 PartNo 0 PackedSize 1048790 count 1 nextOffset 38 batches 3
2026-03-17T14:15:54.950600Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.950603Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.950607Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.950687Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 37,1 HeadOffset 37 endOffset 37 curOffset 38 d0000000000_00000000000000000037_00000_0000000001_00002? size 1048780 WTime 1773756954950
2026-03-17T14:15:54.950836Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.950850Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 37 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.954527Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 37 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.954580Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.954613Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.954622Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.954635Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 0, Offset: 37 is stored on disk
2026-03-17T14:15:54.954640Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.954653Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 1, Offset: 37 is stored on disk
2026-03-17T14:15:54.954660Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.954665Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 2, Offset: 37 is stored on disk
2026-03-17T14:15:54.954705Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.954710Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.954712Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.954715Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.954719Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.954732Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.954754Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.954835Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.954935Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 37
    Offset: 37
    PartNo: 0
    WriteTimestampMS: 1773756954949
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2026-03-17T14:15:54.955436Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428801:3891] destroyed
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.956153Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.958446Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428812:3897], now have 1 active actors on pipe
2026-03-17T14:15:54.958588Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.958607Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.958659Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3c2418f0-7115bf08-ba3626eb-5720eed5_38 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.958674Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.958679Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.958685Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.958690Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.958695Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.958708Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.958712Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.958716Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.958737Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.958754Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.958860Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3c2418f0-7115bf08-ba3626eb-5720eed5_38"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|3c2418f0-7115bf08-ba3626eb-5720eed5_38"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 38
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:54.959227Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428812:3897] destroyed
2026-03-17T14:15:54.966407Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.970676Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428816:3899], now have 1 active actors on pipe
2026-03-17T14:15:54.973726Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.973757Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.985580Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:54.985681Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:54.985691Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:54.985696Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:54.988062Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.988086Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.988089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.988092Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.988100Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.988122Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:54.988142Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.988146Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.988158Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.988167Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.988171Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:54.988173Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.988177Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.988227Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 0
2026-03-17T14:15:54.988253Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.988257Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 1
2026-03-17T14:15:54.988262Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.988264Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 2
2026-03-17T14:15:54.988552Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 38 partNo 2 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 1048790 count 1 nextOffset 39 batches 3
2026-03-17T14:15:54.988591Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:54.988595Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:54.988598Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.988675Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 38,1 HeadOffset 38 endOffset 38 curOffset 39 d0000000000_00000000000000000038_00000_0000000001_00002? size 1048780 WTime 1773756954988
2026-03-17T14:15:54.988867Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:54.988889Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 0 count 1 size 1048780
2026-03-17T14:15:54.994192Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 38 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:54.994235Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:54.994253Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:54.994281Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:54.994297Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.994310Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 0, Offset: 38 is stored on disk
2026-03-17T14:15:54.994315Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.994321Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 1, Offset: 38 is stored on disk
2026-03-17T14:15:54.994328Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:54.994334Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 2, Offset: 38 is stored on disk
2026-03-17T14:15:54.994373Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.994383Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.994386Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.994390Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:54.994392Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.994410Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:54.994448Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.994562Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:54.994947Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428816:3899] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 38
    Offset: 38
    PartNo: 0
    WriteTimestampMS: 1773756954987
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2026-03-17T14:15:54.995805Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:54.996248Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228108517428834:3909], now have 1 active actors on pipe
2026-03-17T14:15:54.996360Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:54.996375Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:54.996418Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|90d3a748-7083d056-537d3842-3b1ea80b_39 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2026-03-17T14:15:54.996435Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:54.996444Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:54.996449Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:54.996450Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:54.996453Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:54.996463Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:54.996469Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:54.996471Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:54.996486Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:54.996502Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:54.996558Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|90d3a748-7083d056-537d3842-3b1ea80b_39"
    Status: Active
    SeqNo: 0
  }
}
2026-03-17T14:15:54.996788Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228108517428834:3909] destroyed
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|90d3a748-7083d056-537d3842-3b1ea80b_39"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 39
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:55.002528Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:55.002966Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228112812396133:3910], now have 1 active actors on pipe
2026-03-17T14:15:55.004390Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:55.004415Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:55.020718Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 0 messageNo: 0 size: 511959
2026-03-17T14:15:55.020813Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 1 messageNo: 0 size: 511959
2026-03-17T14:15:55.020827Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2029: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 2 messageNo: 0 size: 24658
2026-03-17T14:15:55.020835Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2077: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 2 messageNo: 0 size 24658 offset: -1
2026-03-17T14:15:55.022820Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:636: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2026-03-17T14:15:55.022858Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.022862Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:55.022871Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:55.022873Z node 25 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:55.022961Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2026-03-17T14:15:55.023005Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.023014Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:55.023057Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 0
2026-03-17T14:15:55.023080Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:55.023090Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 1
2026-03-17T14:15:55.023095Z node 25 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:55.023098Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1348: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 2
2026-03-17T14:15:55.023351Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1452: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 39 partNo 2 FormedBlobsCount 0 NewHead: Offset 39 PartNo 0 PackedSize 1048790 count 1 nextOffset 40 batches 3
2026-03-17T14:15:55.023378Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2026-03-17T14:15:55.023387Z node 25 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2026-03-17T14:15:55.023395Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.023474Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1711: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 39,1 HeadOffset 39 endOffset 39 curOffset 40 d0000000000_00000000000000000039_00000_0000000001_00002? size 1048780 WTime 1773756955021
2026-03-17T14:15:55.023651Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:55.023676Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 0 count 1 size 1048780
2026-03-17T14:15:55.031913Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 39 count 1 size 1048780 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.031952Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:55.031978Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 2 parts 2 suffix '124' size 1073481
2026-03-17T14:15:55.031986Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.031993Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:55.032001Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:55.032018Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 0, Offset: 39 is stored on disk
2026-03-17T14:15:55.032023Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:55.032027Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 1, Offset: 39 is stored on disk
2026-03-17T14:15:55.032033Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:60: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2026-03-17T14:15:55.032038Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:365: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 2, Offset: 39 is stored on disk
2026-03-17T14:15:55.032070Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.032081Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.032083Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.032089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.032091Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.032104Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00002? (1048780)
2026-03-17T14:15:55.032109Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00002? (1048780)
2026-03-17T14:15:55.032112Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000001_00002? (1048780)
2026-03-17T14:15:55.032115Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00002? (1048780)
2026-03-17T14:15:55.032118Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000001_00002? (1048780)
2026-03-17T14:15:55.032121Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000037_00000_0000000001_00002? (1048780)
2026-03-17T14:15:55.032124Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00000_0000000001_00002? (1048780)
2026-03-17T14:15:55.032126Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00002? (1048780)
2026-03-17T14:15:55.032129Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2026-03-17T14:15:55.032141Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 30 size 1073481 cause it's been evicted from L2. Actual L1 size: 11
2026-03-17T14:15:55.032145Z node 25 :PERSQUEUE DEBUG: read.h:371: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, cookie 0
2026-03-17T14:15:55.032163Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:55.032180Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2026-03-17T14:15:55.032190Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000001_00002?
2026-03-17T14:15:55.032200Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000001_00002?
2026-03-17T14:15:55.032211Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00000_0000000001_00002?
2026-03-17T14:15:55.032222Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00002?
2026-03-17T14:15:55.032237Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000001_00002?
2026-03-17T14:15:55.032255Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000037_00000_0000000001_00002?
2026-03-17T14:15:55.032271Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00000_0000000001_00002?
2026-03-17T14:15:55.032280Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00002?
2026-03-17T14:15:55.032297Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2026-03-17T14:15:55.032307Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 32 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:55.032268Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:55.032600Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 33 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 39
    Offset: 39
    PartNo: 0
    WriteTimestampMS: 1773756955021
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 8
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
>>>>> 3
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 0
    Count: 16
    ReadTimestampMs: 0
  }
}
2026-03-17T14:15:55.032898Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 34 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:55.033250Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 35 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:55.033678Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 36 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:55.033812Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:55.033942Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 37 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:55.034221Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 38 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:55.034501Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 39 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2026-03-17T14:15:55.000000Z
2026-03-17T14:15:55.034779Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2026-03-17T14:15:55.034803Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228112812396133:3910] destroyed
2026-03-17T14:15:55.034809Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:55.034812Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228112812396140:3913], now have 1 active actors on pipe
2026-03-17T14:15:55.034815Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:55.034819Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:55.034823Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:55.034827Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:55.034830Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:55.034834Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:55.034838Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63'
2026-03-17T14:15:55.034842Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:55.034847Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:55.034866Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:444: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2026-03-17T14:15:55.034884Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000032_00000_0000000001_00002?
2026-03-17T14:15:55.034887Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:55.034890Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000032_00000_0000000001_00002?, parameters.CurOffset=32
2026-03-17T14:15:55.034893Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 32.0/3
2026-03-17T14:15:55.034907Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 0
2026-03-17T14:15:55.034918Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 32:0 appended
2026-03-17T14:15:55.034926Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 32.1/3
2026-03-17T14:15:55.034929Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 1
2026-03-17T14:15:55.034932Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 32:1 appended
2026-03-17T14:15:55.034935Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 32.2/3
2026-03-17T14:15:55.034938Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 2
2026-03-17T14:15:55.035139Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 32 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 1048790 count 1 nextOffset 33 batches 3
2026-03-17T14:15:55.035152Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 32:2 appended
2026-03-17T14:15:55.035156Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000033_00000_0000000001_00002?
2026-03-17T14:15:55.035160Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:55.035163Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000033_00000_0000000001_00002?, parameters.CurOffset=33
2026-03-17T14:15:55.035166Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 33.0/3
2026-03-17T14:15:55.035170Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 0
2026-03-17T14:15:55.035172Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 33:0 appended
2026-03-17T14:15:55.035174Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 33.1/3
2026-03-17T14:15:55.035177Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 1
2026-03-17T14:15:55.035179Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 33:1 appended
2026-03-17T14:15:55.035181Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 33.2/3
2026-03-17T14:15:55.035185Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 2
2026-03-17T14:15:55.035381Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 33 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 2097545 count 2 nextOffset 34 batches 5
2026-03-17T14:15:55.035393Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 33:2 appended
2026-03-17T14:15:55.035396Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000034_00000_0000000001_00002?
2026-03-17T14:15:55.035398Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:55.035401Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000034_00000_0000000001_00002?, parameters.CurOffset=34
2026-03-17T14:15:55.035405Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 34.0/3
2026-03-17T14:15:55.035408Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 0
2026-03-17T14:15:55.035410Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 34:0 appended
2026-03-17T14:15:55.035412Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 34.1/3
2026-03-17T14:15:55.035414Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 1
2026-03-17T14:15:55.035416Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 34:1 appended
2026-03-17T14:15:55.035420Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 34.2/3
2026-03-17T14:15:55.035423Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 2
2026-03-17T14:15:55.035602Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 34 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 3146300 count 3 nextOffset 35 batches 7
2026-03-17T14:15:55.035613Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 34:2 appended
2026-03-17T14:15:55.035617Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000035_00000_0000000001_00002?
2026-03-17T14:15:55.035619Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:55.035622Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000035_00000_0000000001_00002?, parameters.CurOffset=35
2026-03-17T14:15:55.035625Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 35.0/3
2026-03-17T14:15:55.035628Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 0
2026-03-17T14:15:55.035630Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 35:0 appended
2026-03-17T14:15:55.035632Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 35.1/3
2026-03-17T14:15:55.035635Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 1
2026-03-17T14:15:55.035638Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 35:1 appended
2026-03-17T14:15:55.035640Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 35.2/3
2026-03-17T14:15:55.035643Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 2
2026-03-17T14:15:55.035814Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 35 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 4195055 count 4 nextOffset 36 batches 9
2026-03-17T14:15:55.035825Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 35:2 appended
2026-03-17T14:15:55.035829Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000036_00000_0000000001_00002?
2026-03-17T14:15:55.035831Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:55.035833Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000036_00000_0000000001_00002?, parameters.CurOffset=36
2026-03-17T14:15:55.035836Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 36.0/3
2026-03-17T14:15:55.035841Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 0
2026-03-17T14:15:55.035856Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 36:0 appended
2026-03-17T14:15:55.035858Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 36.1/3
2026-03-17T14:15:55.035861Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 1
2026-03-17T14:15:55.035863Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 36:1 appended
2026-03-17T14:15:55.035865Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 36.2/3
2026-03-17T14:15:55.035868Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 2
2026-03-17T14:15:55.036039Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 36 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 5243810 count 5 nextOffset 37 batches 11
2026-03-17T14:15:55.036050Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 36:2 appended
2026-03-17T14:15:55.036053Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000037_00000_0000000001_00002?
2026-03-17T14:15:55.036055Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:55.036058Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000037_00000_0000000001_00002?, parameters.CurOffset=37
2026-03-17T14:15:55.036060Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 37.0/3
2026-03-17T14:15:55.036063Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 0
2026-03-17T14:15:55.036065Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 37:0 appended
2026-03-17T14:15:55.036067Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 37.1/3
2026-03-17T14:15:55.036072Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 1
2026-03-17T14:15:55.036073Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 37:1 appended
2026-03-17T14:15:55.036075Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 37.2/3
2026-03-17T14:15:55.036078Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 2
2026-03-17T14:15:55.036260Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 37 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 6292565 count 6 nextOffset 38 batches 13
2026-03-17T14:15:55.036272Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 37:2 appended
2026-03-17T14:15:55.036275Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000038_00000_0000000001_00002?
2026-03-17T14:15:55.036276Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:55.036279Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000038_00000_0000000001_00002?, parameters.CurOffset=38
2026-03-17T14:15:55.036281Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 38.0/3
2026-03-17T14:15:55.036284Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 0
2026-03-17T14:15:55.036286Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 38:0 appended
2026-03-17T14:15:55.036288Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 38.1/3
2026-03-17T14:15:55.036291Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 1
2026-03-17T14:15:55.041854Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 38 partNo 1 result is x0000000000_00000000000000000030_00002_0000000008_00015 size 7878063
2026-03-17T14:15:55.041873Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 38:1 appended
2026-03-17T14:15:55.041877Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 38.2/3
2026-03-17T14:15:55.041882Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 2
2026-03-17T14:15:55.041894Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1106: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000030_00002_0000000008_00015 new key d0000000000_00000000000000000030_00002_0000000008_00015 size 7878063 WTime 1773756955041
2026-03-17T14:15:55.042016Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 38 partNo 2 FormedBlobsCount 1 NewHead: Offset 38 PartNo 1 PackedSize 536763 count 1 nextOffset 39 batches 2
2026-03-17T14:15:55.042030Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 38:2 appended
2026-03-17T14:15:55.042037Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:476: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000039_00000_0000000001_00002?
2026-03-17T14:15:55.042040Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:506: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2026-03-17T14:15:55.042044Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000039_00000_0000000001_00002?, parameters.CurOffset=39
2026-03-17T14:15:55.042047Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 39.0/3
2026-03-17T14:15:55.042051Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 0
2026-03-17T14:15:55.042054Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 39:0 appended
2026-03-17T14:15:55.042056Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 39.1/3
2026-03-17T14:15:55.042059Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 1
2026-03-17T14:15:55.042061Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 39:1 appended
2026-03-17T14:15:55.042063Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:286: [72075186224037892][Partition][0][StateIdle] Try append part 39.2/3
2026-03-17T14:15:55.042066Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 2
2026-03-17T14:15:55.042250Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 39 partNo 2 FormedBlobsCount 0 NewHead: Offset 38 PartNo 1 PackedSize 1585518 count 2 nextOffset 40 batches 4
2026-03-17T14:15:55.042262Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:366: [72075186224037892][Partition][0][StateIdle] Part 39:2 appended
2026-03-17T14:15:55.042321Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:634: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 38,2 HeadOffset 30 endOffset 32 curOffset 40 d0000000000_00000000000000000038_00001_0000000002_00003| size 1585508 WTime 1773756955041
2026-03-17T14:15:55.043521Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:55.043542Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 2 count 8 size 7878063
2026-03-17T14:15:55.043549Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 1 count 2 size 1585508
2026-03-17T14:15:55.043615Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:891: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 16 size 26214400 endOffset 40 max time lag 0ms effective offset 0
2026-03-17T14:15:55.043667Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1116: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 3 blobs, size 24121465 count 23 last offset 15, current partition end offset: 40
2026-03-17T14:15:55.043676Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1132: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2026-03-17T14:15:55.043725Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 0 partno 0 count 7 parts_count 16 source 0 size 8365339 accessed 0 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:55.045846Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:464: No blob in L1. Partition 0 offset 7 partno 2 count 8 parts_count 15 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.045869Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 2 times before, last time 2026-03-17T14:15:54.000000Z
2026-03-17T14:15:55.045899Z node 25 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 6. Have to read 1 of 3 from KV
2026-03-17T14:15:55.046239Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0'
2026-03-17T14:15:55.046249Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2026-03-17T14:15:55.046257Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 2 count 8 parts_count 15
2026-03-17T14:15:55.081129Z node 25 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2026-03-17T14:15:55.081150Z node 25 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2026-03-17T14:15:55.081175Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:398: Prefetched blob in L1. Partition 0 offset 7 count 8 size 7878063 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.081212Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 30 count 8 size 7878063 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.081227Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:311: Caching head blob in L1. Partition 0 offset 38 count 2 size 1585508 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.081251Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:580: FormAnswer for 3 blobs
2026-03-17T14:15:55.081273Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.081289Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.081299Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 0 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.081306Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 1 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.081315Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 1 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.081320Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 2 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.081328Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 2 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.081338Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 3 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.081347Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 3 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.081351Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 4 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.081355Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 4 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.081361Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 5 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.081371Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 5 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.081376Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 6 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.081384Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 6 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.081387Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 7 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2026-03-17T14:15:55.082208Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2026-03-17T14:15:55.082225Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2026-03-17T14:15:55.082240Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.082244Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.082249Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.082254Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.082259Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.082262Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.082265Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.082267Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0' size 7878063
2026-03-17T14:15:55.082271Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63' size 1048780
2026-03-17T14:15:55.082274Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365339
2026-03-17T14:15:55.082276Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 1 count 2 parts 3 suffix '124' size 1585508
2026-03-17T14:15:55.083624Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 7 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.083651Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083655Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083659Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.083665Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083668Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.083673Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083677Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.083683Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083686Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.083692Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083696Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.083701Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083704Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.083708Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083712Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.083715Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083724Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.083729Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.083811Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:55.084067Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.084081Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.084084Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.084086Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.084089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.084100Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000030_00002_0000000002_00002|
2026-03-17T14:15:55.084106Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000032_00000_0000000001_00002?
2026-03-17T14:15:55.084109Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000033_00000_0000000001_00002?
2026-03-17T14:15:55.084112Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000034_00000_0000000001_00002?
2026-03-17T14:15:55.084116Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000035_00000_0000000001_00002?
2026-03-17T14:15:55.084119Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000036_00000_0000000001_00002?
2026-03-17T14:15:55.084122Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000037_00000_0000000001_00002?
2026-03-17T14:15:55.084125Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000038_00000_0000000001_00002?
2026-03-17T14:15:55.084128Z node 25 :PERSQUEUE DEBUG: partition.cpp:2741: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000039_00000_0000000001_00002?
2026-03-17T14:15:55.084156Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:55.084180Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 23 size 8365364 cause it's been evicted from L2. Actual L1 size: 13
2026-03-17T14:15:55.084185Z node 25 :PERSQUEUE DEBUG: read.h:371: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, cookie 0
2026-03-17T14:15:55.084614Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 38 size 1048780 cause it's been evicted from L2. Actual L1 size: 12
2026-03-17T14:15:55.084616Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 34 size 1048780 cause it's been evicted from L2. Actual L1 size: 11
2026-03-17T14:15:55.084619Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 35 size 1048780 cause it's been evicted from L2. Actual L1 size: 10
2026-03-17T14:15:55.084622Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 0 size 8365339 cause it's been evicted from L2. Actual L1 size: 9
2026-03-17T14:15:55.084627Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 32 size 1048780 cause it's been evicted from L2. Actual L1 size: 8
2026-03-17T14:15:55.084630Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 37 size 1048780 cause it's been evicted from L2. Actual L1 size: 7
2026-03-17T14:15:55.084633Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 39 size 1048780 cause it's been evicted from L2. Actual L1 size: 6
2026-03-17T14:15:55.084635Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 36 size 1048780 cause it's been evicted from L2. Actual L1 size: 5
2026-03-17T14:15:55.084637Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 33 size 1048780 cause it's been evicted from L2. Actual L1 size: 4
2026-03-17T14:15:55.084639Z node 25 :PERSQUEUE DEBUG: read.h:371: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, cookie 0
2026-03-17T14:15:55.085128Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:55.085166Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:55.085173Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00002_0000000002_00002|(+) to d0000000000_00000000000000000030_00002_0000000002_00002|(+)
2026-03-17T14:15:55.085174Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00000_0000000001_00002?(+) to d0000000000_00000000000000000032_00000_0000000001_00002?(+)
2026-03-17T14:15:55.085175Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000033_00000_0000000001_00002?(+) to d0000000000_00000000000000000033_00000_0000000001_00002?(+)
2026-03-17T14:15:55.085177Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000034_00000_0000000001_00002?(+) to d0000000000_00000000000000000034_00000_0000000001_00002?(+)
2026-03-17T14:15:55.085178Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000035_00000_0000000001_00002?(+) to d0000000000_00000000000000000035_00000_0000000001_00002?(+)
2026-03-17T14:15:55.085182Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000036_00000_0000000001_00002?(+) to d0000000000_00000000000000000036_00000_0000000001_00002?(+)
2026-03-17T14:15:55.085184Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000037_00000_0000000001_00002?(+) to d0000000000_00000000000000000037_00000_0000000001_00002?(+)
2026-03-17T14:15:55.085185Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000038_00000_0000000001_00002?(+) to d0000000000_00000000000000000038_00000_0000000001_00002?(+)
2026-03-17T14:15:55.085187Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000039_00000_0000000001_00002?(+) to d0000000000_00000000000000000039_00000_0000000001_00002?(+)
2026-03-17T14:15:55.091224Z node 25 :PERSQUEUE DEBUG: partition.cpp:2334: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2026-03-17T14:15:55.106827Z node 25 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:55.106868Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:55.106878Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.106882Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.106885Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.106888Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.106890Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.106904Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:55.107867Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:55.124471Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228112812396140:3913] destroyed
CallPersQueueGRPC response:
2026-03-17T14:15:55.191603Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.191627Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.191630Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.191635Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.191645Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 0
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 4
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 16
    Count: 16
    ReadTimestampMs: 0
  }
}
2026-03-17T14:15:55.201701Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228112812396168:3927], now have 1 active actors on pipe
2026-03-17T14:15:55.202178Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:55.202191Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:55.202243Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:891: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 16 partno 0 count 16 size 26214400 endOffset 40 max time lag 0ms effective offset 16
2026-03-17T14:15:55.201051Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:55.202510Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1116: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 3 blobs, size 16755432 count 23 last offset 30, current partition end offset: 40
2026-03-17T14:15:55.202525Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1132: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2026-03-17T14:15:55.202542Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 3 times before, last time 2026-03-17T14:15:55.000000Z
2026-03-17T14:15:55.202548Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:464: No blob in L1. Partition 0 offset 23 partno 0 count 7 parts_count 16 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.202552Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 30 partno 2 count 8 parts_count 15 source 1 size 7878063 accessed 0 times before, last time 2026-03-17T14:15:55.000000Z
2026-03-17T14:15:55.204673Z node 25 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 7. Have to read 1 of 3 from KV
2026-03-17T14:15:55.204703Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2026-03-17T14:15:55.204711Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0'
2026-03-17T14:15:55.204718Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 23 partno 0 count 7 parts_count 16
2026-03-17T14:15:55.216233Z node 25 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2026-03-17T14:15:55.216256Z node 25 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2026-03-17T14:15:55.216282Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:398: Prefetched blob in L1. Partition 0 offset 23 count 7 size 8365364 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.216322Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:580: FormAnswer for 3 blobs
2026-03-17T14:15:55.216336Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.216335Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2026-03-17T14:15:55.216343Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2026-03-17T14:15:55.216345Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.216349Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.216356Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.216360Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.216370Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.216373Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.216376Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.216379Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.216382Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.216384Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.216389Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 21 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.216391Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 21 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.216394Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 22 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.216397Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 22 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.218953Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.218966Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.218969Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 23 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.218973Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.218976Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.218981Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.218991Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.218994Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.218998Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.219000Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.219003Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.219004Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.219007Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.219009Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.219013Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.219015Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.219023Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2026-03-17T14:15:55.219029Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 30 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.219032Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 31 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.219034Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 31 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.219100Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 7 size 7878063 cause it's been evicted from L2. Actual L1 size: 4
2026-03-17T14:15:55.219107Z node 25 :PERSQUEUE DEBUG: read.h:371: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, cookie 0
2026-03-17T14:15:55.219164Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:55.239774Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:55.248116Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228112812396168:3927] destroyed
CallPersQueueGRPC response:
2026-03-17T14:15:55.293500Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.293524Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.293528Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.293533Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.293536Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 16
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 5
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 9
    Count: 12
    ReadTimestampMs: 0
  }
}
2026-03-17T14:15:55.297954Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:55.298495Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228112812396174:3931], now have 1 active actors on pipe
2026-03-17T14:15:55.298708Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:55.298718Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:55.298760Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:891: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 partno 0 count 12 size 26214400 endOffset 40 max time lag 0ms effective offset 9
2026-03-17T14:15:55.298798Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1116: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 2 blobs, size 7878063 count 14 last offset 15, current partition end offset: 40
2026-03-17T14:15:55.298803Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1132: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2026-03-17T14:15:55.298813Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:464: No blob in L1. Partition 0 offset 7 partno 2 count 8 parts_count 15 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.298818Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878063 accessed 4 times before, last time 2026-03-17T14:15:55.000000Z
2026-03-17T14:15:55.298831Z node 25 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 8. Have to read 1 of 2 from KV
2026-03-17T14:15:55.299079Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2026-03-17T14:15:55.299091Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 2 count 8 parts_count 15
2026-03-17T14:15:55.308870Z node 25 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2026-03-17T14:15:55.308893Z node 25 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2026-03-17T14:15:55.308917Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:398: Prefetched blob in L1. Partition 0 offset 7 count 8 size 7878063 actorID [25:7618228103324610124:2382]
2026-03-17T14:15:55.308952Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:580: FormAnswer for 2 blobs
2026-03-17T14:15:55.310947Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 1 count 2 parts 3 suffix '124' size 1585508
2026-03-17T14:15:55.310968Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878063
2026-03-17T14:15:55.311163Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 1 cbcount 2
2026-03-17T14:15:55.311190Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311201Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311208Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311211Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311221Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311225Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311228Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311231Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311235Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311238Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311243Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311246Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.311249Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311259Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311262Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.311264Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311269Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311272Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311277Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311279Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311285Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311295Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311299Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311302Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311306Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.311309Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.311387Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:428: Erasing blob in L1. Partition 0 offset 38 size 1585508 cause it's been evicted from L2. Actual L1 size: 4
2026-03-17T14:15:55.311400Z node 25 :PERSQUEUE DEBUG: read.h:371: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, cookie 0
2026-03-17T14:15:55.311453Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:55.324937Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:55.329060Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228112812396174:3931] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 9
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 6
CallPersQueueGRPC request to localhost:7107
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 25
    Count: 10
    ReadTimestampMs: 0
  }
}
2026-03-17T14:15:55.372343Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2026-03-17T14:15:55.373077Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [24:7618228112812396180:3935], now have 1 active actors on pipe
2026-03-17T14:15:55.373177Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:55.373197Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:55.373245Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:891: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 25 partno 0 count 10 size 26214400 endOffset 40 max time lag 0ms effective offset 25
2026-03-17T14:15:55.373484Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1116: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 2 blobs, size 8390068 count 14 last offset 30, current partition end offset: 40
2026-03-17T14:15:55.373492Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1132: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2026-03-17T14:15:55.373508Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 23 partno 0 count 7 parts_count 16 source 0 size 8365364 accessed 0 times before, last time 2026-03-17T14:15:55.000000Z
2026-03-17T14:15:55.375760Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:487: Got data from cache. Partition 0 offset 30 partno 2 count 8 parts_count 15 source 1 size 7878063 accessed 1 times before, last time 2026-03-17T14:15:55.000000Z
2026-03-17T14:15:55.375796Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 2 blobs are from cache.
2026-03-17T14:15:55.375819Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:580: FormAnswer for 2 blobs
2026-03-17T14:15:55.375836Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 1 cbcount 2
2026-03-17T14:15:55.375858Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375864Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.375864Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0'
2026-03-17T14:15:55.375871Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375874Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.375876Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0'
2026-03-17T14:15:55.375880Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375883Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.375888Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375891Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.375897Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375902Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.375905Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2026-03-17T14:15:55.375915Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 30 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.375921Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 31 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375925Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 31 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2026-03-17T14:15:55.375929Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 32 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375932Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 32 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375937Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 32 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.375943Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 33 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375946Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 33 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.375951Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 34 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2026-03-17T14:15:55.375955Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:500: FormAnswer processing batch offset 34 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2026-03-17T14:15:55.376024Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:55.387174Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2026-03-17T14:15:55.393876Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.393896Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.393900Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.393903Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.393906Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.396088Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [24:7618228112812396180:3935] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 25
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2026-03-17T14:15:55.494282Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.494325Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.494328Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.494332Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.494336Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.594601Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.594628Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.594631Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.594635Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.594639Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.697307Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.697331Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.697334Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.697339Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.697342Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.797360Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.797385Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.797388Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.797391Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.797394Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.898243Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.898269Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.898272Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.898276Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.898280Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:55.998568Z node 25 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:55.998590Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.998593Z node 25 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:55.998596Z node 25 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:55.998599Z node 25 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
[[bad]]assertion failed at ydb/services/persqueue_v1/persqueue_ut.cpp:3302, virtual void NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCache::Execute_(NUnitTest::TTestContext &): (info9.BlobsFromDisk == 0) failed: (1 != 0) [[rst]]
[[alt1]]TBackTrace::Capture()+28 (0x15BF497C)
NUnitTest::NPrivate::RaiseError(char const*, TBasicString<char, std::__y1::char_traits<char>> const&, bool)+128 (0x15DB4A60)
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCache::Execute_(NUnitTest::TTestContext&)+13647 (0x158FA4DF)
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()::'lambda'()::operator()() const+71 (0x159F2087)
NUnitTest::TTestBase::Run(std::__y1::function<void ()>, TBasicString<char, std::__y1::char_traits<char>> const&, char const*, bool)+120 (0x15DB6D18)
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()+443 (0x159F197B)
NUnitTest::TTestFactory::Execute()+817 (0x15DB7461)
NUnitTest::RunMain(int, char**)+3245 (0x15DC96CD)
??+0 (0x7F5C83257D90)
__libc_start_main+128 (0x7F5C83257E40)
_start+41 (0x149C2029)
[[rst]]
