2025-12-05T13:12:01.700790Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7580360958669974946:2073];send_to=[0:7307199536658146131:7762515];
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/kvke/001a11/r3tmp/tmp76VCxE/pdisk_1.dat
2025-12-05T13:12:01.738911Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-12-05T13:12:01.721825Z node 4 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 2146435075 Duration# 0.006679s
2025-12-05T13:12:01.821479Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-12-05T13:12:01.822002Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-12-05T13:12:01.881778Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-12-05T13:12:01.881852Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-12-05T13:12:01.884304Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-12-05T13:12:01.929850Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-12-05T13:12:02.068505Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-12-05T13:12:02.167242Z node 4 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-12-05T13:12:02.179680Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-12-05T13:12:02.190448Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-12-05T13:12:02.190542Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-12-05T13:12:02.201702Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-12-05T13:12:02.201782Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-12-05T13:12:02.241974Z node 4 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 5 Cookie 5
2025-12-05T13:12:02.242104Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-12-05T13:12:02.242970Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 29998, node 4
2025-12-05T13:12:02.432624Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-12-05T13:12:02.449127Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/kvke/001a11/r3tmp/yandexr5JnER.tmp
2025-12-05T13:12:02.449153Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/kvke/001a11/r3tmp/yandexr5JnER.tmp
2025-12-05T13:12:02.449297Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/kvke/001a11/r3tmp/yandexr5JnER.tmp
2025-12-05T13:12:02.449392Z node 4 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-12-05T13:12:02.493341Z INFO: TTestServer started on Port 32270 GrpcPort 29998
2025-12-05T13:12:02.589116Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-12-05T13:12:02.732642Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-12-05T13:12:02.868698Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:32270
PQClient connected to localhost:29998
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-12-05T13:12:02.954917Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-12-05T13:12:03.021185Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976710658, at schemeshard: 72057594046644480
2025-12-05T13:12:03.034379Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-12-05T13:12:06.297145Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [5:7580360980144811812:2297], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-12-05T13:12:06.297385Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2417: SessionId: ydb://session/3?node_id=5&id=OWY0OTdhNDUtMzFhMTBiOGQtYzdlOWEzNTctZWFlMTZjMTc=, ActorId: [5:7580360980144811810:2296], ActorState: ExecuteState, TraceId: 01kbqa89brcwn2egv1kh4rwr5t, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-12-05T13:12:06.297781Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-12-05T13:12:06.610809Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7580360979799119453:2323], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-12-05T13:12:06.614475Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2417: SessionId: ydb://session/3?node_id=4&id=YjlkNWIwODktZThmY2ZhZDEtYTQ5ZGMxMzAtMzNlM2Y3YzM=, ActorId: [4:7580360979799119450:2321], ActorState: ExecuteState, TraceId: 01kbqa89mxdtgczpb5wyq7zbg7, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-12-05T13:12:06.614902Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-12-05T13:12:06.629048Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-12-05T13:12:06.700928Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7580360958669974946:2073];send_to=[0:7307199536658146131:7762515];
2025-12-05T13:12:06.701006Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-12-05T13:12:06.721159Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-12-05T13:12:06.939336Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-12-05T13:12:07.305811Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710665. Ctx: { TraceId: 01kbqa8a4r9bb0t5fa2kd1e0fj, Database: , SessionId: ydb://session/3?node_id=4&id=OGJjY2Y3YzYtMTM3MjM5OTItNDkwNzI3ZTUtNjE5M2FiZmQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [4:7580360984094087196:3032] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-12-05T13:12:12.631525Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-12-05T13:12:12.675545Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [4:7580361005568924115:3270] connected; active server actors: 1
2025-12-05T13:12:12.675705Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-12-05T13:12:12.677711Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-12-05T13:12:12.681442Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-12-05T13:12:12.696455Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2959: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-12-05T13:12:12.700671Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2991: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-12-05T13:12:12.700926Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:785: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-12-05T13:12:12.700951Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-12-05T13:12:12.700983Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-12-05T13:12:12.705755Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 5, Generation 1
2025-12-05T13:12:12.705947Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361005568924155:2438], now have 1 active actors on pipe
2025-12-05T13:12:12.705981Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361005568924113:3268], now have 1 active actors on pipe
2025-12-05T13:12:12.706633Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:12.711632Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:12.723596Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361005568924186:3323], now have 1 active actors on pipe
2025-12-05T13:12:12.723962Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:12.736684Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:12.737567Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:82: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-12-05T13:12:12.737610Z node 5 :PERSQUEUE DEBUG: partition.cpp:1294: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-12-05T13:12:12.737872Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:82: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-12-05T13:12:12.738097Z node 5 :PERSQUEUE INFO: partition_init.cpp:1142: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [5:7580361005914615952:2371]
2025-12-05T13:12:12.743185Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:82: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-12-05T13:12:12.743220Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:62: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-12-05T13:12:12.743242Z node 5 :PERSQUEUE INFO: partition.cpp:692: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [5:7580361005914615952:2371]
2025-12-05T13:12:12.743266Z node 5 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-12-05T13:12:12.744628Z node 5 :PERSQUEUE DEBUG: partition.cpp:4382: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-12-05T13:12:12.744658Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:12.744678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-12-05T13:12:12.744712Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:12.744722Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:12.744737Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:12.744746Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:12.744773Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:12.744782Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:12.744791Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:12.744802Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:12.744811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:12.744845Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-12-05T13:12:12.745124Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:12.745267Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:12.751630Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:12.751755Z node 5 :PERSQUEUE DEBUG: partition.cpp:1399: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764940332764, TxId 281474976710676
2025-12-05T13:12:12.751772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:12.751785Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:12.751794Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:12.751821Z node 5 :PERSQUEUE DEBUG: partition.cpp:2435: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-12-05T13:12:12.751899Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:12.751909Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:12.751938Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:12.752098Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:12.755489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:12.755775Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:12.755795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:12.755808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:12.755820Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:12.755835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:12.755845Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:12.755869Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:12.756192Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-12-05T13:12:12.756273Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-12-05T13:12:12.756566Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:12.769976Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:12.770084Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:12.774353Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:12.846939Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:12.846969Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:12.846983Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:12.846999Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:12.847010Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:12.865070Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01kbqa8fmm2nwa2rkjeg5a54rs, Database: , SessionId: ydb://session/3?node_id=4&id=YTQzYTNlNmQtZDA4MjEzMDAtNTVkZmEyYzAtZjZlOWI1OTU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1764940332764
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1764940332764
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-12-05T13:12:12.917652Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-12-05T13:12:12.952188Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:12.952220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:12.952232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:12.952248Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:12.952260Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:13.052523Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.052560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.052572Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.052589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.052602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:13.152625Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.152654Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.152673Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.152690Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.152702Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:13.256606Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.256637Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.256649Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.256664Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.256676Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:13.360514Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.360550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.360562Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.360578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.360589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-12-05T13:12:13.427691Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-12-05T13:12:13.460519Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.460557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.460569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.460585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.460596Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:13.560658Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.560695Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.560708Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.560726Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.560736Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:13.661815Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.661884Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.661898Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.661918Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.661943Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:13.764145Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.764181Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.764195Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.764212Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.764228Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:13.864427Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.864465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.864480Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.864507Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.864519Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-12-05T13:12:13.940304Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
PQ Client: create topic: rt3.dc1--topic12 with 1 partitions
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-12-05T13:12:13.943668Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic12, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic12"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-12-05T13:12:13.964543Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:13.964574Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.964588Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:13.964605Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:13.964617Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710681
  SchemeShardTabletId: 72057594046644480
  PathId: 10
}
ErrorCode: OK
AddTopic: rt3.dc1--topic12
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic12, dc = dc1
2025-12-05T13:12:13.993371Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037895][] pipe [4:7580361009863891707:3468] connected; active server actors: 1
2025-12-05T13:12:13.994144Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037895][rt3.dc1--topic12] updating configuration. Deleted partitions []. Added partitions [0]
2025-12-05T13:12:13.995513Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037895][rt3.dc1--topic12] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037895
2025-12-05T13:12:13.995761Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037895][rt3.dc1--topic12] BALANCER INIT DONE for rt3.dc1--topic12: (0, 72075186224037894) 
2025-12-05T13:12:14.016663Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2959: [PQ: 72075186224037894] Handle TEvInterconnect::TEvNodeInfo
2025-12-05T13:12:14.029799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2991: [PQ: 72075186224037894] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-12-05T13:12:14.030142Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:785: [PQ: 72075186224037894] no config, start with empty partitions and default config
2025-12-05T13:12:14.030175Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-12-05T13:12:14.030238Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037894] doesn't have tx writes info
2025-12-05T13:12:14.030726Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361009863891706:3467], now have 1 active actors on pipe
2025-12-05T13:12:14.030761Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361009863891724:2464], now have 1 active actors on pipe
2025-12-05T13:12:14.031469Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:14.037188Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:14.044361Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361014158859050:3508], now have 1 active actors on pipe
2025-12-05T13:12:14.045015Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:14.048586Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:14.049492Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:82: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitConfigStep
2025-12-05T13:12:14.049539Z node 5 :PERSQUEUE DEBUG: partition.cpp:1294: [72075186224037894][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-12-05T13:12:14.049834Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:82: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-12-05T13:12:14.050104Z node 5 :PERSQUEUE INFO: partition_init.cpp:1142: [72075186224037894][Partition][0][StateInit] bootstrapping 0 [5:7580361014504550715:2400]
2025-12-05T13:12:14.051576Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037895][rt3.dc1--topic12] TEvClientConnected TabletId 72075186224037894, NodeId 5, Generation 1
2025-12-05T13:12:14.054153Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:82: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitFieldsStep
2025-12-05T13:12:14.054177Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:62: [rt3.dc1--topic12:0:Initializer] Initializing completed.
2025-12-05T13:12:14.054213Z node 5 :PERSQUEUE INFO: partition.cpp:692: [72075186224037894][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic12' partition 0 generation 1 [5:7580361014504550715:2400]
2025-12-05T13:12:14.054240Z node 5 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037894][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic12 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-12-05T13:12:14.055178Z node 5 :PERSQUEUE DEBUG: partition.cpp:4382: [72075186224037894][Partition][0][StateIdle] Process pending events. Count 1
2025-12-05T13:12:14.055202Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.055218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-12-05T13:12:14.055247Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.055256Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.055269Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.055276Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.055300Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.055308Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.055322Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.055334Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.055340Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.055366Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-12-05T13:12:14.055871Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:14.055999Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:14.064211Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:14.064423Z node 5 :PERSQUEUE DEBUG: partition.cpp:1399: [72075186224037894][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764940334087, TxId 281474976710681
2025-12-05T13:12:14.064450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.064466Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.064477Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.064510Z node 5 :PERSQUEUE DEBUG: partition.cpp:2435: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-12-05T13:12:14.064606Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:14.064624Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:14.064643Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.064838Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:14.066114Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.066143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.066155Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.066168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.066179Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.069032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:14.069368Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:14.069389Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.069401Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.069414Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.069427Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.069436Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.069465Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:14.069796Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037894] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic12" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic12" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-12-05T13:12:14.069876Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-12-05T13:12:14.070208Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:14.078730Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:14.078865Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-12-05T13:12:14.085981Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-12-05T13:12:14.155723Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.155761Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.155775Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.155794Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.155806Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.168186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.168214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.168237Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.168254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.168264Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.191028Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710683. Ctx: { TraceId: 01kbqa8gxy550djaa2xrat4cbr, Database: , SessionId: ydb://session/3?node_id=4&id=ZWU0MDVhMTgtMjNlMGY4MDQtM2E2YWVmZTQtMjk1ZTZiZjY=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic12
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 10
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710681
    CreateStep: 1764940334087
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 10
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 10
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710681
    CreateStep: 1764940334087
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 10
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037894
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037895
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 9
    PathsLimit: 10000
    ShardsInside: 8
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic12"
 name rt3.dc1--topic12 version1
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-12-05T13:12:14.236105Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic12, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-12-05T13:12:14.256646Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.256678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.256691Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.256706Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.256718Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.268763Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.268797Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.268813Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.268828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.268843Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.358513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.358550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.358563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.358582Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.358597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.369277Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.369307Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.369318Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.369335Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.369347Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.458685Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.458718Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.458733Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.458749Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.458762Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.469454Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.469486Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.469503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.469521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.469534Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.559210Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.559246Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.559258Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.559276Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.559287Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.571240Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.571272Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.571286Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.571302Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.571319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.659609Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.659643Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.659666Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.659684Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.659696Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.671152Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.671192Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.671206Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.671223Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.671235Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:29998
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-12-05T13:12:14.749603Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic12"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic12"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:14.761900Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:14.788356Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.788394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.788422Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.788437Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.788450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.788503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.788510Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.788516Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.788523Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.788531Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.788581Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361014158859185:3580], now have 1 active actors on pipe
2025-12-05T13:12:14.788650Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:14.788715Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:14.790681Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:14.788791Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|dfd8a4ac-6c36f798-4a5be0df-dd4f7e1f_0 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:14.788825Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.788836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:14.788858Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.788867Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.788887Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:14.788912Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:14.788922Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:14.788937Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.788969Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:14.789013Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|dfd8a4ac-6c36f798-4a5be0df-dd4f7e1f_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|dfd8a4ac-6c36f798-4a5be0df-dd4f7e1f_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
  }
  MessageNo: 0
}
2025-12-05T13:12:14.793299Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361014158859185:3580] destroyed
2025-12-05T13:12:14.797630Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:14.808752Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361014158859187:3581], now have 1 active actors on pipe
2025-12-05T13:12:14.812604Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:14.812667Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:14.812955Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-12-05T13:12:14.813005Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:14.813043Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.813055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:14.813081Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.813091Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.813136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:14.813227Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-12-05T13:12:14.814106Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-12-05T13:12:14.814148Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:14.814161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:14.814180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.814723Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1764940334814
2025-12-05T13:12:14.814879Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:14.814994Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-12-05T13:12:14.824446Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:14.824517Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:14.844732Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1764940334812
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 1
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:14.824587Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:14.824621Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:14.824666Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-12-05T13:12:14.824871Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-12-05T13:12:14.824892Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:953: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-12-05T13:12:14.824905Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.824914Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.824922Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.824932Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.824939Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.824962Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:14.824994Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:14.825066Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-12-05T13:12:14.825197Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1093: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-12-05T13:12:14.825210Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1109: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-12-05T13:12:14.825236Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-12-05T13:12:14.000000Z
2025-12-05T13:12:14.825250Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-12-05T13:12:14.829580Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-12-05T13:12:14.829668Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-12-05T13:12:14.829761Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-12-05T13:12:14.829770Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-12-05T13:12:14.829880Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1003: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1764940334812 queuesize 0 startOffset 0
2025-12-05T13:12:14.859198Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361014158859187:3581] destroyed
2025-12-05T13:12:14.877049Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:14.884526Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361014158859191:3584], now have 1 active actors on pipe
2025-12-05T13:12:14.892562Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:14.892617Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:14.892678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.892690Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.892700Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.892717Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.892728Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.892810Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|979f4c53-457fb80a-3965b55b-dfa3ddb8_0 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:14.892836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.892847Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:14.892868Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.892878Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.892909Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:14.892971Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:14.892985Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:14.892999Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.893033Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:14.893084Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:14.893142Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.893154Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.893161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.893172Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.893181Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|979f4c53-457fb80a-3965b55b-dfa3ddb8_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|979f4c53-457fb80a-3965b55b-dfa3ddb8_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
  }
  MessageNo: 0
}
2025-12-05T13:12:14.897824Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:14.900952Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361014158859191:3584] destroyed
2025-12-05T13:12:14.911688Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361014158859193:3585], now have 1 active actors on pipe
2025-12-05T13:12:14.909945Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:14.912248Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:14.912277Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:14.912606Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-12-05T13:12:14.912649Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:14.912697Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.912710Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:14.912742Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.912751Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.912768Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:14.912865Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-12-05T13:12:14.970681Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-12-05T13:12:14.970793Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:14.970803Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:14.970817Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.971256Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1764940334971
2025-12-05T13:12:14.971660Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:14.971773Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-12-05T13:12:14.977751Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:14.977795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:14.977857Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:14.977892Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:14.977917Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-12-05T13:12:14.978118Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-12-05T13:12:14.978139Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:953: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-12-05T13:12:14.978161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.978180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.978209Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.978226Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.978236Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.978264Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:14.978310Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:14.978419Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037894][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic12' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-12-05T13:12:14.978578Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1093: [72075186224037894][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-12-05T13:12:14.978590Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1109: [72075186224037894][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-12-05T13:12:14.978627Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-12-05T13:12:14.000000Z
2025-12-05T13:12:14.978642Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-12-05T13:12:14.978679Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-12-05T13:12:14.978765Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-12-05T13:12:14.978811Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1003: Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp done, result 1764940334911 queuesize 0 startOffset 0
2025-12-05T13:12:14.978945Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-12-05T13:12:14.978994Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-12-05T13:12:14.980395Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:14.982799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361014158859193:3585] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1764940334911
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 56
    WriteTimeMs: 9
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:14.992524Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361014158859206:3593], now have 1 active actors on pipe
2025-12-05T13:12:14.992616Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:14.992640Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:14.992760Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|71ed4af-4115964a-bdf8ceb3-1e469f40_1 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:14.992806Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.992818Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:14.992836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:14.992848Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.992865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:14.992899Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:14.992927Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:14.992943Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:14.992995Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:14.993044Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:14.993105Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.993116Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.993125Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.993138Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.993149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|71ed4af-4115964a-bdf8ceb3-1e469f40_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:14.995357Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361014158859206:3593] destroyed
2025-12-05T13:12:14.987653Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:14.993859Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:14.996934Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:14.996959Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.996970Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:14.996986Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:14.996997Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|71ed4af-4115964a-bdf8ceb3-1e469f40_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.023737Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.024587Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826504:3594], now have 1 active actors on pipe
2025-12-05T13:12:15.034750Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.034801Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.035408Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.036039Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.036085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.036117Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.036707Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.036772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.036786Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.036811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.036820Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.036835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.036846Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.036864Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.036970Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-12-05T13:12:15.037010Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.037025Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-12-05T13:12:15.037036Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.037050Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-12-05T13:12:15.120611Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-12-05T13:12:15.120714Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.120727Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.120745Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.121597Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1764940335121
2025-12-05T13:12:15.122841Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:15.122873Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.123020Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.123279Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.123293Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.123305Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.123328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.123342Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.167224Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:15.167301Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.167378Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.167402Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.167438Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-12-05T13:12:15.167453Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.167478Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-12-05T13:12:15.167498Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.167522Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-12-05T13:12:15.168236Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.168254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.168268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.168284Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.168293Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.168326Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.168425Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.169031Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.169336Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1764940335036
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 127
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-12-05T13:12:15.171797Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826504:3594] destroyed
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.178102Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.178910Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826524:3606], now have 1 active actors on pipe
2025-12-05T13:12:15.179523Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.179556Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.179649Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e04aca0c-6155108-9f80e4c0-a0cb8e3c_1 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:15.179682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.179694Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.179714Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.179726Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.179743Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.179774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.179786Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.179799Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.179841Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.179889Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.182546Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.183678Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826524:3606] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e04aca0c-6155108-9f80e4c0-a0cb8e3c_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|e04aca0c-6155108-9f80e4c0-a0cb8e3c_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.210124Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.212054Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826526:3607], now have 1 active actors on pipe
2025-12-05T13:12:15.217316Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.217371Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.217895Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.218410Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.218448Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.218474Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.219069Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.219135Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.219148Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.219176Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.219191Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.219214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.219225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.219245Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.219373Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-12-05T13:12:15.219415Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.219440Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-12-05T13:12:15.219458Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.219474Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-12-05T13:12:15.273761Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-12-05T13:12:15.273861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.273873Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.273891Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.274644Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1764940335273
2025-12-05T13:12:15.275844Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:15.275876Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.275992Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.276207Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.276220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.276231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.276244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.276256Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.294837Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:15.294903Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.294966Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.294987Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.295018Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-12-05T13:12:15.295029Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.295026Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.295045Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-12-05T13:12:15.295062Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.295076Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-12-05T13:12:15.330327Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.330941Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.330368Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.330385Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.330402Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.330412Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.330457Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.330650Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.335340Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826526:3607] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1764940335218
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 73
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.340130Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.340930Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826535:3615], now have 1 active actors on pipe
2025-12-05T13:12:15.342160Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.342210Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.342330Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|fbc296fa-7231d412-73dfab63-785a9db9_2 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:15.342364Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.342378Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.342401Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.342412Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.342432Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.342468Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.342481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.342498Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.342550Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.342609Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.342900Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-12-05T13:12:15.343889Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826535:3615] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|fbc296fa-7231d412-73dfab63-785a9db9_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|fbc296fa-7231d412-73dfab63-785a9db9_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.366803Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.367525Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826545:3618], now have 1 active actors on pipe
2025-12-05T13:12:15.372195Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.372257Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.372910Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.373456Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.373497Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.373529Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.374052Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.374118Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.374136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.374164Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.374173Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.374210Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.374221Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.374239Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.374354Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-12-05T13:12:15.374395Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.374409Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-12-05T13:12:15.374422Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.374435Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-12-05T13:12:15.376178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.376201Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.376216Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.376234Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.376249Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.416731Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-12-05T13:12:15.416832Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.416847Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.416867Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.417672Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1764940335417
2025-12-05T13:12:15.418797Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:15.418831Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.418968Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.431089Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:15.431161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.431217Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.431232Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.431253Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.431282Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-12-05T13:12:15.431293Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.431309Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-12-05T13:12:15.431327Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.431340Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-12-05T13:12:15.431845Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.431864Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.431874Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.431888Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.431901Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.431940Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.432011Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.432163Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1764940335374
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 56
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.434794Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826545:3618] destroyed
2025-12-05T13:12:15.435721Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.436193Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826553:3622], now have 1 active actors on pipe
2025-12-05T13:12:15.436379Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.436399Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.436504Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|210d1d39-e29891c1-c17731ea-24111203_2 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:15.436532Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.436550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.436567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.436578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.436590Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.436626Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.436640Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.436652Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.436688Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.436733Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.436867Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|210d1d39-e29891c1-c17731ea-24111203_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:15.437686Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826553:3622] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|210d1d39-e29891c1-c17731ea-24111203_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.456265Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.457132Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826555:3623], now have 1 active actors on pipe
2025-12-05T13:12:15.461416Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.461459Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.461964Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.462531Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.462585Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.462614Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.463082Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.463147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.463161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.463190Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.463207Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.463226Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.463237Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.463255Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.463384Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-12-05T13:12:15.463433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.463452Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-12-05T13:12:15.463465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.463480Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-12-05T13:12:15.478074Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-12-05T13:12:15.478157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.478167Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.478180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.478767Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1764940335478
2025-12-05T13:12:15.479760Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:15.479778Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.479881Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.488222Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:15.488326Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.488667Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.488764Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.488803Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.488851Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-12-05T13:12:15.488868Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.488890Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-12-05T13:12:15.488913Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.488934Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-12-05T13:12:15.489489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.489516Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.489530Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.489542Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.489550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.489580Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.489636Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.489871Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-12-05T13:12:15.491868Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826555:3623] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1764940335463
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 25
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.496389Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826559:3626], now have 1 active actors on pipe
2025-12-05T13:12:15.496722Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.496761Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.496883Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9bdf2c38-bfd0e0b8-1ad1e192-561254a0_3 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:15.496921Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.496940Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.496961Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.496972Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.496991Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.497025Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.497036Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.497053Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.497105Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.497169Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9bdf2c38-bfd0e0b8-1ad1e192-561254a0_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:15.498419Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826559:3626] destroyed
2025-12-05T13:12:15.495707Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.497545Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|9bdf2c38-bfd0e0b8-1ad1e192-561254a0_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.519055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.519093Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.519107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.519125Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.519138Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.520809Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.523297Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826563:3628], now have 1 active actors on pipe
2025-12-05T13:12:15.527505Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.527561Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.528340Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.528884Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.528947Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.528981Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.544504Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.544589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.544602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.544627Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.544641Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.544664Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.544674Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.544690Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.544798Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-12-05T13:12:15.544835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.544850Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-12-05T13:12:15.544861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.544872Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-12-05T13:12:15.549812Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-12-05T13:12:15.549908Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.549924Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.549943Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.550866Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1764940335549
2025-12-05T13:12:15.552010Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.552154Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.564807Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:15.564907Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.564968Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.564983Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.565010Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.565055Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-12-05T13:12:15.565081Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.565101Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-12-05T13:12:15.565126Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.565153Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-12-05T13:12:15.579079Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.579115Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.579130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.579149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.579161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.586718Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.586755Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.586769Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.586785Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.586795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.586835Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.586945Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.587231Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1764940335544
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 20
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.590904Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826563:3628] destroyed
2025-12-05T13:12:15.591954Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.592467Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826601:3643], now have 1 active actors on pipe
2025-12-05T13:12:15.592685Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.592708Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.592816Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2007549b-6d884430-2d5259ee-9b76a777_3 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:15.592854Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.592872Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.592895Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.592920Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.592939Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.592974Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.592991Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.593007Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.593067Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.593129Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.593332Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.593952Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826601:3643] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2007549b-6d884430-2d5259ee-9b76a777_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|2007549b-6d884430-2d5259ee-9b76a777_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.616207Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.616860Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826603:3644], now have 1 active actors on pipe
2025-12-05T13:12:15.619918Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.619958Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.619974Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.619993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.620007Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.620937Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.620985Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.621535Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.622017Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.622063Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.622093Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.622351Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.622410Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.622423Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.622446Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.622456Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.622473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.622484Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.622502Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.622608Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-12-05T13:12:15.622655Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.622670Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-12-05T13:12:15.622683Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.622698Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-12-05T13:12:15.649227Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-12-05T13:12:15.649326Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.649341Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.649359Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.650173Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1764940335649
2025-12-05T13:12:15.652817Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.653062Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.666709Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.665640Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:15.665709Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.665757Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.665781Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.665804Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.665841Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-12-05T13:12:15.665857Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.665879Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-12-05T13:12:15.665900Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.665920Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-12-05T13:12:15.666342Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.666357Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.666370Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.666384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.666394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.666425Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.666486Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.668445Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826603:3644] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1764940335619
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 45
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.670924Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.671462Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826607:3647], now have 1 active actors on pipe
2025-12-05T13:12:15.671758Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.671784Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.671886Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|63fafef1-1b40b67a-a2448d8a-cc181828_4 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:15.671915Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.671928Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.671946Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.671957Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.671974Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.672006Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.672018Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.672043Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.672092Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.672142Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.672344Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|63fafef1-1b40b67a-a2448d8a-cc181828_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:15.673113Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826607:3647] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|63fafef1-1b40b67a-a2448d8a-cc181828_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.681563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.681607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.681623Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.681640Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.681654Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.713342Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.717140Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826611:3650], now have 1 active actors on pipe
2025-12-05T13:12:15.721200Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.721248Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.721655Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.722028Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.722072Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.722093Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.722328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.722341Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.722350Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.722362Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.722373Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.722407Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.722442Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.722453Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.722471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.722479Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.722490Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.722496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.722508Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.722595Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-12-05T13:12:15.722621Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.722631Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-12-05T13:12:15.722638Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.722648Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-12-05T13:12:15.755411Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-12-05T13:12:15.755521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.755534Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.755549Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.756325Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1764940335755
2025-12-05T13:12:15.757517Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.757670Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.774326Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:15.774413Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.774462Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.774495Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.774520Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.774568Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-12-05T13:12:15.774586Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.774610Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-12-05T13:12:15.774635Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.774660Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-12-05T13:12:15.775085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.775107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.775698Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.775121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.775139Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.775150Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.775187Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.775263Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1764940335720
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 53
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.780960Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826611:3650] destroyed
2025-12-05T13:12:15.781709Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.781740Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.781754Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.781772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.781785Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.784567Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.790339Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.789256Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826616:3654], now have 1 active actors on pipe
2025-12-05T13:12:15.789543Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.789575Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.789702Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|4921a3ac-20e2f8d4-cf4e7ff5-49125973_4 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:15.789734Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.789762Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.789785Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.789798Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.789818Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.789854Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.789866Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.789885Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.789938Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.790010Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.791899Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826616:3654] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|4921a3ac-20e2f8d4-cf4e7ff5-49125973_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|4921a3ac-20e2f8d4-cf4e7ff5-49125973_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.820666Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.820704Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.820719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.820737Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.820750Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.842073Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826618:3655], now have 1 active actors on pipe
2025-12-05T13:12:15.841405Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.847144Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.847196Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.847857Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.848329Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.848377Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.848426Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.848672Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.848739Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.848753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.848781Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.848793Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.848809Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.848820Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.848839Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.848953Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-12-05T13:12:15.849001Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.849023Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-12-05T13:12:15.849035Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.849050Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-12-05T13:12:15.852913Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-12-05T13:12:15.853000Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.853016Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.853036Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.853878Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1764940335852
2025-12-05T13:12:15.854963Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.855111Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.862936Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:15.863015Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.863060Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.863090Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.863123Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.863162Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-12-05T13:12:15.863177Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.863199Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-12-05T13:12:15.863222Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.863243Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-12-05T13:12:15.863669Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.863686Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.863700Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.863716Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.863726Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.863760Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.863832Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.864036Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.865359Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826618:3655] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1764940335848
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.878026Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.878796Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826624:3660], now have 1 active actors on pipe
2025-12-05T13:12:15.879167Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.879187Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.879281Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cecae900-e1aca816-8cfbe707-d2075037_5 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:15.879308Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.879318Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.879335Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.879344Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.879358Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.879386Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.879394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.879407Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.879445Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.879481Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.879773Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.880584Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826624:3660] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cecae900-e1aca816-8cfbe707-d2075037_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:15.882004Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.882044Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.882058Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.882077Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.882091Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|cecae900-e1aca816-8cfbe707-d2075037_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.906635Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.907610Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361018453826626:3661], now have 1 active actors on pipe
2025-12-05T13:12:15.911769Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:15.911825Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:15.912435Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.912929Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.912976Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.913004Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.913240Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.913290Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.913308Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.913328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.913341Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.913359Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.913371Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.913387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.913493Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-12-05T13:12:15.913526Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.913542Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-12-05T13:12:15.913553Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.913565Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-12-05T13:12:15.928132Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-12-05T13:12:15.932804Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:15.932853Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:15.932876Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.933661Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1764940335932
2025-12-05T13:12:15.934924Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:15.934954Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:15.935092Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-12-05T13:12:15.945685Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:15.945753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:15.945816Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:15.945841Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.945878Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-12-05T13:12:15.945896Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.945911Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-12-05T13:12:15.945927Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:15.945941Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-12-05T13:12:15.945945Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:15.946333Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.946354Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.946364Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.946376Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.946384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.946407Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:15.946486Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.946803Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1764940335913
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 30
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:15.948501Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361018453826626:3661] destroyed
2025-12-05T13:12:15.950415Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.951044Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826633:3666], now have 1 active actors on pipe
2025-12-05T13:12:15.951551Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.951585Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.951694Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6e94645a-8df0d069-da272039-8e0999a1_5 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:15.951733Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.951749Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.951772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:15.951785Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.951809Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.951846Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:15.951859Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:15.951877Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.951945Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:15.952006Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:15.952575Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:15.953350Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826633:3666] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6e94645a-8df0d069-da272039-8e0999a1_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|6e94645a-8df0d069-da272039-8e0999a1_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:15.978294Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:15.979261Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361018453826639:3670], now have 1 active actors on pipe
2025-12-05T13:12:15.983837Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:15.983893Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:15.984478Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:15.985025Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:15.985072Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:15.985101Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:15.985358Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.985374Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.985388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.985407Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:15.985421Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:15.985459Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:15.985503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:15.985517Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.985540Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.985550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:15.985565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:15.985575Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:15.985590Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.985694Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-12-05T13:12:15.985727Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.985741Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-12-05T13:12:15.985752Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:15.985766Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-12-05T13:12:16.006709Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-12-05T13:12:16.006796Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:16.006811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:16.006828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.007611Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1764940336005
2025-12-05T13:12:16.008915Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:16.009054Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-12-05T13:12:16.017284Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:16.017375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:16.017428Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:16.017449Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:16.017474Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.017518Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-12-05T13:12:16.017534Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.017555Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-12-05T13:12:16.017579Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.017601Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-12-05T13:12:16.018143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.018165Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.018179Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.018216Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.018227Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.018259Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:16.018349Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:16.018591Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1764940335985
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 29
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:16.021415Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361018453826639:3670] destroyed
2025-12-05T13:12:16.024891Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.027842Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361022748793942:3673], now have 1 active actors on pipe
2025-12-05T13:12:16.027932Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:16.027959Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:16.028065Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a76e213d-b30ec6fc-9d681397-73a622ad_6 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:16.028102Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.028115Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.028136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:16.028147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.028165Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.028198Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:16.028210Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:16.028227Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.028271Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:16.028324Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
2025-12-05T13:12:16.028582Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a76e213d-b30ec6fc-9d681397-73a622ad_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:16.033498Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361022748793942:3673] destroyed
2025-12-05T13:12:16.035953Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.035984Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.035998Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.036017Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.036032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|a76e213d-b30ec6fc-9d681397-73a622ad_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:16.089145Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.089178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.089193Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.089212Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.089228Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.122495Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.123248Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361022748793946:3677], now have 1 active actors on pipe
2025-12-05T13:12:16.128386Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:16.128458Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:16.129151Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:16.129704Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:16.129740Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:16.129768Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:16.129992Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:16.130041Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.130055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.130079Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.130090Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.130107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:16.130117Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.130134Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.130259Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-12-05T13:12:16.130292Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.130306Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-12-05T13:12:16.130319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.130334Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-12-05T13:12:16.141720Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-12-05T13:12:16.141808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:16.141822Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:16.141840Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.142636Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1764940336142
2025-12-05T13:12:16.143811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:16.143845Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:16.143981Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-12-05T13:12:16.155150Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:16.154056Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:16.154133Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:16.154221Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:16.154243Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.154283Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
CallPersQueueGRPC response:
2025-12-05T13:12:16.154297Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.154317Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-12-05T13:12:16.154347Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.154366Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-12-05T13:12:16.154748Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1764940336129
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 23
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-12-05T13:12:16.154765Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.154777Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.154793Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.154804Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.154837Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:16.154881Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:16.154907Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:16.158572Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361022748793946:3677] destroyed
2025-12-05T13:12:16.158764Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.159440Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361022748793950:3680], now have 1 active actors on pipe
2025-12-05T13:12:16.160264Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:16.160299Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:16.160395Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|72939d45-1fbe55ad-ebb62ae1-d8105983_6 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:16.160443Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.160456Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.160477Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:16.160490Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.160507Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.160539Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:16.160551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:16.160567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.160613Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:16.160663Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:16.161222Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|72939d45-1fbe55ad-ebb62ae1-d8105983_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:16.168678Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361022748793950:3680] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|72939d45-1fbe55ad-ebb62ae1-d8105983_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:16.187306Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.188045Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361022748793952:3681], now have 1 active actors on pipe
2025-12-05T13:12:16.192692Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:16.192749Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:16.193322Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:16.193877Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:16.193919Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:16.193947Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:16.194270Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.194288Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.194300Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.194317Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.194332Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.194373Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:16.194416Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.194429Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.194450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.194461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.194478Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:16.194488Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.194504Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.194605Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-12-05T13:12:16.194639Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.194654Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-12-05T13:12:16.194665Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.194678Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-12-05T13:12:16.204334Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-12-05T13:12:16.204551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:16.204569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:16.204586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.205355Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1764940336205
2025-12-05T13:12:16.206480Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:16.206612Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-12-05T13:12:16.230636Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:16.230702Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:16.230769Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:16.230790Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.230828Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-12-05T13:12:16.230840Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.230862Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-12-05T13:12:16.230882Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.230903Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-12-05T13:12:16.231258Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.231273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.231286Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.231722Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:16.231301Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.231311Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.231340Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:16.231403Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:16.231533Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1764940336192
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 37
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-12-05T13:12:16.233383Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361022748793952:3681] destroyed
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:16.235749Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361022748793957:3685], now have 1 active actors on pipe
2025-12-05T13:12:16.235807Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:16.235830Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:16.235920Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|df8be64a-580e504b-38dbe869-9b37a92e_7 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:16.235948Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.235960Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.235980Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:16.235990Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.236006Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.236037Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:16.236054Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:16.236069Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.236112Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:16.236156Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:16.234982Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|df8be64a-580e504b-38dbe869-9b37a92e_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:16.239663Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361022748793957:3685] destroyed
2025-12-05T13:12:16.236516Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:16.247226Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.247254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.247265Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.247281Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.247293Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|df8be64a-580e504b-38dbe869-9b37a92e_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:16.271270Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.272935Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361022748793960:3687], now have 1 active actors on pipe
2025-12-05T13:12:16.277836Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:16.277892Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:16.278452Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:16.278930Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:16.278977Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:16.279003Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:16.279467Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:16.279527Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.279540Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.279563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.279573Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.279589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:16.279598Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.279615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.279809Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-12-05T13:12:16.279852Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.279868Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-12-05T13:12:16.279881Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.279895Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-12-05T13:12:16.289279Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-12-05T13:12:16.289364Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:16.289377Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:16.289393Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.290096Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1764940336286
2025-12-05T13:12:16.291255Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:16.291381Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-12-05T13:12:16.294371Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.294395Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.294408Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.294423Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.294435Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.304849Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:16.304915Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:16.304978Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:16.305014Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.305051Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-12-05T13:12:16.305067Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.305089Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-12-05T13:12:16.305112Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.305131Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-12-05T13:12:16.305698Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.305721Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.305735Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.305750Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.305760Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.305796Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:16.305865Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:16.306585Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:16.306402Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:16.309077Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361022748793960:3687] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1764940336279
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:16.311164Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.312018Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361022748793965:3691], now have 1 active actors on pipe
2025-12-05T13:12:16.312074Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:16.312095Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:16.312194Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|923b968-affcc11f-c64925db-43c7fdb7_7 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:16.312221Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.312233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.312251Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:16.312261Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.312277Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.312307Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:16.312319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:16.312333Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.312374Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:16.312438Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:16.312976Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|923b968-affcc11f-c64925db-43c7fdb7_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:16.318096Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361022748793965:3691] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|923b968-affcc11f-c64925db-43c7fdb7_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:16.333618Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.334454Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361022748793967:3692], now have 1 active actors on pipe
2025-12-05T13:12:16.341717Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:16.341768Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:16.342321Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:16.342823Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:16.342860Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:16.342886Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:16.343289Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:16.343339Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.343354Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.343375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.343386Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.343400Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:16.343410Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.343426Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.343526Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-12-05T13:12:16.343559Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.343574Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-12-05T13:12:16.343584Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.343596Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-12-05T13:12:16.347595Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.347624Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.347637Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.347653Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.347664Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.353637Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-12-05T13:12:16.354445Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:16.354473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:16.354500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.355349Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1764940336355
2025-12-05T13:12:16.356631Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:16.356764Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-12-05T13:12:16.387270Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:16.387356Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:16.387433Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:16.387465Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.387470Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:16.387517Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-12-05T13:12:16.387535Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.387558Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-12-05T13:12:16.387584Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.387612Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-12-05T13:12:16.389728Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:16.388339Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.388370Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.388387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.388429Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.388443Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.388482Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:16.388565Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:16.391826Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361022748793967:3692] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1764940336342
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 44
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:16.394009Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.396857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.396915Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.396928Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.396943Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.396956Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.397386Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361022748793975:3696], now have 1 active actors on pipe
2025-12-05T13:12:16.404783Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:16.404831Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:16.404942Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|438b4288-4668c14a-59440a33-c3cb74a6_8 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:16.404980Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.404993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.405012Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:16.405023Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.405038Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.405068Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:16.405079Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:16.405094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.405134Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:16.405178Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|438b4288-4668c14a-59440a33-c3cb74a6_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:16.409825Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361022748793975:3696] destroyed
2025-12-05T13:12:16.408657Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|438b4288-4668c14a-59440a33-c3cb74a6_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:16.447827Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.447864Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.447876Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.447891Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.447903Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.448921Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.449433Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361022748793978:3698], now have 1 active actors on pipe
2025-12-05T13:12:16.453951Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:16.453994Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:16.454560Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:16.455064Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:16.455096Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:16.455118Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:16.455585Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:16.455631Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.455643Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.455670Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.455682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:16.455695Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:16.455704Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.455721Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.455815Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-12-05T13:12:16.455851Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.455867Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-12-05T13:12:16.455877Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:16.455892Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-12-05T13:12:16.475755Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-12-05T13:12:16.475867Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:16.475880Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:16.475898Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.483174Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1764940336482
2025-12-05T13:12:16.486892Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:16.487049Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-12-05T13:12:16.501457Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.501488Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.501502Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.501520Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.501534Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.516718Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:16.516792Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:16.516868Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:16.516870Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:16.516897Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.516934Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-12-05T13:12:16.516950Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.516968Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-12-05T13:12:16.516988Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:16.517007Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-12-05T13:12:16.517595Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:16.517642Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.517665Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:16.517684Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:16.517696Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:16.517746Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-12-05T13:12:16.517762Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-12-05T13:12:16.517775Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-12-05T13:12:16.517793Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-12-05T13:12:16.517831Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-12-05T13:12:16.517843Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-12-05T13:12:16.517855Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-12-05T13:12:16.517868Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-12-05T13:12:16.517886Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-12-05T13:12:16.517909Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-12-05T13:12:16.518002Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:16.518057Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-12-05T13:12:16.518092Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-12-05T13:12:16.518411Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-12-05T13:12:16.518666Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-12-05T13:12:16.518919Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-12-05T13:12:16.519087Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-12-05T13:12:16.519399Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-12-05T13:12:16.519497Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-12-05T13:12:16.519592Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-12-05T13:12:16.519681Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-12-05T13:12:16.521043Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:16.523276Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 9 blobs for compaction
2025-12-05T13:12:16.523342Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361022748793978:3698] destroyed
2025-12-05T13:12:16.523388Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-12-05T13:12:14.000000Z
2025-12-05T13:12:16.523410Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:16.523429Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:16.523448Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:16.523468Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:16.523487Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:16.523506Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:16.000000Z
2025-12-05T13:12:16.523524Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:16.000000Z
2025-12-05T13:12:16.523543Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:16.000000Z
2025-12-05T13:12:16.523591Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-12-05T13:12:16.523709Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-12-05T13:12:16.523779Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-12-05T13:12:16.523794Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:16.523818Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-12-05T13:12:16.523860Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.0/1
2025-12-05T13:12:16.523898Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-12-05T13:12:16.524912Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-12-05T13:12:16.524975Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:0 appended
2025-12-05T13:12:16.525022Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-12-05T13:12:16.525048Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:16.525074Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
CallPersQueueGRPC response:
2025-12-05T13:12:16.525431Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-12-05T13:12:16.525474Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1764940336450
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 64
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:16.525497Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:16.525523Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:16.525543Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:16.525564Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:16.533921Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.0/3
2025-12-05T13:12:16.533971Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-12-05T13:12:16.533989Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:0 appended
2025-12-05T13:12:16.534301Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:16.534338Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:16.534358Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:16.538484Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:16.545367Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.1/3
2025-12-05T13:12:16.545413Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-12-05T13:12:16.545431Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:1 appended
2025-12-05T13:12:16.545614Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.2/3
2025-12-05T13:12:16.545631Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-12-05T13:12:16.560972Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048956 count 2 nextOffset 2 batches 3
2025-12-05T13:12:16.561083Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:2 appended
2025-12-05T13:12:16.561125Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-12-05T13:12:16.561145Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:16.561167Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-12-05T13:12:16.562233Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.0/3
2025-12-05T13:12:16.562273Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-12-05T13:12:16.562293Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:0 appended
2025-12-05T13:12:16.581911Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.1/3
2025-12-05T13:12:16.581954Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-12-05T13:12:16.581973Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:1 appended
2025-12-05T13:12:16.582304Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.2/3
2025-12-05T13:12:16.582319Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-12-05T13:12:16.586077Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097712 count 3 nextOffset 3 batches 5
2025-12-05T13:12:16.586155Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:2 appended
2025-12-05T13:12:16.586185Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-12-05T13:12:16.586215Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:16.586235Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-12-05T13:12:16.597001Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.0/3
2025-12-05T13:12:16.597066Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-12-05T13:12:16.597085Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:0 appended
2025-12-05T13:12:16.601369Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.1/3
2025-12-05T13:12:16.601427Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-12-05T13:12:16.601455Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:1 appended
2025-12-05T13:12:16.601755Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.2/3
2025-12-05T13:12:16.601773Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-12-05T13:12:16.672707Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146468 count 4 nextOffset 4 batches 7
2025-12-05T13:12:16.672778Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:2 appended
2025-12-05T13:12:16.672813Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-12-05T13:12:16.672828Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:16.672844Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-12-05T13:12:16.681359Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:592: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037889 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 6] state 'Ready' dataSize 824 rowCount 2 cpuUsage 0
2025-12-05T13:12:16.686039Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.0/3
2025-12-05T13:12:16.686097Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-12-05T13:12:16.686115Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:0 appended
2025-12-05T13:12:16.705053Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.1/3
2025-12-05T13:12:16.705098Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-12-05T13:12:16.705122Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:1 appended
2025-12-05T13:12:16.705371Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.2/3
2025-12-05T13:12:16.705399Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-12-05T13:12:16.783057Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:619: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-12-05T13:12:16.783190Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:284: PersistSingleStats for pathId 6 shard idx 72057594046644480:2 data size 824 row count 2
2025-12-05T13:12:16.783237Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:305: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037889 maps to shardIdx: 72057594046644480:2 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 6], pathId map=Cluster, is column=0, is olap=0, RowCount 2, DataSize 824
2025-12-05T13:12:16.783327Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:498: Do not want to split tablet 72075186224037889 SplitByLoadNotEnabledForTable
2025-12-05T13:12:16.787766Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:619: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-12-05T13:12:16.987660Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:592: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037891 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 8] state 'Ready' dataSize 656 rowCount 2 cpuUsage 0
2025-12-05T13:12:17.007041Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195224 count 5 nextOffset 5 batches 9
2025-12-05T13:12:17.007107Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:2 appended
2025-12-05T13:12:17.007136Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-12-05T13:12:17.007147Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.007163Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-12-05T13:12:17.008199Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.0/3
2025-12-05T13:12:17.008233Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-12-05T13:12:17.008246Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:0 appended
2025-12-05T13:12:17.009594Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.1/3
2025-12-05T13:12:17.009633Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-12-05T13:12:17.009647Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:1 appended
2025-12-05T13:12:17.009912Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.2/3
2025-12-05T13:12:17.009927Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-12-05T13:12:17.037779Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243980 count 6 nextOffset 6 batches 11
2025-12-05T13:12:17.037842Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:2 appended
2025-12-05T13:12:17.037870Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-12-05T13:12:17.037880Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.037895Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-12-05T13:12:17.038895Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.0/3
2025-12-05T13:12:17.038927Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-12-05T13:12:17.038940Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:0 appended
2025-12-05T13:12:17.040136Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.1/3
2025-12-05T13:12:17.040159Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-12-05T13:12:17.040171Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:1 appended
2025-12-05T13:12:17.040783Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.2/3
2025-12-05T13:12:17.040809Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-12-05T13:12:17.044017Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292736 count 7 nextOffset 7 batches 13
2025-12-05T13:12:17.044079Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:2 appended
2025-12-05T13:12:17.044104Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-12-05T13:12:17.044114Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.044946Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-12-05T13:12:17.049147Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.0/3
2025-12-05T13:12:17.049211Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-12-05T13:12:17.049228Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:0 appended
2025-12-05T13:12:17.050532Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.1/3
2025-12-05T13:12:17.050580Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-12-05T13:12:17.050597Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:1 appended
2025-12-05T13:12:17.050857Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.2/3
2025-12-05T13:12:17.050880Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-12-05T13:12:17.067159Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341492 count 8 nextOffset 8 batches 15
2025-12-05T13:12:17.067238Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:2 appended
2025-12-05T13:12:17.067265Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-12-05T13:12:17.067277Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.067294Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-12-05T13:12:17.068369Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.0/3
2025-12-05T13:12:17.068403Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-12-05T13:12:17.076525Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:0 appended
2025-12-05T13:12:17.077908Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.1/3
2025-12-05T13:12:17.077938Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-12-05T13:12:17.077954Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:1 appended
2025-12-05T13:12:17.078219Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.2/3
2025-12-05T13:12:17.078244Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-12-05T13:12:17.087822Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:619: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-12-05T13:12:17.087969Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:284: PersistSingleStats for pathId 8 shard idx 72057594046644480:4 data size 656 row count 2
2025-12-05T13:12:17.088014Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:305: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037891 maps to shardIdx: 72057594046644480:4 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 8], pathId map=Versions, is column=0, is olap=0, RowCount 2, DataSize 656
2025-12-05T13:12:17.088111Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:498: Do not want to split tablet 72075186224037891 SplitByLoadNotEnabledForTable
2025-12-05T13:12:17.088362Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:619: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-12-05T13:12:17.139776Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7718: Cannot get console configs
2025-12-05T13:12:17.139812Z node 4 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-12-05T13:12:17.204507Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365511
2025-12-05T13:12:17.204594Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1099: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365511 WTime 1764940337204
2025-12-05T13:12:17.218539Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-12-05T13:12:17.218599Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:2 appended
2025-12-05T13:12:17.219464Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:636: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1764940337219
2025-12-05T13:12:17.219689Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361022748793984:3703], now have 1 active actors on pipe
2025-12-05T13:12:17.220423Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|25f7d3ed-9204e79e-9cde8069-4d86e00_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:17.219764Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.219795Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.219841Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.219854Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.219865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.219879Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.219890Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.220006Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|25f7d3ed-9204e79e-9cde8069-4d86e00_8 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:17.220026Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.220038Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.220054Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.220065Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.220080Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.220107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.220121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.220136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.220167Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.220215Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.220887Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.220900Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.220910Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.220923Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.220932Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.220975Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.222586Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365511
2025-12-05T13:12:17.222696Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-12-05T13:12:17.223048Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361022748793984:3703] destroyed
2025-12-05T13:12:17.225411Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:592: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037890 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 7] state 'Ready' dataSize 0 rowCount 0 cpuUsage 0
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|25f7d3ed-9204e79e-9cde8069-4d86e00_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.258989Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.261328Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761337:3732], now have 1 active actors on pipe
2025-12-05T13:12:17.268610Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365511 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.268663Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.268720Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.269088Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.269106Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.269122Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.269147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.269163Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.269194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000000_00000_0000000001_00000?
2025-12-05T13:12:17.269214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000001_00000_0000000001_00002?
2025-12-05T13:12:17.269231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000002_00000_0000000001_00002?
2025-12-05T13:12:17.269243Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000003_00000_0000000001_00002?
2025-12-05T13:12:17.269257Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000004_00000_0000000001_00002?
2025-12-05T13:12:17.269262Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.269267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000005_00000_0000000001_00002?
2025-12-05T13:12:17.269277Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000006_00000_0000000001_00002?
2025-12-05T13:12:17.269290Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000007_00000_0000000001_00002?
2025-12-05T13:12:17.269295Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.269304Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037892][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000008_00000_0000000001_00002?
2025-12-05T13:12:17.269457Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365511
2025-12-05T13:12:17.269505Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-12-05T13:12:17.269966Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.270090Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.270122Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.270153Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-12-05T13:12:17.270164Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-12-05T13:12:17.270174Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-12-05T13:12:17.270185Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-12-05T13:12:17.270206Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-12-05T13:12:17.270216Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-12-05T13:12:17.270226Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-12-05T13:12:17.270235Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-12-05T13:12:17.270245Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-12-05T13:12:17.271265Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.271304Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.271332Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.271834Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.271886Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.271900Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.271932Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.271946Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.271963Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.271973Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.271993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.272102Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-12-05T13:12:17.272143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.272159Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-12-05T13:12:17.272170Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.272181Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-12-05T13:12:17.275750Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.275800Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.275837Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.275868Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.275903Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.275932Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.275961Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.275985Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.276016Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.276078Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.276129Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-12-05T13:12:17.276131Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.276155Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.276168Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.276171Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.276185Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.276216Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.276234Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.276274Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.276700Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.277216Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.277744Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.278308Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.278842Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.279322Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.279801Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.302139Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-12-05T13:12:17.302257Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.302273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.302289Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.303057Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1764940337302
2025-12-05T13:12:17.304506Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.304637Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.318737Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.320302Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.318820Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.318904Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.318927Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.318974Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-12-05T13:12:17.318993Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.319015Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-12-05T13:12:17.319042Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.319064Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-12-05T13:12:17.319483Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.319736Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.319756Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.319771Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.319788Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.319801Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.319843Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-12-05T13:12:17.319857Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-12-05T13:12:17.319871Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-12-05T13:12:17.319885Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-12-05T13:12:17.319899Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-12-05T13:12:17.319914Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-12-05T13:12:17.319927Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-12-05T13:12:17.319942Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-12-05T13:12:17.319954Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-12-05T13:12:17.319964Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037894][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-12-05T13:12:17.320046Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.320110Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.320123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.320135Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.320151Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.320163Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.320183Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037894][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-12-05T13:12:17.320198Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-12-05T13:12:17.320327Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-12-05T13:12:17.320528Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-12-05T13:12:17.320805Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-12-05T13:12:17.320992Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-12-05T13:12:17.321245Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.321273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.321294Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.321316Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.321328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.321457Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-12-05T13:12:17.321560Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-12-05T13:12:17.321653Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-12-05T13:12:17.321755Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1764940337270
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 48
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.325987Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:619: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-12-05T13:12:17.326086Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.326122Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:284: PersistSingleStats for pathId 7 shard idx 72057594046644480:3 data size 0 row count 0
2025-12-05T13:12:17.326161Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:305: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037890 maps to shardIdx: 72057594046644480:3 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 7], pathId map=Topics, is column=0, is olap=0, RowCount 0, DataSize 0
2025-12-05T13:12:17.326272Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:498: Do not want to split tablet 72075186224037890 SplitByLoadNotEnabledForTable
2025-12-05T13:12:17.326451Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:619: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-12-05T13:12:17.322556Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037894][Partition][0][StateIdle] Request 9 blobs for compaction
2025-12-05T13:12:17.322624Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761337:3732] destroyed
2025-12-05T13:12:17.322674Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-12-05T13:12:14.000000Z
2025-12-05T13:12:17.322698Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:17.322719Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:17.322743Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:17.322766Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:15.000000Z
2025-12-05T13:12:17.322788Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:16.000000Z
2025-12-05T13:12:17.322809Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:16.000000Z
2025-12-05T13:12:17.322830Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:16.000000Z
2025-12-05T13:12:17.322870Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-12-05T13:12:17.000000Z
2025-12-05T13:12:17.322960Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-12-05T13:12:17.323048Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-12-05T13:12:17.323105Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:17.323151Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:17.323197Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:17.323245Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:17.323270Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:17.323299Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:17.323326Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:17.323350Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-12-05T13:12:17.324476Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037894][Partition][0][StateIdle] Continue blobs compaction
2025-12-05T13:12:17.324516Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-12-05T13:12:17.324529Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.324550Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-12-05T13:12:17.324592Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 0.0/1
2025-12-05T13:12:17.324621Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-12-05T13:12:17.325964Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-12-05T13:12:17.325988Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 0:0 appended
2025-12-05T13:12:17.326015Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-12-05T13:12:17.326026Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.326045Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-12-05T13:12:17.327009Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361027043761349:3743], now have 1 active actors on pipe
2025-12-05T13:12:17.327285Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.0/3
2025-12-05T13:12:17.327304Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:17.327327Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-12-05T13:12:17.327334Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:17.327339Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:0 appended
2025-12-05T13:12:17.327491Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ca7f079-a0147bf4-4987f9b3-91ebb552_9 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:17.327541Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.327560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.327592Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.327606Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.327627Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.327661Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.327673Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.327690Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.327741Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.327797Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.328661Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361027043761349:3743] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ca7f079-a0147bf4-4987f9b3-91ebb552_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:17.329156Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.1/3
2025-12-05T13:12:17.328006Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.329190Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-12-05T13:12:17.329205Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:1 appended
2025-12-05T13:12:17.329451Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.2/3
2025-12-05T13:12:17.329472Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|ca7f079-a0147bf4-4987f9b3-91ebb552_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.357799Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048956 count 2 nextOffset 2 batches 3
2025-12-05T13:12:17.357875Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:2 appended
2025-12-05T13:12:17.357906Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-12-05T13:12:17.357917Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.357932Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-12-05T13:12:17.358953Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.0/3
2025-12-05T13:12:17.358997Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-12-05T13:12:17.359013Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:0 appended
2025-12-05T13:12:17.361054Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.1/3
2025-12-05T13:12:17.361091Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-12-05T13:12:17.361110Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:1 appended
2025-12-05T13:12:17.361291Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.2/3
2025-12-05T13:12:17.361310Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-12-05T13:12:17.365675Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097712 count 3 nextOffset 3 batches 5
2025-12-05T13:12:17.365739Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:2 appended
2025-12-05T13:12:17.365884Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-12-05T13:12:17.365905Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.365926Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-12-05T13:12:17.367064Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.0/3
2025-12-05T13:12:17.367109Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-12-05T13:12:17.367123Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:0 appended
2025-12-05T13:12:17.368239Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.1/3
2025-12-05T13:12:17.368260Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-12-05T13:12:17.368273Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:1 appended
2025-12-05T13:12:17.368502Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.2/3
2025-12-05T13:12:17.368518Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-12-05T13:12:17.371270Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146468 count 4 nextOffset 4 batches 7
2025-12-05T13:12:17.371316Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:2 appended
2025-12-05T13:12:17.371340Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-12-05T13:12:17.371351Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.371368Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-12-05T13:12:17.372320Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.0/3
2025-12-05T13:12:17.372346Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-12-05T13:12:17.372358Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:0 appended
2025-12-05T13:12:17.374480Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.1/3
2025-12-05T13:12:17.374515Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-12-05T13:12:17.374528Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:1 appended
2025-12-05T13:12:17.374732Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.2/3
2025-12-05T13:12:17.374747Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-12-05T13:12:17.379949Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195224 count 5 nextOffset 5 batches 9
2025-12-05T13:12:17.380006Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:2 appended
2025-12-05T13:12:17.380033Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-12-05T13:12:17.380042Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.380058Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-12-05T13:12:17.381237Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.0/3
2025-12-05T13:12:17.381279Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-12-05T13:12:17.381294Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:0 appended
2025-12-05T13:12:17.382680Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.1/3
2025-12-05T13:12:17.382704Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-12-05T13:12:17.382717Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:1 appended
2025-12-05T13:12:17.382899Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.2/3
2025-12-05T13:12:17.382914Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-12-05T13:12:17.387262Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.387988Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243980 count 6 nextOffset 6 batches 11
2025-12-05T13:12:17.388043Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:2 appended
2025-12-05T13:12:17.388072Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-12-05T13:12:17.388082Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.388100Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-12-05T13:12:17.388171Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361027043761371:3749], now have 1 active actors on pipe
2025-12-05T13:12:17.389178Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.0/3
2025-12-05T13:12:17.389212Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-12-05T13:12:17.389229Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:0 appended
2025-12-05T13:12:17.390408Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.1/3
2025-12-05T13:12:17.390432Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-12-05T13:12:17.390444Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:1 appended
2025-12-05T13:12:17.390633Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.2/3
2025-12-05T13:12:17.390649Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-12-05T13:12:17.395703Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292736 count 7 nextOffset 7 batches 13
2025-12-05T13:12:17.395756Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:2 appended
2025-12-05T13:12:17.395783Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-12-05T13:12:17.395792Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.395807Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-12-05T13:12:17.397067Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.0/3
2025-12-05T13:12:17.397102Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-12-05T13:12:17.397117Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:0 appended
2025-12-05T13:12:17.397276Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:17.397319Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:17.397911Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.398414Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.1/3
2025-12-05T13:12:17.398437Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-12-05T13:12:17.398451Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:1 appended
2025-12-05T13:12:17.398469Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.398538Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.398584Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.398682Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.2/3
2025-12-05T13:12:17.398706Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-12-05T13:12:17.399177Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.399244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.399258Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.399285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.399298Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.399316Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.399328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.399349Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.399457Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-12-05T13:12:17.399494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.399511Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-12-05T13:12:17.399524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.399540Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-12-05T13:12:17.403600Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-12-05T13:12:17.403680Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.403694Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.403713Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.404391Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1764940337404
2025-12-05T13:12:17.405600Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.405734Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.415781Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341492 count 8 nextOffset 8 batches 15
2025-12-05T13:12:17.415843Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:2 appended
2025-12-05T13:12:17.415872Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-12-05T13:12:17.415883Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-12-05T13:12:17.415898Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-12-05T13:12:17.416458Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.416522Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.416600Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.416624Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.416663Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-12-05T13:12:17.416679Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.416702Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-12-05T13:12:17.416724Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.416750Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-12-05T13:12:17.417807Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.417232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.417259Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.417272Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.417289Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.417301Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.417338Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.417365Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.0/3
2025-12-05T13:12:17.417399Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-12-05T13:12:17.417411Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.417415Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:0 appended
2025-12-05T13:12:17.417618Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.418655Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.1/3
2025-12-05T13:12:17.418678Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-12-05T13:12:17.418693Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:1 appended
2025-12-05T13:12:17.418902Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.2/3
2025-12-05T13:12:17.418920Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-12-05T13:12:17.419406Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361027043761371:3749] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1764940337399
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 17
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.424227Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.424255Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.424268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.424287Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.424300Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.433402Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.489953Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365511
2025-12-05T13:12:17.490023Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1099: [72075186224037894][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic12' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365511 WTime 1764940337489
2025-12-05T13:12:17.492907Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-12-05T13:12:17.492961Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:2 appended
2025-12-05T13:12:17.493548Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:636: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1764940337493
2025-12-05T13:12:17.493707Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.493719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.493730Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.493746Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.493760Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.493821Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761379:3753], now have 1 active actors on pipe
2025-12-05T13:12:17.493893Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.493910Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.493939Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.494043Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365511
2025-12-05T13:12:17.494099Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-12-05T13:12:17.494180Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|49f15c28-54c47dae-8036f662-bc5f8573_9 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:17.494212Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.494225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.494246Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.494256Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.494272Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.494304Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.494316Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.494333Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.494371Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.494486Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.496659Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|49f15c28-54c47dae-8036f662-bc5f8573_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:17.508566Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761379:3753] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|49f15c28-54c47dae-8036f662-bc5f8573_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.524547Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.524583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.524597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.524616Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.524639Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.531677Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.536932Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761384:3757], now have 1 active actors on pipe
2025-12-05T13:12:17.549583Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.549641Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.550223Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.550736Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.550771Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.550800Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.551082Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.551133Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.551147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.551172Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.551184Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.551201Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.551213Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.551230Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.551338Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-12-05T13:12:17.551370Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.551385Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-12-05T13:12:17.551397Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.551412Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-12-05T13:12:17.559094Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-12-05T13:12:17.559175Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.559188Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.559207Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.559944Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1764940337559
2025-12-05T13:12:17.562642Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.562791Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.571852Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365511 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.571894Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.571943Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.572167Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:17.572180Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.572330Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365511
2025-12-05T13:12:17.572368Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-12-05T13:12:17.572873Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.572921Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.572984Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.573006Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.573044Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-12-05T13:12:17.573061Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.573083Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-12-05T13:12:17.573103Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.573124Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-12-05T13:12:17.573735Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.573756Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.573768Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.573783Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.573795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.573828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000000_00000_0000000001_00000?
2025-12-05T13:12:17.573857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000001_00000_0000000001_00002?
2025-12-05T13:12:17.573872Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000002_00000_0000000001_00002?
2025-12-05T13:12:17.573886Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000003_00000_0000000001_00002?
2025-12-05T13:12:17.573899Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000004_00000_0000000001_00002?
2025-12-05T13:12:17.573911Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000005_00000_0000000001_00002?
2025-12-05T13:12:17.573924Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000006_00000_0000000001_00002?
2025-12-05T13:12:17.573937Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000007_00000_0000000001_00002?
2025-12-05T13:12:17.573949Z node 5 :PERSQUEUE DEBUG: partition.cpp:2662: [72075186224037894][Partition][0][StateIdle] Key deleted: d0000000000_00000000000000000008_00000_0000000001_00002?
2025-12-05T13:12:17.574007Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.574067Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.574108Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.574129Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-12-05T13:12:17.574137Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-12-05T13:12:17.574146Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-12-05T13:12:17.574154Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-12-05T13:12:17.574162Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-12-05T13:12:17.574170Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-12-05T13:12:17.574178Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-12-05T13:12:17.574186Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-12-05T13:12:17.574212Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-12-05T13:12:17.576174Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.575416Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.579018Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761384:3757] destroyed
2025-12-05T13:12:17.579278Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579314Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579349Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579379Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579423Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579451Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579480Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579508Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579540Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.579611Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.579655Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.579679Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.579693Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.579705Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.579721Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.579732Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.579761Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1764940337551
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 21
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.580280Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-12-05T13:12:17.580317Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.580663Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.581043Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.581433Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.581825Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.582062Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.585907Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.590307Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.590407Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361027043761391:3763], now have 1 active actors on pipe
2025-12-05T13:12:17.590495Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:17.590555Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:17.590769Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|67a7af2e-6e362864-30c29576-45231e8f_10 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:17.590808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.590814Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.590820Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.590865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.590882Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.590923Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.590989Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.591025Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.591070Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.591148Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.591199Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.591480Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.592271Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361027043761391:3763] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|67a7af2e-6e362864-30c29576-45231e8f_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|67a7af2e-6e362864-30c29576-45231e8f_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.598249Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.598290Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.598307Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.598325Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.598339Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.612858Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.613790Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361027043761408:3771], now have 1 active actors on pipe
2025-12-05T13:12:17.618556Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:17.618606Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:17.619125Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.619616Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.619650Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.619679Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.619904Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.619952Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.619964Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.619989Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.620000Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.620016Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.620027Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.620044Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.620142Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-12-05T13:12:17.620174Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.620189Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-12-05T13:12:17.620199Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.620214Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-12-05T13:12:17.646203Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-12-05T13:12:17.646300Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.646313Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.646331Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.647117Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1764940337644
2025-12-05T13:12:17.648231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:17.648266Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.648402Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.665850Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.664508Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.664585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.664647Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.664668Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.664707Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-12-05T13:12:17.664722Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.664744Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-12-05T13:12:17.664765Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.664786Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-12-05T13:12:17.665145Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.665161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.665173Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.665189Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.665200Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.665232Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.665298Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.665552Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.667331Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361027043761408:3771] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1764940337619
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 44
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.671110Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.671888Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761412:3774], now have 1 active actors on pipe
2025-12-05T13:12:17.671981Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.672003Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.672100Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d25d5e69-e8131100-7a9023a2-e2ef0b26_10 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:17.672129Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.672140Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.672159Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.672170Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.672187Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.672217Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.672230Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.672246Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.672303Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.672350Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.672616Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.673878Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761412:3774] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d25d5e69-e8131100-7a9023a2-e2ef0b26_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|d25d5e69-e8131100-7a9023a2-e2ef0b26_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.698611Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.698649Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.698665Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.698686Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.698702Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.703126Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.703799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761414:3775], now have 1 active actors on pipe
2025-12-05T13:12:17.708110Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.708165Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.708693Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.709159Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.709190Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.709220Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.709478Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.709524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.709537Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.709559Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.709570Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.709585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.709597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.709614Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.709714Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-12-05T13:12:17.709747Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.709761Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-12-05T13:12:17.709772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.709786Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-12-05T13:12:17.717709Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-12-05T13:12:17.717791Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.717805Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.717824Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.718666Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1764940337718
2025-12-05T13:12:17.719870Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.720002Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.742052Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.742117Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.742183Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.742219Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.742257Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-12-05T13:12:17.742272Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.742294Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-12-05T13:12:17.742315Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.742336Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-12-05T13:12:17.742727Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.742744Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.742757Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.742773Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.742784Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.742815Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.742880Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.743021Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.744432Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761414:3775] destroyed
2025-12-05T13:12:17.743218Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.745492Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.745524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.745537Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.745552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.745564Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.745796Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1764940337709
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 1
    WriteTimeMs: 30
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.758595Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.759354Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361027043761419:3779], now have 1 active actors on pipe
2025-12-05T13:12:17.759563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:17.759594Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:17.759687Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e80e2a00-88ffe982-c27f5c20-276fbf71_11 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:17.759719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.759736Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.759754Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.759766Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.759783Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.759816Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.759827Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.759843Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.759888Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.759959Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.760155Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.761265Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361027043761419:3779] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e80e2a00-88ffe982-c27f5c20-276fbf71_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e80e2a00-88ffe982-c27f5c20-276fbf71_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.784143Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.790284Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361027043761423:3782], now have 1 active actors on pipe
2025-12-05T13:12:17.792759Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:17.792821Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:17.793384Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.793900Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.793938Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.793967Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.794227Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.794280Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.794295Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.794320Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.794332Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.794348Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.794361Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.794380Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.794493Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-12-05T13:12:17.794526Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.794546Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-12-05T13:12:17.794559Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.794575Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-12-05T13:12:17.800438Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-12-05T13:12:17.803093Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.803131Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.803147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.803166Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.803180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.803997Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.804019Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.804037Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.804895Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1764940337804
2025-12-05T13:12:17.806162Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.806320Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.822017Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.822106Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.822160Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.822177Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.822223Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-12-05T13:12:17.822240Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.822259Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-12-05T13:12:17.822282Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.822312Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-12-05T13:12:17.822651Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.822665Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.822674Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.822686Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.822694Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.822718Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.822767Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1183: [PQ: 72075186224037892] Topic 'rt3.dc1--topic1' counters. CacheSize 11536577 CachedBlobs 5
2025-12-05T13:12:17.822817Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.822932Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.823092Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1764940337794
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 26
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.824897Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361027043761423:3782] destroyed
2025-12-05T13:12:17.826171Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.826857Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761427:3785], now have 1 active actors on pipe
2025-12-05T13:12:17.827307Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.827339Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.827432Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|bd53b208-efd810aa-f1e30f0f-bfd4c4cc_11 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:17.827460Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.827473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.827493Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.827505Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.827524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.827552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.827565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.827582Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.827623Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.827666Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.828113Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|bd53b208-efd810aa-f1e30f0f-bfd4c4cc_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:17.832821Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761427:3785] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|bd53b208-efd810aa-f1e30f0f-bfd4c4cc_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.849516Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.849628Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.849655Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.849680Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.849697Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.849710Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.850867Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761429:3786], now have 1 active actors on pipe
2025-12-05T13:12:17.855315Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.855367Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.855937Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.856526Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.856562Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.856589Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.856835Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.856884Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.856898Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.856922Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.856934Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.856949Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.856962Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.856981Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.857090Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-12-05T13:12:17.857122Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.857136Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-12-05T13:12:17.857148Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.857162Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-12-05T13:12:17.862964Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-12-05T13:12:17.863056Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.863069Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.863087Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.863933Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1764940337863
2025-12-05T13:12:17.866313Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.866463Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.877556Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.877614Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.877676Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.877694Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.877732Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-12-05T13:12:17.877746Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.877772Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-12-05T13:12:17.877794Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.877813Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-12-05T13:12:17.878183Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.878218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.878233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.878249Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.878261Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.878294Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.878362Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.879157Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1764940337854
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 22
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.878979Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.882909Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761429:3786] destroyed
2025-12-05T13:12:17.882958Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361027043761433:3789], now have 1 active actors on pipe
2025-12-05T13:12:17.883214Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:17.883241Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:17.883323Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|acd6e66a-cd47dfff-41582fef-61f800f0_12 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:17.883348Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.883360Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.883377Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.883388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.883404Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.883433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.883444Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.883471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.883512Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.883558Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.882445Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.884025Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|acd6e66a-cd47dfff-41582fef-61f800f0_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:17.887044Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361027043761433:3789] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|acd6e66a-cd47dfff-41582fef-61f800f0_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.904513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.904546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.904561Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.904577Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.904594Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.911554Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.912132Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361027043761435:3790], now have 1 active actors on pipe
2025-12-05T13:12:17.916689Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:17.916738Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:17.917278Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.917782Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.917816Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.917843Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.918109Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.918158Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.918172Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.918211Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.918223Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.918240Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.918253Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.918272Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.918376Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-12-05T13:12:17.918407Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.918421Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-12-05T13:12:17.918433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.918448Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-12-05T13:12:17.923165Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-12-05T13:12:17.923250Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.923266Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.923287Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.926018Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1764940337922
2025-12-05T13:12:17.927459Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.927600Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.936051Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:17.936123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.936185Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.936206Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.936245Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-12-05T13:12:17.936261Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.936287Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-12-05T13:12:17.936309Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.936331Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-12-05T13:12:17.936811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.936829Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.936842Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.936857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.936868Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.936901Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.936970Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.937722Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1764940337918
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 15
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:17.937552Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.941299Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.939882Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361027043761435:3790] destroyed
2025-12-05T13:12:17.942177Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761440:3794], now have 1 active actors on pipe
2025-12-05T13:12:17.942252Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.942274Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.942372Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|c13d239b-a22123e5-694f2796-b75e160d_12 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:17.942402Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.942415Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.942433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:17.942445Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.942462Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
CallPersQueueGRPC response:
2025-12-05T13:12:17.942490Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:17.942501Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:17.942516Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.942556Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:17.942599Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|c13d239b-a22123e5-694f2796-b75e160d_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:17.942808Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:17.947245Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761440:3794] destroyed
2025-12-05T13:12:17.950128Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.950168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.950185Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.950219Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.950233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|c13d239b-a22123e5-694f2796-b75e160d_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:17.971625Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361027043761449:3801], now have 1 active actors on pipe
2025-12-05T13:12:17.970960Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:17.975872Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:17.975908Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:17.976336Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:17.976796Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:17.976836Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:17.976864Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:17.977057Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:17.977112Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.977129Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.977153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.977163Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:17.977179Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:17.977189Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.977205Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.977308Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-12-05T13:12:17.977344Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.977359Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-12-05T13:12:17.977372Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:17.977387Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-12-05T13:12:17.985678Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-12-05T13:12:17.985761Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:17.985774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:17.985794Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.986561Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1764940337984
2025-12-05T13:12:17.987751Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:17.987894Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-12-05T13:12:17.995437Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:17.995496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:17.995551Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:17.995584Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.995620Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-12-05T13:12:17.995632Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.995652Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-12-05T13:12:17.995674Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:17.995695Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-12-05T13:12:17.996044Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:17.996060Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.996071Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:17.996085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:17.996095Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:17.996124Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:17.996182Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:17.996307Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:17.997781Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361027043761449:3801] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1764940337976
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 18
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:17.996869Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:18.001518Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.005276Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.005306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.005315Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361031338728752:3804], now have 1 active actors on pipe
2025-12-05T13:12:18.005320Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.005337Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.005351Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.005920Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:18.005954Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:18.006068Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|dc6f5c95-c9968427-7a5e9aa-428092b4_13 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:18.006094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.006107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.006126Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:18.006139Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.006156Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.006214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:18.006230Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:18.006247Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.006286Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:18.006335Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.006510Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|dc6f5c95-c9968427-7a5e9aa-428092b4_13"
    Status: Active
    SeqNo: 0
  }
}
2025-12-05T13:12:18.007793Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361031338728752:3804] destroyed
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|dc6f5c95-c9968427-7a5e9aa-428092b4_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:18.041943Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.042748Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361031338728754:3805], now have 1 active actors on pipe
2025-12-05T13:12:18.047660Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:18.047710Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:18.048227Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:18.048737Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:18.048772Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:18.048801Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:18.049025Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:18.049073Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.049088Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.049113Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.049123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.049139Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:18.049149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.049165Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.049280Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-12-05T13:12:18.049317Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.049333Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-12-05T13:12:18.049345Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.049361Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-12-05T13:12:18.065461Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-12-05T13:12:18.065704Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:18.065720Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:18.065737Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.066489Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1764940338066
2025-12-05T13:12:18.067544Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:18.067566Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:18.067689Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-12-05T13:12:18.091309Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:18.091376Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:18.091436Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:18.091461Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.091500Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-12-05T13:12:18.091515Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.091536Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-12-05T13:12:18.091558Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.091576Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-12-05T13:12:18.091966Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.091982Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.091995Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.092011Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.092022Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.092079Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:18.092143Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.092818Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:18.098170Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:18.099426Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361031338728754:3805] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1764940338048
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 39
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:18.105642Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.105670Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.105685Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.105703Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.105717Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.111173Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361031338728760:3808], now have 1 active actors on pipe
2025-12-05T13:12:18.111601Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:18.111633Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:18.111734Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|13ac4f60-4bc2a832-df0a10f-66289341_13 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:18.111765Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.111779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.111798Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:18.111811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.111829Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.111858Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:18.111870Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:18.111887Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.111931Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:18.111982Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.109906Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.112595Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:18.113374Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361031338728760:3808] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|13ac4f60-4bc2a832-df0a10f-66289341_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|13ac4f60-4bc2a832-df0a10f-66289341_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:18.151322Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.152610Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361031338728764:3813], now have 1 active actors on pipe
2025-12-05T13:12:18.157391Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:18.157440Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:18.158016Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:18.158572Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:18.158609Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:18.158638Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:18.158900Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:18.158952Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.158965Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.158990Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.159000Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.159018Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:18.159030Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.159048Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.159159Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-12-05T13:12:18.159191Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.159205Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-12-05T13:12:18.159215Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.159228Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-12-05T13:12:18.171317Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.171358Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.171374Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.171392Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.171406Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.174471Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-12-05T13:12:18.174571Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:18.174591Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:18.174612Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.175444Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1764940338171
2025-12-05T13:12:18.176755Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:18.176892Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-12-05T13:12:18.199057Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:18.197752Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:18.197833Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:18.197909Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:18.197931Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.197972Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-12-05T13:12:18.197988Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.198010Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-12-05T13:12:18.198032Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.198054Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-12-05T13:12:18.198475Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:18.198630Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.198649Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.198664Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.198682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.198694Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.198732Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:18.198814Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1764940338158
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 36
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:18.202970Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361031338728764:3813] destroyed
2025-12-05T13:12:18.203073Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.203844Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361031338728768:3816], now have 1 active actors on pipe
2025-12-05T13:12:18.204025Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:18.204051Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:18.204141Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|541cec12-3104a07d-5cbde066-e1ee04e_14 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:18.204169Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.204180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.204197Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:18.204208Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.204225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.204256Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:18.204265Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:18.204279Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.204321Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:18.204363Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.204581Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|541cec12-3104a07d-5cbde066-e1ee04e_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:18.209830Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.209863Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.209877Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.209894Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.209907Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.209985Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361031338728768:3816] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|541cec12-3104a07d-5cbde066-e1ee04e_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:18.237013Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.240586Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361031338728770:3817], now have 1 active actors on pipe
2025-12-05T13:12:18.242411Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:18.242472Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:18.243078Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:18.243649Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:18.243699Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:18.243727Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:18.244201Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:18.244263Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.244280Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.244303Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.244314Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.244330Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:18.244341Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.244358Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.244605Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-12-05T13:12:18.244649Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.244666Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-12-05T13:12:18.244678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.244692Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-12-05T13:12:18.253976Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-12-05T13:12:18.254091Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:18.254107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:18.254126Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.255005Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1764940338253
2025-12-05T13:12:18.256247Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:18.256389Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-12-05T13:12:18.276528Z node 5 :PERSQUEUE DEBUG: partition.cpp:2260: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-12-05T13:12:18.276799Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:18.276855Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:18.276916Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:18.276935Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.276972Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-12-05T13:12:18.276986Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.277010Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-12-05T13:12:18.277030Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.277050Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-12-05T13:12:18.277678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.277694Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.277707Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.277722Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.277734Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.277765Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:18.277802Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:18.277828Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.278067Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1764940338240
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 4
    WriteTimeMs: 30
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:18.280769Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361031338728770:3817] destroyed
2025-12-05T13:12:18.290228Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.291237Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361031338728777:3822], now have 1 active actors on pipe
2025-12-05T13:12:18.291594Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:18.291625Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:18.291735Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9cb0ab04-2ce1302c-fbed4e57-cd3b4c5f_14 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:18.291764Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.291777Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.291796Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:18.291808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.291836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.291868Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:18.291880Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:18.291907Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.291949Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:18.291997Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.298590Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:18.299952Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361031338728777:3822] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9cb0ab04-2ce1302c-fbed4e57-cd3b4c5f_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:29998
2025-12-05T13:12:18.308599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.308632Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.308646Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.308664Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.308677Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|9cb0ab04-2ce1302c-fbed4e57-cd3b4c5f_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:18.328785Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.329667Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361031338728779:3824], now have 1 active actors on pipe
2025-12-05T13:12:18.335646Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:18.335702Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:18.336263Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:18.336799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:18.336850Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:18.336878Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:18.337265Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:18.337323Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.337338Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.337367Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.337381Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.337398Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:18.337409Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.337438Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.337532Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-12-05T13:12:18.337571Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.337587Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-12-05T13:12:18.337600Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.337615Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-12-05T13:12:18.361884Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-12-05T13:12:18.361987Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:18.362000Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:18.362014Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.362789Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1764940338362
2025-12-05T13:12:18.363953Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:18.364100Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-12-05T13:12:18.375476Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.375513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.375526Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.375542Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.375555Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.380318Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:18.380396Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:18.380488Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:18.380514Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.380557Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-12-05T13:12:18.380572Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.380598Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-12-05T13:12:18.380604Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:18.380623Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.380645Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-12-05T13:12:18.381806Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1764940338337
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 42
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:18.381277Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.381306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.381319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.381336Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.381347Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.381385Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:18.381459Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.383987Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361031338728779:3824] destroyed
2025-12-05T13:12:18.393217Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.395286Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:18.394414Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361031338728787:3829], now have 1 active actors on pipe
2025-12-05T13:12:18.394501Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:18.394528Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:18.394645Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|4e0dae47-c1f72aa7-d4fcef4f-ebaca163_15 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-12-05T13:12:18.394678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.394692Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
CallPersQueueGRPC response:
2025-12-05T13:12:18.394713Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:18.394726Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.394746Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.394781Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:18.394794Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:18.394809Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|4e0dae47-c1f72aa7-d4fcef4f-ebaca163_15"
    Status: Active
    SeqNo: 0
  }
}
2025-12-05T13:12:18.394859Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:18.394910Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.395966Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361031338728787:3829] destroyed
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|4e0dae47-c1f72aa7-d4fcef4f-ebaca163_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:18.409929Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.409970Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.409985Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.410002Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.410015Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.427243Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.429237Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361031338728794:3830], now have 1 active actors on pipe
2025-12-05T13:12:18.435960Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:18.436010Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:18.436599Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:18.437154Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:18.437199Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:18.437223Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:18.437729Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:18.437774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.437786Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.437809Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.437821Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.437835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:18.437845Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.437862Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.437952Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-12-05T13:12:18.437984Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.437999Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-12-05T13:12:18.438010Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.438022Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-12-05T13:12:18.448211Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-12-05T13:12:18.448310Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:18.448324Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:18.448343Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.455904Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1764940338455
2025-12-05T13:12:18.456980Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:18.457118Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-12-05T13:12:18.472282Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7580361005914615933:2371]
2025-12-05T13:12:18.472350Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:18.472427Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:18.472449Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.472487Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-12-05T13:12:18.472501Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.472525Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-12-05T13:12:18.472546Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.472566Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-12-05T13:12:18.473133Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.473150Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.473162Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.473177Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.473188Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.473218Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:18.473285Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.475625Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:18.477240Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.477267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.477279Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.477294Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.477306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.477360Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361031338728794:3830] destroyed
2025-12-05T13:12:18.475852Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1764940338436
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 36
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-12-05T13:12:18.482262Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.483587Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361031338728807:3839], now have 1 active actors on pipe
2025-12-05T13:12:18.483661Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:18.483684Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:18.483775Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ff4f1426-5102470-4571f325-d6ac89ba_15 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-12-05T13:12:18.483803Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.483816Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.483834Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-12-05T13:12:18.483846Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.483864Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.483895Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-12-05T13:12:18.483905Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-12-05T13:12:18.483920Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.483963Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-12-05T13:12:18.484006Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.485196Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ff4f1426-5102470-4571f325-d6ac89ba_15"
    Status: Active
    SeqNo: 0
  }
}
2025-12-05T13:12:18.486496Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361031338728807:3839] destroyed
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|ff4f1426-5102470-4571f325-d6ac89ba_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-12-05T13:12:18.511879Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.512095Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.512124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.512135Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.512150Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.512160Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.515296Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361031338728809:3840], now have 1 active actors on pipe
2025-12-05T13:12:18.516886Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:18.516929Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:18.517450Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-12-05T13:12:18.518138Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-12-05T13:12:18.518179Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-12-05T13:12:18.518220Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-12-05T13:12:18.518742Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:629: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-12-05T13:12:18.518789Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.518813Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.518835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.518847Z node 5 :PERSQUEUE DEBUG: partition.cpp:2378: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-12-05T13:12:18.518863Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-12-05T13:12:18.518875Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.518891Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.518990Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-12-05T13:12:18.519023Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.519035Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-12-05T13:12:18.519047Z node 5 :PERSQUEUE DEBUG: partition.cpp:2442: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-12-05T13:12:18.519058Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1320: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-12-05T13:12:18.528775Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1424: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-12-05T13:12:18.528866Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-12-05T13:12:18.528879Z node 5 :PERSQUEUE DEBUG: partition.cpp:2297: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-12-05T13:12:18.528895Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.529686Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1676: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1764940338529
2025-12-05T13:12:18.530869Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-12-05T13:12:18.530999Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-12-05T13:12:18.545610Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7580361014504550698:2400]
2025-12-05T13:12:18.545683Z node 5 :PERSQUEUE DEBUG: partition.cpp:2108: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-12-05T13:12:18.545749Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:566: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-12-05T13:12:18.545771Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.545823Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-12-05T13:12:18.545840Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.545862Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-12-05T13:12:18.545883Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-12-05T13:12:18.545905Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-12-05T13:12:18.546156Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-12-05T13:12:18.546661Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.546679Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.546693Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.546708Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.546719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.546754Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-12-05T13:12:18.546830Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.549024Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:18.551556Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361031338728809:3840] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1764940338518
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 27
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-12-05T13:12:18.555356Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.555982Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7580361031338728813:3843], now have 1 active actors on pipe
2025-12-05T13:12:18.556433Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-12-05T13:12:18.556462Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-12-05T13:12:18.557946Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-12-05T13:12:18.558266Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1093: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365511 count 9 last offset 0, current partition end offset: 16
2025-12-05T13:12:18.558284Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1109: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-12-05T13:12:18.558334Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365511 accessed 0 times before, last time 2025-12-05T13:12:17.000000Z
2025-12-05T13:12:18.558368Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-12-05T13:12:18.558444Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-12-05T13:12:18.561547Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-12-05T13:12:18.562123Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512171 from pos 0 cbcount 2
2025-12-05T13:12:18.562577Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1764940334812
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
CallPersQueueGRPC request to localhost:29998
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-12-05T13:12:18.563227Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-12-05T13:12:18.578902Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-12-05T13:12:18.580757Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7580361031338728813:3843] destroyed
2025-12-05T13:12:18.580838Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7580361031338728815:3844], now have 1 active actors on pipe
2025-12-05T13:12:18.580928Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-12-05T13:12:18.580950Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-12-05T13:12:18.582285Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037894][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic12' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-12-05T13:12:18.582499Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1093: [72075186224037894][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365511 count 9 last offset 0, current partition end offset: 16
2025-12-05T13:12:18.582518Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1109: [72075186224037894][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-12-05T13:12:18.582566Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365511 accessed 0 times before, last time 2025-12-05T13:12:17.000000Z
2025-12-05T13:12:18.582603Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-12-05T13:12:18.582682Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-12-05T13:12:18.584380Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-12-05T13:12:18.589340Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512171 from pos 0 cbcount 2
2025-12-05T13:12:18.589753Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-12-05T13:12:18.589923Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.589937Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.589950Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.589967Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.589980Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.591146Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1764940334911
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
2025-12-05T13:12:18.593415Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7580361031338728815:3844] destroyed
2025-12-05T13:12:18.617868Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.617898Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.617911Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.617928Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.617940Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.692521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.692555Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.692567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.692584Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.692599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.719682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.719716Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.719728Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.719743Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.719754Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.798815Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.798848Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.798886Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.798905Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.798917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Try persist
2025-12-05T13:12:18.837552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2284: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-12-05T13:12:18.837592Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.837607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2292: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-12-05T13:12:18.837626Z node 5 :PERSQUEUE DEBUG: partition.cpp:2343: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-12-05T13:12:18.837641Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Try persist
