2025-11-26T18:39:49.524975Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7577105665426776552:2074];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:39:49.525044Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/1ucl/004989/r3tmp/tmp8DwBAq/pdisk_1.dat
2025-11-26T18:39:49.768877Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-26T18:39:49.781300Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:39:49.781459Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-26T18:39:49.779963Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-26T18:39:49.793738Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:39:49.986962Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:39:50.032854Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:39:50.187658Z node 4 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1233: Notification cookie mismatch for subscription [4:7577105665426776505:2082] 1764182389492878 != 1764182389492881
2025-11-26T18:39:50.202115Z node 4 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-26T18:39:50.246548Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:39:50.246653Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:39:50.254324Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:39:50.254435Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:39:50.275870Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-26T18:39:50.283510Z node 4 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 5 Cookie 5
2025-11-26T18:39:50.288200Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 13507, node 4
2025-11-26T18:39:50.466155Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-26T18:39:50.480217Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-26T18:39:50.542112Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/1ucl/004989/r3tmp/yandexWjCjhD.tmp
2025-11-26T18:39:50.542145Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/1ucl/004989/r3tmp/yandexWjCjhD.tmp
2025-11-26T18:39:50.542283Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/1ucl/004989/r3tmp/yandexWjCjhD.tmp
2025-11-26T18:39:50.542447Z node 4 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-26T18:39:50.644158Z INFO: TTestServer started on Port 20813 GrpcPort 13507
2025-11-26T18:39:50.697635Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-26T18:39:50.741408Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:20813
PQClient connected to localhost:13507
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-26T18:39:51.002106Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-26T18:39:51.110514Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-11-26T18:39:54.414859Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [4:7577105686901614131:2323], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:39:54.423690Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=4&id=ODMwOTRmMjAtNzhiMDgxZDctNDcwM2M2ZTAtODk2ZWZjNjU=, ActorId: [4:7577105686901614128:2321], ActorState: ExecuteState, TraceId: 01kb0qe1c04q01bbqq0qdz7py4, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:39:54.424150Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:39:54.435797Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:39:54.529579Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7577105665426776552:2074];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:39:54.529646Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-26T18:39:54.608132Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:39:54.890163Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-26T18:39:55.372469Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710665. Ctx: { TraceId: 01kb0qe27x9q24n2mrx7k77rbk, Database: , SessionId: ydb://session/3?node_id=4&id=ZjMxZjUwM2YtNmQzMWMwMzItYWY2N2I4NjMtNDkxZjUxZjQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [4:7577105691196581881:3045] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:40:04.850124Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710678
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-26T18:40:04.924190Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [4:7577105729851288083:3326] connected; active server actors: 1
2025-11-26T18:40:04.924505Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-26T18:40:04.926728Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-26T18:40:04.926846Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-26T18:40:04.963013Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2959: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-26T18:40:04.980191Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2991: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-26T18:40:04.980485Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:785: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-26T18:40:04.980518Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:40:04.980558Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-26T18:40:04.981148Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105729851288082:3325], now have 1 active actors on pipe
2025-11-26T18:40:04.981187Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105729851288113:2451], now have 1 active actors on pipe
2025-11-26T18:40:04.982059Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:04.981391Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 5, Generation 1
2025-11-26T18:40:04.990738Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:05.019080Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105734146255451:3379], now have 1 active actors on pipe
2025-11-26T18:40:05.022345Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:05.026679Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:05.027460Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-26T18:40:05.027517Z node 5 :PERSQUEUE DEBUG: partition.cpp:1298: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-26T18:40:05.027873Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-26T18:40:05.028108Z node 5 :PERSQUEUE INFO: partition_init.cpp:1106: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [5:7577105736879825542:2374]
2025-11-26T18:40:05.030732Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-26T18:40:05.030767Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-26T18:40:05.030788Z node 5 :PERSQUEUE INFO: partition.cpp:695: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [5:7577105736879825542:2374]
2025-11-26T18:40:05.030815Z node 5 :PERSQUEUE DEBUG: partition.cpp:715: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-26T18:40:05.033230Z node 5 :PERSQUEUE DEBUG: partition.cpp:4392: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-26T18:40:05.033290Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.033313Z node 5 :PERSQUEUE DEBUG: partition.cpp:2375: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-26T18:40:05.033354Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:05.033366Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.033384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:05.033395Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.033431Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.033444Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:05.033456Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.033472Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:05.033484Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.033519Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:40:05.034064Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:05.034221Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:05.039380Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:05.039529Z node 5 :PERSQUEUE DEBUG: partition.cpp:1403: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764182405048, TxId 281474976710678
2025-11-26T18:40:05.039548Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.039558Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:05.039567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.039588Z node 5 :PERSQUEUE DEBUG: partition.cpp:2439: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-26T18:40:05.039667Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:05.039676Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:05.039700Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.039855Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:05.043182Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:05.043508Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:05.043531Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.043546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.043557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.043573Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.043583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.043624Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:05.044008Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-26T18:40:05.044103Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:40:05.044384Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:05.051471Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:05.051587Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:05.057908Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:05.136692Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.136731Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.136745Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.136762Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.136773Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.177521Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7717: Cannot get console configs
2025-11-26T18:40:05.177554Z node 4 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-26T18:40:05.213335Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710679. Ctx: { TraceId: 01kb0qebt2a2s3asdnffzm9bwv, Database: , SessionId: ydb://session/3?node_id=4&id=NTMzMzc0ZGEtNzM2ZGE4ODctZWY2MmYyOWUtZjIxN2YwOA==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-11-26T18:40:05.237238Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.237289Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.237300Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.237316Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.237327Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710678
    CreateStep: 1764182405048
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710678
    CreateStep: 1764182405048
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 1480
        DataSize: 1480
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:40:05.269563Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:40:05.338076Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.338114Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.338127Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.338149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.338161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.441517Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.441550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.441563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.441583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.441606Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.545639Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.545670Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.545681Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.545701Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.545712Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.651140Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.651176Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.651188Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.651208Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.651219Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.761428Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.761468Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.761482Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.761501Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.761514Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:40:05.778201Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:40:05.865368Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.865401Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.865413Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.865432Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.865443Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:05.986168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:05.986202Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.986214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:05.986231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:05.986241Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.086506Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.086546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.086559Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.086579Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.086593Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.196370Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.196397Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.196409Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.196425Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.196437Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:40:06.291595Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
PQ Client: create topic: rt3.dc1--topic12 with 1 partitions
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-26T18:40:06.295600Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic12, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic12"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-26T18:40:06.297386Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.297423Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.297436Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.297454Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.297480Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710683
  SchemeShardTabletId: 72057594046644480
  PathId: 10
}
ErrorCode: OK
AddTopic: rt3.dc1--topic12
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic12, dc = dc1
2025-11-26T18:40:06.371101Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037895][] pipe [4:7577105738441222937:3507] connected; active server actors: 1
2025-11-26T18:40:06.371320Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037895][rt3.dc1--topic12] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-26T18:40:06.372941Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2959: [PQ: 72075186224037894] Handle TEvInterconnect::TEvNodeInfo
2025-11-26T18:40:06.374083Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037895][rt3.dc1--topic12] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037895
2025-11-26T18:40:06.377174Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037895][rt3.dc1--topic12] BALANCER INIT DONE for rt3.dc1--topic12: (0, 72075186224037894) 
2025-11-26T18:40:06.379173Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2991: [PQ: 72075186224037894] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-26T18:40:06.379504Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:785: [PQ: 72075186224037894] no config, start with empty partitions and default config
2025-11-26T18:40:06.379540Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:40:06.379586Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037894] doesn't have tx writes info
2025-11-26T18:40:06.381850Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105738441222936:3506], now have 1 active actors on pipe
2025-11-26T18:40:06.381880Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105738441222967:2477], now have 1 active actors on pipe
2025-11-26T18:40:06.382572Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:06.388197Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:06.401331Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.401362Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.401375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.401393Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.401405Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.401475Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105738441222990:3549], now have 1 active actors on pipe
2025-11-26T18:40:06.402520Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:06.420609Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:06.421706Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitConfigStep
2025-11-26T18:40:06.421769Z node 5 :PERSQUEUE DEBUG: partition.cpp:1298: [72075186224037894][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-26T18:40:06.422069Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-26T18:40:06.422307Z node 5 :PERSQUEUE INFO: partition_init.cpp:1106: [72075186224037894][Partition][0][StateInit] bootstrapping 0 [5:7577105741174792993:2396]
2025-11-26T18:40:06.429860Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037895][rt3.dc1--topic12] TEvClientConnected TabletId 72075186224037894, NodeId 5, Generation 1
2025-11-26T18:40:06.434492Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitFieldsStep
2025-11-26T18:40:06.434533Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic12:0:Initializer] Initializing completed.
2025-11-26T18:40:06.434558Z node 5 :PERSQUEUE INFO: partition.cpp:695: [72075186224037894][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic12' partition 0 generation 1 [5:7577105741174792993:2396]
2025-11-26T18:40:06.434584Z node 5 :PERSQUEUE DEBUG: partition.cpp:715: [72075186224037894][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic12 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-26T18:40:06.436071Z node 5 :PERSQUEUE DEBUG: partition.cpp:4392: [72075186224037894][Partition][0][StateIdle] Process pending events. Count 1
2025-11-26T18:40:06.436107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.436130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2375: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-26T18:40:06.436178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:06.436190Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.436206Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:06.436215Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.436252Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.436264Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:06.436275Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.436289Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:06.436310Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.436347Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:40:06.453981Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:06.454203Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:06.473736Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:06.473893Z node 5 :PERSQUEUE DEBUG: partition.cpp:1403: [72075186224037894][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764182406441, TxId 281474976710683
2025-11-26T18:40:06.473917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.473932Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:06.473944Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.473979Z node 5 :PERSQUEUE DEBUG: partition.cpp:2439: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-26T18:40:06.474080Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:06.474097Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:06.474113Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.474349Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:06.494790Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:06.495103Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:06.495126Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.495139Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.495152Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.495164Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.495175Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.495195Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:06.495552Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037894] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic12" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic12" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-26T18:40:06.495688Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:40:06.495983Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:06.505535Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.505565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.505577Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.505595Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.505607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.521879Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:06.521981Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:06.532500Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:06.535760Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.535794Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.535808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.535828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.535850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.606639Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.606670Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.606682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.606699Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.606711Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.637399Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.637441Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.637453Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.637470Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.637481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.705506Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.705537Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.705551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.705571Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.705584Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.727392Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710685. Ctx: { TraceId: 01kb0qed775f6bkq6zvpw5nmey, Database: , SessionId: ydb://session/3?node_id=4&id=MjYyYTNlY2QtNDQ3NjM3NDMtMzgzZGI2MjAtZjQ5Zjc2YjQ=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-11-26T18:40:06.743304Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.743338Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.743348Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.743366Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.743377Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.806050Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.806085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.806107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.806136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.806157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic12
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 10
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710683
    CreateStep: 1764182406441
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 10
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 10
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710683
    CreateStep: 1764182406441
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 10
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037894
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037895
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 9
    PathsLimit: 10000
    ShardsInside: 8
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 1480
        DataSize: 1480
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic12"
 name rt3.dc1--topic12 version1
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-26T18:40:06.834268Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic12, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:40:06.842075Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.842109Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.842124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.842146Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.842158Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.909529Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.909563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.909576Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.909605Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.909617Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:06.945499Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:06.945533Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.945547Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:06.945568Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:06.945581Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.010618Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.010655Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.010665Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.010682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.010693Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.049404Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.049437Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.049449Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.049464Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.049475Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.113512Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.113546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.113560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.113577Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.113588Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.153354Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.153390Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.153403Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.153422Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.153434Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.216408Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.216443Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.216473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.216492Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.216504Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.253532Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.253569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.253583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.253604Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.253615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.319564Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.319604Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.319618Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.319644Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.319657Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-26T18:40:07.340029Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic12, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:40:07.356677Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.356712Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.356726Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.356745Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.356757Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.420096Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.420129Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.420144Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.420164Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.420178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.457534Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.457564Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.457577Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.457595Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.457607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.526747Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.526780Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.526793Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.526812Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.526824Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.559222Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.559261Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.559273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.559296Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.559307Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.626011Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.626045Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.626058Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.626077Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.626089Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.661352Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.661387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.661400Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.661420Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.661432Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.726334Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.726364Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.726376Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.726394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.726405Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.761537Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.761567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.761581Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.761599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.761611Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.828442Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.828496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.828510Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.828532Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.828546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13507
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-26T18:40:07.854566Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic12"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic12"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:07.862752Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:07.868819Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.868873Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.868883Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.868898Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.868907Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.868975Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105742736190476:3656], now have 1 active actors on pipe
2025-11-26T18:40:07.869078Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:07.869122Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:07.869215Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|c8613da6-16fa6567-d3575bc4-af02a0fb_0 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:07.869267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.869285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:07.869306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:07.869317Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.869335Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:07.869387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:07.869399Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:07.869412Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.869457Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:07.869529Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:07.873671Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:07.875109Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105742736190476:3656] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|c8613da6-16fa6567-d3575bc4-af02a0fb_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|c8613da6-16fa6567-d3575bc4-af02a0fb_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
  }
  MessageNo: 0
}
2025-11-26T18:40:07.880944Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:07.881682Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105742736190478:3657], now have 1 active actors on pipe
2025-11-26T18:40:07.882338Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:07.882368Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:07.882701Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-11-26T18:40:07.882747Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:07.882796Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.882808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:07.882836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:07.882849Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.882866Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:07.882962Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-26T18:40:07.883815Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-26T18:40:07.883855Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:07.883867Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:07.883882Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.884383Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1764182407883
2025-11-26T18:40:07.884559Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:07.884668Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-11-26T18:40:07.890252Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:07.890312Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:07.890379Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:07.890415Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:07.890457Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-26T18:40:07.890668Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:40:07.890694Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:957: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-26T18:40:07.890712Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.890727Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.890739Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.890754Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.890764Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.890796Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:07.890839Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:07.891004Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:40:07.891225Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:40:07.891243Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-26T18:40:07.891292Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-11-26T18:40:07.000000Z
2025-11-26T18:40:07.891319Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-26T18:40:07.891371Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:07.891497Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-11-26T18:40:07.891570Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1007: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1764182407880 queuesize 0 startOffset 0
2025-11-26T18:40:07.892161Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-26T18:40:07.892222Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:07.894584Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1764182407880
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 2
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:07.896943Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105742736190478:3657] destroyed
2025-11-26T18:40:07.898901Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:07.901048Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105742736190482:3660], now have 1 active actors on pipe
2025-11-26T18:40:07.902150Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:07.902199Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:07.902295Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|bdd3c77e-816674f6-6d0022c3-69179c63_0 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:07.902336Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.902351Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:07.902374Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:07.902388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.902408Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:07.902439Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:07.902451Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:07.902465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.902512Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:07.902575Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:07.903316Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-11-26T18:40:07.904284Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105742736190482:3660] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|bdd3c77e-816674f6-6d0022c3-69179c63_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|bdd3c77e-816674f6-6d0022c3-69179c63_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
  }
  MessageNo: 0
}
2025-11-26T18:40:07.914048Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:07.919712Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105742736190484:3661], now have 1 active actors on pipe
2025-11-26T18:40:07.919818Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:07.919841Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:07.920173Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-11-26T18:40:07.920223Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:07.920268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.920280Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:07.920307Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:07.920318Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.920336Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:07.920431Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-26T18:40:07.947593Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-26T18:40:07.953400Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:07.953431Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:07.953448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.953988Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1764182407951
2025-11-26T18:40:07.954165Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:07.954284Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-11-26T18:40:07.959477Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.959507Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.959518Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.959533Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.959543Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.960586Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:07.960650Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:07.960714Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:07.960745Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:07.960781Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-26T18:40:07.960986Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:40:07.961009Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:957: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-26T18:40:07.961028Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.961040Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.961053Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.961065Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.961075Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.961098Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:07.961143Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:07.961274Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037894][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic12' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:40:07.961892Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037894][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:40:07.961916Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037894][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-26T18:40:07.961960Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-11-26T18:40:07.000000Z
2025-11-26T18:40:07.961983Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-26T18:40:07.962027Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:07.962138Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-11-26T18:40:07.962203Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1007: Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp done, result 1764182407920 queuesize 0 startOffset 0
2025-11-26T18:40:07.964233Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-26T18:40:07.964322Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:07.964694Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1764182407919
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 31
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:07.970600Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:07.971537Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.971566Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.971577Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.971593Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:07.971604Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.971679Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105742736190484:3661] destroyed
2025-11-26T18:40:07.971728Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105742736190493:3666], now have 1 active actors on pipe
2025-11-26T18:40:07.971784Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:07.971808Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:07.971929Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b6af86e9-ad3699a1-c6884524-b5cc2eca_1 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:07.971954Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:07.971966Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:07.971982Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:07.971993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:07.972009Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:07.972043Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:07.972054Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:07.972072Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:07.972120Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:07.972166Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:07.978031Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b6af86e9-ad3699a1-c6884524-b5cc2eca_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:07.982774Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105742736190493:3666] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b6af86e9-ad3699a1-c6884524-b5cc2eca_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:08.046986Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.054059Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105747031157791:3667], now have 1 active actors on pipe
2025-11-26T18:40:08.057813Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:08.057865Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:08.058391Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:08.058900Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:08.058938Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:08.058958Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:08.059273Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:08.059318Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.059330Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.059346Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.059353Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.059366Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:08.059379Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.059396Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.059485Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-26T18:40:08.059510Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.059520Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-26T18:40:08.059527Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.059538Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-26T18:40:08.076500Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-26T18:40:08.076602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:08.076616Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:08.076635Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.077646Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1764182408077
2025-11-26T18:40:08.078800Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:08.078837Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:08.078965Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-26T18:40:08.080065Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.080082Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.080092Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.080106Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.080117Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.092965Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:08.093031Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:08.093099Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:08.093123Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.093176Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-26T18:40:08.093191Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.093214Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-26T18:40:08.093236Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.093274Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-26T18:40:08.093435Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:08.093945Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.093962Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.093974Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.093989Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.093999Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.094029Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:08.094104Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.094746Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.098254Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105747031157791:3667] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1764182408059
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 33
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:08.100463Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.100940Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105747031157797:3671], now have 1 active actors on pipe
2025-11-26T18:40:08.101236Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:08.101278Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:08.101354Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|289e5718-dc62d81f-9e62a99a-bd674d59_1 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:08.101378Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.101388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.101403Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:08.101412Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.101424Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.101452Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:08.101460Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:08.101471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.101507Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:08.101540Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.101889Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.102417Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105747031157797:3671] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|289e5718-dc62d81f-9e62a99a-bd674d59_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|289e5718-dc62d81f-9e62a99a-bd674d59_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:08.141230Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.142943Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105747031157799:3672], now have 1 active actors on pipe
2025-11-26T18:40:08.151565Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:08.151620Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:08.152187Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:08.152693Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:08.152741Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:08.152768Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:08.153158Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:08.153215Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.153229Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.153525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.153545Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.153560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:08.153572Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.153591Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.153704Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-26T18:40:08.153738Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.153754Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-26T18:40:08.153763Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.153776Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-26T18:40:08.190083Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-26T18:40:08.190182Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:08.190197Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:08.190214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.191024Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1764182408190
2025-11-26T18:40:08.192209Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:08.192236Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:08.192366Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-26T18:40:08.192623Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.192640Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.192652Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.192667Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.192688Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.216319Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:08.216391Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:08.216472Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:08.216502Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.216546Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-26T18:40:08.216565Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.216584Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-26T18:40:08.216605Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.216622Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-26T18:40:08.217236Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.217275Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.217287Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.217303Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.217315Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.217348Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:08.217424Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.217459Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:08.217845Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.219781Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105747031157799:3672] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1764182408153
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 61
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:08.225502Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.226173Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105747031157803:3675], now have 1 active actors on pipe
2025-11-26T18:40:08.230538Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:08.230577Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:08.230683Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|60b3b7cf-aa3c7537-f4cdcb56-c746149d_2 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:08.230715Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.230731Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.230750Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:08.230763Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.230781Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.230814Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:08.230827Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:08.230841Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.230891Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:08.230944Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.231431Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|60b3b7cf-aa3c7537-f4cdcb56-c746149d_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:08.238515Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105747031157803:3675] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|60b3b7cf-aa3c7537-f4cdcb56-c746149d_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:08.263038Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.263748Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105747031157829:3685], now have 1 active actors on pipe
2025-11-26T18:40:08.269180Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:08.269234Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:08.269799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:08.270357Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:08.270413Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:08.270442Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:08.270917Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:08.270973Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.270986Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.271008Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.271021Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.271039Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:08.271050Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.271073Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.271189Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-26T18:40:08.271225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.271243Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-26T18:40:08.271257Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.271273Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-26T18:40:08.444509Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-26T18:40:08.444609Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:08.444622Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:08.444639Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.445496Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1764182408445
2025-11-26T18:40:08.446724Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.446742Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.446753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.446769Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.446781Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.446909Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:08.446931Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:08.447069Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-26T18:40:08.468355Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:08.468435Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:08.468520Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:08.468547Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.468588Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-26T18:40:08.468603Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.468627Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-26T18:40:08.468648Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.468669Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-26T18:40:08.469209Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.469230Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.469259Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.469275Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.469286Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.469317Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:08.469392Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.469389Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1764182408271
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 197
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:08.469728Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.477441Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.481363Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105747031157848:3695], now have 1 active actors on pipe
2025-11-26T18:40:08.481448Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:08.481474Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:08.481597Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|1d559014-65015b2-313e3e44-b10bd725_2 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:08.481629Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.481642Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.481659Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:08.481672Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.481689Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.481720Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:08.481731Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:08.481747Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.481809Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:08.481856Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.485453Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-11-26T18:40:08.486314Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105747031157848:3695] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|1d559014-65015b2-313e3e44-b10bd725_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|1d559014-65015b2-313e3e44-b10bd725_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:08.511396Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.512201Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105747031157850:3696], now have 1 active actors on pipe
2025-11-26T18:40:08.516365Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:08.516416Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:08.516941Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:08.517465Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:08.517502Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:08.517529Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:08.517980Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:08.518038Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.518049Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.518071Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.518080Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.518095Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:08.518106Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.518125Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.518236Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-26T18:40:08.518269Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.518285Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-26T18:40:08.518296Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.518309Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-26T18:40:08.543721Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105747031157829:3685] destroyed
2025-11-26T18:40:08.545084Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-26T18:40:08.545162Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:08.545176Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:08.545191Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.545968Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1764182408545
2025-11-26T18:40:08.547121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.547147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.547160Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.547178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.547191Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.547504Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:08.547530Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:08.547655Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-26T18:40:08.567696Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:08.567762Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:08.567810Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:08.567829Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:08.567854Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.567893Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-26T18:40:08.567916Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.567934Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-26T18:40:08.567970Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.567996Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-26T18:40:08.568526Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.568552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.568566Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.568582Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.568594Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.568626Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:08.568693Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.568888Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.570206Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105747031157850:3696] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1764182408517
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 45
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:08.625515Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.626380Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105747031157869:3705], now have 1 active actors on pipe
2025-11-26T18:40:08.626824Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:08.626866Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:08.626975Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b57147ce-914cbaa8-745afef2-f61a1fdb_3 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:08.627009Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.627023Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.627041Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:08.627055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.627072Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.627105Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:08.627117Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:08.627132Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.627181Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:08.627236Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.627845Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b57147ce-914cbaa8-745afef2-f61a1fdb_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:08.628699Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105747031157869:3705] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b57147ce-914cbaa8-745afef2-f61a1fdb_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:08.647433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.647463Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.647478Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.647496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.647508Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.647569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.647580Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.647588Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.647598Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.647605Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.658936Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.659567Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105747031157871:3706], now have 1 active actors on pipe
2025-11-26T18:40:08.666729Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:08.666789Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:08.667362Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:08.667877Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:08.667930Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:08.667959Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:08.668370Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:08.668430Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.668444Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.668484Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.668495Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.668511Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:08.668524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.668545Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.668650Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-26T18:40:08.668692Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.668712Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-26T18:40:08.668727Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.668740Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-26T18:40:08.702248Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-26T18:40:08.702360Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:08.702375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:08.702393Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.703179Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1764182408702
2025-11-26T18:40:08.704249Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:08.704374Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-26T18:40:08.725180Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:08.725265Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:08.725333Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:08.725358Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.725399Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-26T18:40:08.725415Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.725436Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-26T18:40:08.725459Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.725483Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-26T18:40:08.726027Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.726055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.726068Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.726082Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.726094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.726126Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:08.726204Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.726396Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:08.728112Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105747031157871:3706] destroyed
2025-11-26T18:40:08.726589Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1764182408668
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 53
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:08.737456Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.744315Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105747031157876:3710], now have 1 active actors on pipe
2025-11-26T18:40:08.744407Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:08.744432Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:08.744558Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|282fa957-fa5a650d-6899c90c-ae799631_3 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:08.744600Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.744619Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.744637Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:08.744648Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.744664Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.744694Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:08.744704Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:08.744717Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.744763Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:08.744819Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.745323Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.746375Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105747031157876:3710] destroyed
2025-11-26T18:40:08.748096Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.748125Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.748138Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.748154Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.748166Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.748211Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.748220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.748227Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.748237Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.748244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|282fa957-fa5a650d-6899c90c-ae799631_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|282fa957-fa5a650d-6899c90c-ae799631_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:08.784364Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.785027Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105747031157880:3713], now have 1 active actors on pipe
2025-11-26T18:40:08.789711Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:08.789757Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:08.790290Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:08.790837Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:08.790874Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:08.790901Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:08.791305Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:08.791356Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.791368Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.791392Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.791404Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.791418Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:08.791470Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.791496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.791604Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-26T18:40:08.791637Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.791658Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-26T18:40:08.791679Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.791694Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-26T18:40:08.814126Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-26T18:40:08.814230Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:08.814244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:08.814261Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.815013Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1764182408814
2025-11-26T18:40:08.816045Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:08.816175Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-26T18:40:08.829205Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:08.829278Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:08.829341Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:08.829358Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.829387Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-26T18:40:08.829407Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.829428Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-26T18:40:08.829446Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.829461Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-26T18:40:08.829476Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:08.829914Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.829926Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.829946Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.829958Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.829967Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.829993Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:08.830211Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.830045Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.831819Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105747031157880:3713] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1764182408790
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 39
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:08.837234Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.837834Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105747031157886:3716], now have 1 active actors on pipe
2025-11-26T18:40:08.841408Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:08.841455Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:08.841590Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e143a1db-7301741d-a6d7d85d-37717aef_4 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:08.841625Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.841640Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.841668Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:08.841682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.841701Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.841736Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:08.841749Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:08.841773Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.841828Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:08.841879Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.842683Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.843348Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105747031157886:3716] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e143a1db-7301741d-a6d7d85d-37717aef_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:08.848163Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.848158Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.848189Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.848189Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.848203Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.848204Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.848232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.848232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.848244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.848244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e143a1db-7301741d-a6d7d85d-37717aef_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:08.887664Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.888325Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105747031157888:3718], now have 1 active actors on pipe
2025-11-26T18:40:08.893081Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:08.893129Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:08.893644Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:08.894124Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:08.894164Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:08.894191Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:08.894396Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:08.894457Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.894471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.894496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.894505Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.894520Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:08.894531Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.894551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.894666Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-26T18:40:08.894697Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.894712Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-26T18:40:08.894723Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.894738Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-26T18:40:08.904003Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-26T18:40:08.904094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:08.904108Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:08.904123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.904928Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1764182408904
2025-11-26T18:40:08.906180Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:08.906288Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-26T18:40:08.914357Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:08.914421Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:08.914488Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:08.914518Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.914556Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-26T18:40:08.914570Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.914591Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-26T18:40:08.914613Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:08.914630Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-26T18:40:08.915183Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.915209Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.915220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.915235Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.915246Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.915282Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:08.915359Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.915520Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:08.915575Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:08.917059Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105747031157888:3718] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1764182408894
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 18
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:08.924627Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.925346Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105747031157895:3724], now have 1 active actors on pipe
2025-11-26T18:40:08.925514Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:08.925547Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:08.925642Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|46a34ba4-2af637a8-771e8598-6324deea_4 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:08.925675Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.925689Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.925710Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:08.925722Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.925740Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.925772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:08.925784Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:08.925797Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.925843Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:08.925898Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:08.926080Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|46a34ba4-2af637a8-771e8598-6324deea_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:08.929491Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105747031157895:3724] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|46a34ba4-2af637a8-771e8598-6324deea_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:08.948544Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.948577Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.948590Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.948610Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.948624Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.948690Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.948699Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.948708Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.948719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:08.948727Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:08.990812Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:08.992067Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105747031157903:3728], now have 1 active actors on pipe
2025-11-26T18:40:08.996974Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:08.997023Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:08.997618Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:08.998120Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:08.998156Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:08.998184Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:08.998609Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:08.998661Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:08.998673Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.998695Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.998708Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:08.998725Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:08.998737Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:08.998758Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.998868Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-26T18:40:08.998901Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.998915Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-26T18:40:08.998928Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:08.998942Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-26T18:40:09.048865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.048905Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.048920Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.048939Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.048952Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.056525Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-26T18:40:09.063846Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:09.063878Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:09.063897Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.064782Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1764182409064
2025-11-26T18:40:09.065913Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:09.065941Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:09.066061Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-26T18:40:09.093585Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:09.091922Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:09.091996Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:09.092063Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:09.092087Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.092128Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-26T18:40:09.092144Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.092167Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-26T18:40:09.092187Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.092207Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-26T18:40:09.092795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.092813Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.092824Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.092838Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.092851Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.092885Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:09.092957Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.093391Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:09.095009Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105747031157903:3728] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1764182408998
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 93
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:09.102398Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.103360Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105751326125205:3733], now have 1 active actors on pipe
2025-11-26T18:40:09.103431Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:09.103453Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:09.104161Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e7c949cb-9558c7c6-80afb702-a75948a0_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:09.103551Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e7c949cb-9558c7c6-80afb702-a75948a0_5 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:09.103585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.103599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.103617Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:09.103777Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.103796Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.103825Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:09.103836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:09.103850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.103894Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:09.103942Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.110082Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105751326125205:3733] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e7c949cb-9558c7c6-80afb702-a75948a0_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:09.144652Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.146081Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105751326125208:3735], now have 1 active actors on pipe
2025-11-26T18:40:09.149513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.149541Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.149554Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.149576Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.149592Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.151260Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:09.151298Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:09.151848Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:09.152387Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:09.152431Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:09.152478Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:09.152734Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:09.152783Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.152795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.152818Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.152829Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.152846Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:09.152857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.152878Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.152988Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-26T18:40:09.153019Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.153035Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-26T18:40:09.153046Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.153060Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-26T18:40:09.166382Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.166417Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.166429Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.166447Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.166459Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.181131Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-26T18:40:09.181225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:09.181238Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:09.181614Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.182419Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1764182409182
2025-11-26T18:40:09.183569Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:09.183691Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-26T18:40:09.205138Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:09.205213Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:09.205304Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:09.205331Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.205370Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-26T18:40:09.205386Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.205406Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-26T18:40:09.205431Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.205452Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-26T18:40:09.205917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.205936Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.205948Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.205964Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.205974Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.206005Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:09.206085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.206640Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1764182409152
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 49
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:09.209516Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:09.215126Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105751326125208:3735] destroyed
2025-11-26T18:40:09.220713Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.221961Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105751326125212:3738], now have 1 active actors on pipe
2025-11-26T18:40:09.222368Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:09.222400Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:09.222505Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ffbc0877-8b0faa70-cda61641-e0380deb_5 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:09.222538Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.222553Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.222572Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:09.222585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.222605Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.222636Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:09.222648Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:09.222662Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.222710Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:09.222761Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.223027Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ffbc0877-8b0faa70-cda61641-e0380deb_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:09.225961Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105751326125212:3738] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|ffbc0877-8b0faa70-cda61641-e0380deb_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:09.250052Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.250081Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.250093Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.250110Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.250119Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.267598Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.267626Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.267637Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.267653Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.267663Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.301434Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.315174Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105751326125221:3744], now have 1 active actors on pipe
2025-11-26T18:40:09.320265Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:09.320311Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:09.320867Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:09.321411Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:09.321451Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:09.321475Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:09.321890Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:09.321942Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.321954Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.321978Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.321988Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.322000Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:09.322011Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.322028Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.322125Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-26T18:40:09.322159Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.322174Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-26T18:40:09.322185Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.322199Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-26T18:40:09.342972Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-26T18:40:09.346735Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:09.346762Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:09.346776Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.347550Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1764182409346
2025-11-26T18:40:09.348904Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:09.349035Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-26T18:40:09.356098Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.356124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.356136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.356152Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.356162Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.363460Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:09.363523Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:09.363588Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:09.363610Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.363646Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-26T18:40:09.363659Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.363716Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-26T18:40:09.363738Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.363760Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-26T18:40:09.364301Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.364318Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.364330Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.364344Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.364355Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.364386Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:09.364479Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.365005Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:09.365738Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1764182409321
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 41
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-26T18:40:09.367831Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105751326125221:3744] destroyed
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:09.368221Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.368243Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.368255Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.368272Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.368281Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.378001Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.378656Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105751326125234:3752], now have 1 active actors on pipe
2025-11-26T18:40:09.379092Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:09.379118Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:09.379230Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|f0ce6184-390a2ad0-721e9353-e0581217_6 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:09.379263Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.379277Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.379297Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:09.379309Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.379326Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.379357Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:09.379369Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:09.379386Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.379431Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:09.379909Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.380127Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|f0ce6184-390a2ad0-721e9353-e0581217_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:09.380975Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105751326125234:3752] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|f0ce6184-390a2ad0-721e9353-e0581217_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:09.407682Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.408429Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105751326125236:3753], now have 1 active actors on pipe
2025-11-26T18:40:09.413590Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:09.413639Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:09.414178Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:09.414671Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:09.414705Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:09.414731Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:09.414958Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:09.415009Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.415023Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.415045Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.415056Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.415071Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:09.415082Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.415103Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.415209Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-26T18:40:09.415238Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.415251Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-26T18:40:09.415262Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.415278Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-26T18:40:09.433964Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-26T18:40:09.434048Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:09.434062Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:09.434080Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.434876Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1764182409434
2025-11-26T18:40:09.436078Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:09.436213Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-26T18:40:09.460753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:09.461842Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:09.461894Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:09.461969Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:09.461992Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.462031Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-26T18:40:09.462045Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.462066Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-26T18:40:09.462091Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.462110Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-26T18:40:09.462625Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.462642Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.462655Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.462670Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.462682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.462715Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:09.462790Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.462957Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:09.467084Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-11-26T18:40:09.468677Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105751326125236:3753] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1764182409414
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 46
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:09.473355Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.473383Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.473396Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.473414Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.473425Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.475094Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.475893Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105751326125256:3763], now have 1 active actors on pipe
2025-11-26T18:40:09.481413Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:09.481461Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:09.481565Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6ff3c409-30d110c3-bc939ec5-1ad6ae20_6 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:09.481597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.481611Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.481630Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:09.481642Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.481660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.481695Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:09.481706Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:09.481723Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.481773Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:09.481820Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.482507Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6ff3c409-30d110c3-bc939ec5-1ad6ae20_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:09.488278Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105751326125256:3763] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|6ff3c409-30d110c3-bc939ec5-1ad6ae20_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:09.541835Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105751326125258:3764], now have 1 active actors on pipe
2025-11-26T18:40:09.533410Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.552280Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:09.552336Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:09.553350Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:09.553897Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:09.553935Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:09.553965Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:09.554224Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:09.554278Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.554291Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.554316Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.554328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.554346Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:09.554358Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.554377Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.554486Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-26T18:40:09.554522Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.554538Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-26T18:40:09.554552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.554567Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-26T18:40:09.562292Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-26T18:40:09.562629Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:09.562647Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:09.562660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.563484Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1764182409561
2025-11-26T18:40:09.564840Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:09.564972Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-26T18:40:09.565271Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.565285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.565295Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.565308Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.565318Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.576262Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:09.602246Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:09.602316Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:09.602386Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:09.602411Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.602453Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-26T18:40:09.602470Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.602491Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-26T18:40:09.602511Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.602534Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-26T18:40:09.603128Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.603147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.603160Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.603175Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.603186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.603217Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:09.603293Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.603911Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:09.605453Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1764182409554
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 48
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:09.606647Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105751326125258:3764] destroyed
2025-11-26T18:40:09.616301Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.625367Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105751326125269:3771], now have 1 active actors on pipe
2025-11-26T18:40:09.625456Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:09.625478Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:09.625585Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cfb84713-c9badf33-ddcd373a-52ed27ae_7 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:09.625615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.625627Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.625647Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:09.625659Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.625676Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.625708Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:09.625719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:09.625734Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.625776Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:09.625825Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cfb84713-c9badf33-ddcd373a-52ed27ae_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:09.629186Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:09.633488Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105751326125269:3771] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|cfb84713-c9badf33-ddcd373a-52ed27ae_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:09.665055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.665087Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.665098Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.665116Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.665127Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.674631Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.674669Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.674684Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.674705Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.674719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.708930Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.718802Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105751326125273:3773], now have 1 active actors on pipe
2025-11-26T18:40:09.730839Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:09.730893Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:09.731468Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:09.731985Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:09.732029Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:09.732060Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:09.732462Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:09.732525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.732543Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.732566Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.732579Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.732597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:09.732615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.732639Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.732765Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-26T18:40:09.732808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.732828Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-26T18:40:09.732844Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.732860Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-26T18:40:09.830552Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-26T18:40:09.830642Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:09.830655Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:09.830669Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.831395Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1764182409831
2025-11-26T18:40:09.832503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:09.832529Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:09.832647Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-26T18:40:09.832907Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.832919Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.832929Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.832943Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.832954Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.859263Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:09.859339Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:09.859410Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:09.859434Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.859484Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-26T18:40:09.859499Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.859521Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-26T18:40:09.859544Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.859566Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-26T18:40:09.860204Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.860222Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.860233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.860250Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.860261Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.860307Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:09.860382Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.860547Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:09.860903Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-11-26T18:40:09.863024Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105751326125273:3773] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1764182409732
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 126
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:09.865002Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.865748Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105751326125280:3779], now have 1 active actors on pipe
2025-11-26T18:40:09.866327Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:09.866358Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:09.866467Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e10704e0-ae375310-e060800c-977688b2_7 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:09.866502Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.866517Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.866538Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:09.866551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.866568Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.866602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:09.866612Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:09.866628Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.866680Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:09.866737Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.867290Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e10704e0-ae375310-e060800c-977688b2_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:09.873019Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105751326125280:3779] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|e10704e0-ae375310-e060800c-977688b2_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:09.891525Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.892234Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105751326125282:3780], now have 1 active actors on pipe
2025-11-26T18:40:09.897664Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:09.897719Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:09.898221Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:09.898629Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:09.898660Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:09.898678Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:09.899023Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:09.899069Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.899078Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.899096Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.899103Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.899113Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:09.899121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.899135Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.899214Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-26T18:40:09.899244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.899253Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-26T18:40:09.899261Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.899270Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-26T18:40:09.909533Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-26T18:40:09.909633Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:09.909647Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:09.909664Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.910442Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1764182409906
2025-11-26T18:40:09.911591Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:09.911718Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-26T18:40:09.922237Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:09.922300Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:09.922376Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:09.922403Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.922426Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:09.922451Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-26T18:40:09.922465Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.922495Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-26T18:40:09.922521Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.922542Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-26T18:40:09.923052Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.923073Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.923085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.923100Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.923112Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.923140Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:09.923208Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.923411Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:09.924615Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105751326125282:3780] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1764182409898
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 23
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:09.927824Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.928314Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105751326125287:3784], now have 1 active actors on pipe
2025-11-26T18:40:09.929519Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:09.929554Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:09.929671Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b5fcd0a0-f30651d0-b7229682-e5fc9920_8 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:09.929704Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.929718Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.929741Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:09.929753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.929771Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.929804Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:09.929815Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:09.929829Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.929883Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:09.929931Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
2025-11-26T18:40:09.930211Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b5fcd0a0-f30651d0-b7229682-e5fc9920_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:2025-11-26T18:40:09.930847Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105751326125287:3784] destroyed
13507
2025-11-26T18:40:09.932856Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.932886Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.932901Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.932917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.932927Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.932978Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.932989Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.933007Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.933018Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.933027Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b5fcd0a0-f30651d0-b7229682-e5fc9920_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:09.950731Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:09.952666Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105751326125295:3785], now have 1 active actors on pipe
2025-11-26T18:40:09.957682Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:09.957733Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:09.958299Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:09.958800Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:09.958846Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:09.958868Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:09.971490Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:09.971567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.971581Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.971602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.971610Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:09.971625Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:09.971636Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.971652Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.971760Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-26T18:40:09.971792Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.971807Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-26T18:40:09.971818Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:09.971832Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-26T18:40:09.976286Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-26T18:40:09.976364Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:09.976377Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:09.976394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.977180Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1764182409976
2025-11-26T18:40:09.979037Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:09.979173Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-26T18:40:09.994572Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:09.994656Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:09.994707Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:09.994734Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:09.994758Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.994798Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-26T18:40:09.994813Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.994834Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-26T18:40:09.994857Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:09.994878Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-26T18:40:09.995437Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:09.995454Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.995466Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:09.995481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:09.995492Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:09.995548Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-11-26T18:40:09.995562Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-26T18:40:09.995575Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-26T18:40:09.995588Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-26T18:40:09.995601Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-26T18:40:09.995615Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-26T18:40:09.995626Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-26T18:40:09.995637Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-26T18:40:09.995650Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-26T18:40:09.995667Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-11-26T18:40:09.995723Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1183: [PQ: 72075186224037892] Topic 'rt3.dc1--topic1' counters. CacheSize 8390426 CachedBlobs 9
2025-11-26T18:40:09.995780Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:09.995827Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-11-26T18:40:09.995851Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-26T18:40:09.996730Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:09.996038Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-26T18:40:09.996190Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-26T18:40:09.996343Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-26T18:40:09.996462Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-26T18:40:09.996697Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-26T18:40:09.996756Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-26T18:40:09.996817Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-26T18:40:09.996891Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-26T18:40:09.997418Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 9 blobs for compaction
2025-11-26T18:40:09.997480Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-11-26T18:40:07.000000Z
2025-11-26T18:40:09.997497Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:08.000000Z
2025-11-26T18:40:09.997517Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:08.000000Z
CallPersQueueGRPC response:
2025-11-26T18:40:09.997551Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:08.000000Z
2025-11-26T18:40:09.997575Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:08.000000Z
2025-11-26T18:40:09.997593Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:09.000000Z
2025-11-26T18:40:09.997615Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:09.000000Z
2025-11-26T18:40:09.997634Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:09.000000Z
2025-11-26T18:40:09.997655Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:09.000000Z
2025-11-26T18:40:09.997733Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-11-26T18:40:09.997815Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1764182409971
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 23
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-26T18:40:09.997859Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:09.997868Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-26T18:40:09.997901Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:09.997931Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-26T18:40:09.997939Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:09.997954Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:09.997990Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:09.997996Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-11-26T18:40:09.998024Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:09.998033Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.0/1
2025-11-26T18:40:09.998065Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-26T18:40:09.998069Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:09.998098Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:09.998132Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:09.999160Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-26T18:40:09.999186Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:0 appended
2025-11-26T18:40:09.999382Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-26T18:40:09.999390Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:09.999403Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-26T18:40:10.000329Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.0/3
2025-11-26T18:40:10.000350Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-26T18:40:10.000360Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:0 appended
2025-11-26T18:40:10.001577Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.1/3
2025-11-26T18:40:10.001598Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-26T18:40:10.001613Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:1 appended
2025-11-26T18:40:10.001855Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.2/3
2025-11-26T18:40:10.001871Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-26T18:40:10.000750Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.012629Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048956 count 2 nextOffset 2 batches 3
2025-11-26T18:40:10.012705Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:2 appended
2025-11-26T18:40:10.012735Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-26T18:40:10.012745Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.012760Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-26T18:40:10.013799Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.0/3
2025-11-26T18:40:10.013834Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-26T18:40:10.013847Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:0 appended
2025-11-26T18:40:10.015073Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.1/3
2025-11-26T18:40:10.015108Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-26T18:40:10.015121Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:1 appended
2025-11-26T18:40:10.015326Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.2/3
2025-11-26T18:40:10.015342Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-26T18:40:10.018369Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097712 count 3 nextOffset 3 batches 5
2025-11-26T18:40:10.018420Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:2 appended
2025-11-26T18:40:10.018449Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-26T18:40:10.018460Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.018478Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-26T18:40:10.019483Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.0/3
2025-11-26T18:40:10.019524Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-26T18:40:10.019537Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:0 appended
2025-11-26T18:40:10.020740Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.1/3
2025-11-26T18:40:10.020773Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-26T18:40:10.020786Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:1 appended
2025-11-26T18:40:10.021028Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.2/3
2025-11-26T18:40:10.021046Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-26T18:40:10.037281Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146468 count 4 nextOffset 4 batches 7
2025-11-26T18:40:10.037349Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:2 appended
2025-11-26T18:40:10.037382Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-26T18:40:10.037395Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.037413Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-11-26T18:40:10.038458Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.0/3
2025-11-26T18:40:10.038513Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-26T18:40:10.038529Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:0 appended
2025-11-26T18:40:10.039741Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.1/3
2025-11-26T18:40:10.039782Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-26T18:40:10.039796Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:1 appended
2025-11-26T18:40:10.040034Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.2/3
2025-11-26T18:40:10.040059Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-26T18:40:10.043132Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195224 count 5 nextOffset 5 batches 9
2025-11-26T18:40:10.043186Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:2 appended
2025-11-26T18:40:10.043214Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-26T18:40:10.043224Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.043241Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-26T18:40:10.044333Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.0/3
2025-11-26T18:40:10.044379Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-26T18:40:10.044394Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:0 appended
2025-11-26T18:40:10.045894Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.1/3
2025-11-26T18:40:10.045930Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-26T18:40:10.045945Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:1 appended
2025-11-26T18:40:10.057206Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.2/3
2025-11-26T18:40:10.057373Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-26T18:40:10.060436Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243980 count 6 nextOffset 6 batches 11
2025-11-26T18:40:10.060492Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:2 appended
2025-11-26T18:40:10.060514Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-26T18:40:10.060522Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.060534Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-26T18:40:10.061716Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.0/3
2025-11-26T18:40:10.061755Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-26T18:40:10.061769Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:0 appended
2025-11-26T18:40:10.062800Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.1/3
2025-11-26T18:40:10.062829Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-26T18:40:10.062843Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:1 appended
2025-11-26T18:40:10.063073Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.2/3
2025-11-26T18:40:10.063094Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-26T18:40:10.072561Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292736 count 7 nextOffset 7 batches 13
2025-11-26T18:40:10.072622Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:2 appended
2025-11-26T18:40:10.072652Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-26T18:40:10.072661Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.072678Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-26T18:40:10.073716Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.0/3
2025-11-26T18:40:10.073757Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-26T18:40:10.073772Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:0 appended
2025-11-26T18:40:10.074952Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.1/3
2025-11-26T18:40:10.074984Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-26T18:40:10.074996Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:1 appended
2025-11-26T18:40:10.075242Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.2/3
2025-11-26T18:40:10.075259Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-26T18:40:10.092512Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341492 count 8 nextOffset 8 batches 15
2025-11-26T18:40:10.092586Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:2 appended
2025-11-26T18:40:10.092616Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-26T18:40:10.092626Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.092641Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-26T18:40:10.093618Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.0/3
2025-11-26T18:40:10.093661Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-26T18:40:10.093674Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:0 appended
2025-11-26T18:40:10.094767Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.1/3
2025-11-26T18:40:10.094789Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-26T18:40:10.094801Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:1 appended
2025-11-26T18:40:10.094981Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.2/3
2025-11-26T18:40:10.094999Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-26T18:40:10.169578Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365511
2025-11-26T18:40:10.169670Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365511 WTime 1764182410169
2025-11-26T18:40:10.180214Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-11-26T18:40:10.180272Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:2 appended
2025-11-26T18:40:10.181134Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1764182410180
2025-11-26T18:40:10.181402Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105751326125295:3785] destroyed
2025-11-26T18:40:10.181623Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:178: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-11-26T18:40:10.181662Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.181683Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.181696Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.181712Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.181725Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.181783Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.181912Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365511
2025-11-26T18:40:10.181993Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-11-26T18:40:10.182404Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092600:3796], now have 1 active actors on pipe
2025-11-26T18:40:10.182470Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.182493Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.182535Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.182548Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.182557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.182570Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.182578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.182669Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9f9c775c-5c36837d-475acc5f-bb22b508_8 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:10.182690Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.182704Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.182721Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.182733Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.182749Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.185486Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.182779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.182791Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.182804Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.182844Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.182892Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9f9c775c-5c36837d-475acc5f-bb22b508_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.188304Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092600:3796] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|9f9c775c-5c36837d-475acc5f-bb22b508_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.226561Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092627:3806], now have 1 active actors on pipe
2025-11-26T18:40:10.225971Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.230637Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.230677Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.231181Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.231663Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.231704Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.231733Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.232099Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.232156Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.232172Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.232194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.232203Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.232218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.232230Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.232248Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.232352Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-26T18:40:10.232390Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.232404Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-26T18:40:10.232416Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.232429Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-26T18:40:10.237739Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-26T18:40:10.237819Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.237833Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.237848Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.238662Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1764182410238
2025-11-26T18:40:10.239249Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365511 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.239291Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.239350Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.239696Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.239719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.239732Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.239751Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.239765Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.239921Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.239950Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.239982Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-11-26T18:40:10.239995Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-26T18:40:10.240004Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-26T18:40:10.240012Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-26T18:40:10.240020Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-11-26T18:40:10.240030Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-11-26T18:40:10.240040Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-26T18:40:10.240050Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-26T18:40:10.240059Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-26T18:40:10.240265Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.240390Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.240811Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365511
2025-11-26T18:40:10.240860Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-26T18:40:10.246658Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.246713Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.246747Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.246780Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.246812Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.246841Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.246876Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.246910Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.246944Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.247005Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.247052Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.247077Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.247094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.247105Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.247120Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.247131Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.247152Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.247536Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-26T18:40:10.247577Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.247783Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.248016Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.248230Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.248433Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.248652Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.248840Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.249050Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.253916Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.253987Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.254051Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.254064Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.254079Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.254119Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-26T18:40:10.254133Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.254153Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-26T18:40:10.254181Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.254201Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-26T18:40:10.254653Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.254678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.254689Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.254702Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.254711Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.254740Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-11-26T18:40:10.254752Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-26T18:40:10.254764Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-26T18:40:10.254775Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-26T18:40:10.254786Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-26T18:40:10.254799Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-26T18:40:10.254808Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-26T18:40:10.254821Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-26T18:40:10.254832Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-26T18:40:10.254843Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037894][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-11-26T18:40:10.254917Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.254957Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037894][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-11-26T18:40:10.254977Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-26T18:40:10.255095Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-26T18:40:10.255058Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.255266Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-26T18:40:10.255485Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-26T18:40:10.255695Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
CallPersQueueGRPC response:
2025-11-26T18:40:10.256291Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-26T18:40:10.256405Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1764182410231
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 21
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-26T18:40:10.256621Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.256798Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.257341Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037894][Partition][0][StateIdle] Request 9 blobs for compaction
2025-11-26T18:40:10.257393Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092627:3806] destroyed
2025-11-26T18:40:10.257440Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-11-26T18:40:07.000000Z
2025-11-26T18:40:10.257459Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:08.000000Z
2025-11-26T18:40:10.257479Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:08.000000Z
2025-11-26T18:40:10.257499Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:08.000000Z
2025-11-26T18:40:10.257519Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:09.000000Z
2025-11-26T18:40:10.257539Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:09.000000Z
2025-11-26T18:40:10.257560Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:09.000000Z
2025-11-26T18:40:10.257581Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:09.000000Z
2025-11-26T18:40:10.257602Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-26T18:40:10.000000Z
2025-11-26T18:40:10.257649Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-11-26T18:40:10.257747Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037894][Partition][0][StateIdle] Continue blobs compaction
2025-11-26T18:40:10.257778Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-26T18:40:10.257796Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.257812Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-11-26T18:40:10.257844Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 0.0/1
2025-11-26T18:40:10.257852Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:10.257872Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-26T18:40:10.257877Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:10.257900Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:10.257925Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:10.257957Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:10.257991Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:10.258015Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:10.258037Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:10.258060Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-11-26T18:40:10.258447Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.260981Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-11-26T18:40:10.260340Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092644:3816], now have 1 active actors on pipe
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|92023355-e0a1e52a-de158bb7-dddce0f1_9"
    Status: Active
    SeqNo: 0
  }
}
2025-11-26T18:40:10.260399Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.260423Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.260529Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|92023355-e0a1e52a-de158bb7-dddce0f1_9 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:10.260558Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.260572Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.260592Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.260603Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.260619Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.260655Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.260665Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.260682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.260726Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.260774Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.261990Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092644:3816] destroyed
2025-11-26T18:40:10.265948Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-26T18:40:10.265993Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 0:0 appended
2025-11-26T18:40:10.266025Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-26T18:40:10.266037Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.266053Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-26T18:40:10.267004Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.0/3
2025-11-26T18:40:10.267049Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-26T18:40:10.267065Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:0 appended
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|92023355-e0a1e52a-de158bb7-dddce0f1_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.274240Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.1/3
2025-11-26T18:40:10.274294Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-26T18:40:10.274315Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:1 appended
2025-11-26T18:40:10.274537Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.2/3
2025-11-26T18:40:10.274558Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-26T18:40:10.277554Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048956 count 2 nextOffset 2 batches 3
2025-11-26T18:40:10.277617Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:2 appended
2025-11-26T18:40:10.277650Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-26T18:40:10.277664Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.277683Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-26T18:40:10.278886Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.0/3
2025-11-26T18:40:10.278939Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-26T18:40:10.278957Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:0 appended
2025-11-26T18:40:10.280089Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.1/3
2025-11-26T18:40:10.280114Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-26T18:40:10.280128Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:1 appended
2025-11-26T18:40:10.280280Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.2/3
2025-11-26T18:40:10.280297Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-26T18:40:10.281236Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.281275Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.281290Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.281309Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.281320Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.300729Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097712 count 3 nextOffset 3 batches 5
2025-11-26T18:40:10.300795Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:2 appended
2025-11-26T18:40:10.300830Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-26T18:40:10.300843Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.300861Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-26T18:40:10.301855Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.0/3
2025-11-26T18:40:10.301891Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-26T18:40:10.301907Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:0 appended
2025-11-26T18:40:10.303267Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.1/3
2025-11-26T18:40:10.303306Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-26T18:40:10.303322Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:1 appended
2025-11-26T18:40:10.303513Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.2/3
2025-11-26T18:40:10.303530Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-26T18:40:10.306340Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146468 count 4 nextOffset 4 batches 7
2025-11-26T18:40:10.306397Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:2 appended
2025-11-26T18:40:10.306428Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-26T18:40:10.306439Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.306458Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-11-26T18:40:10.307696Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.0/3
2025-11-26T18:40:10.307743Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-26T18:40:10.307757Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:0 appended
2025-11-26T18:40:10.309765Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.309137Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.1/3
2025-11-26T18:40:10.309194Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-26T18:40:10.309237Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:1 appended
2025-11-26T18:40:10.309577Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.2/3
2025-11-26T18:40:10.309598Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-26T18:40:10.310314Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092647:3818], now have 1 active actors on pipe
2025-11-26T18:40:10.315299Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195224 count 5 nextOffset 5 batches 9
2025-11-26T18:40:10.315361Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:2 appended
2025-11-26T18:40:10.315394Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-26T18:40:10.315412Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.315431Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-26T18:40:10.316169Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.316224Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.316475Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.0/3
2025-11-26T18:40:10.316525Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-26T18:40:10.316541Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:0 appended
2025-11-26T18:40:10.316947Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.317577Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.317630Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.317661Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.317888Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.1/3
2025-11-26T18:40:10.317964Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-26T18:40:10.318001Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:1 appended
2025-11-26T18:40:10.318158Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.318207Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.2/3
2025-11-26T18:40:10.318225Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-26T18:40:10.318233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.318247Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.318275Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.318288Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.318306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.318324Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.318353Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.318477Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-26T18:40:10.318529Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.318551Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-26T18:40:10.318565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.318583Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-26T18:40:10.321855Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243980 count 6 nextOffset 6 batches 11
2025-11-26T18:40:10.321921Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:2 appended
2025-11-26T18:40:10.321955Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-26T18:40:10.321968Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.321987Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-26T18:40:10.323036Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.0/3
2025-11-26T18:40:10.323079Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-26T18:40:10.323094Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:0 appended
2025-11-26T18:40:10.324292Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.1/3
2025-11-26T18:40:10.324329Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-26T18:40:10.324343Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:1 appended
2025-11-26T18:40:10.324566Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.2/3
2025-11-26T18:40:10.324588Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-26T18:40:10.327529Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292736 count 7 nextOffset 7 batches 13
2025-11-26T18:40:10.327586Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:2 appended
2025-11-26T18:40:10.327618Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-26T18:40:10.327632Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.327650Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-26T18:40:10.329361Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.0/3
2025-11-26T18:40:10.329406Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-26T18:40:10.329421Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:0 appended
2025-11-26T18:40:10.330932Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.1/3
2025-11-26T18:40:10.330969Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-26T18:40:10.330985Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:1 appended
2025-11-26T18:40:10.331190Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.2/3
2025-11-26T18:40:10.331217Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-26T18:40:10.334462Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-26T18:40:10.334556Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.334573Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.334592Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.335419Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1764182410334
2025-11-26T18:40:10.336526Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.336664Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.338130Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341492 count 8 nextOffset 8 batches 15
2025-11-26T18:40:10.338190Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:2 appended
2025-11-26T18:40:10.338224Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-26T18:40:10.338236Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-26T18:40:10.338257Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-26T18:40:10.339486Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.0/3
2025-11-26T18:40:10.339536Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-26T18:40:10.339553Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:0 appended
2025-11-26T18:40:10.340721Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.1/3
2025-11-26T18:40:10.340747Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-26T18:40:10.340763Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:1 appended
2025-11-26T18:40:10.340914Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.2/3
2025-11-26T18:40:10.340930Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-26T18:40:10.346419Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.346463Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.346520Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.346538Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.346567Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-11-26T18:40:10.346579Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.346592Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-26T18:40:10.346619Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.346635Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-26T18:40:10.347201Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.347220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.347234Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.347252Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.347264Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.347299Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.347376Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.347563Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.347738Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.349085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092647:3818] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1764182410316
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 29
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.358568Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.381569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.381602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.381616Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.381636Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.381650Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.394825Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365511
2025-11-26T18:40:10.394909Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037894][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic12' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365511 WTime 1764182410394
2025-11-26T18:40:10.398914Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-11-26T18:40:10.398967Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:2 appended
2025-11-26T18:40:10.399605Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1764182410399
2025-11-26T18:40:10.399801Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.399819Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.399832Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.399850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.399862Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.399935Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092652:3822], now have 1 active actors on pipe
2025-11-26T18:40:10.400007Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.400032Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.400074Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.400218Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365511
2025-11-26T18:40:10.400303Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-11-26T18:40:10.400411Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cfd39c74-30625095-9afce466-d00f1a88_9 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:10.400439Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.400468Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.400489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.400503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.400521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.400555Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.400568Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.400583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.400625Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.400782Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.402060Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cfd39c74-30625095-9afce466-d00f1a88_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.406837Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092652:3822] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|cfd39c74-30625095-9afce466-d00f1a88_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.428798Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.430241Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092656:3825], now have 1 active actors on pipe
2025-11-26T18:40:10.433536Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365511 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.433581Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.433675Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365511
2025-11-26T18:40:10.433728Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-26T18:40:10.435225Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.435271Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.435810Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.436333Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.436375Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.436402Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.436814Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.437063Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.437085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.437095Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.437109Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.437117Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.437259Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.437292Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.437343Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:10.437366Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.437391Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-11-26T18:40:10.437401Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-26T18:40:10.437409Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-26T18:40:10.437419Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-26T18:40:10.437429Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-11-26T18:40:10.437438Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-11-26T18:40:10.437448Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-26T18:40:10.437457Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-26T18:40:10.437465Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-26T18:40:10.442401Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442457Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442497Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442531Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442568Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442600Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442632Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442664Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442700Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.442774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.442825Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.442851Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.442869Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.442911Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.442923Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.442957Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.442971Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.442993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.443120Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-26T18:40:10.443158Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.443176Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-26T18:40:10.443190Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.443203Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-26T18:40:10.445333Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-26T18:40:10.445365Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.445691Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.446053Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.446377Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.446706Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.447032Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.447390Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.447719Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.455961Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-26T18:40:10.456054Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.456072Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.456094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.457681Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1764182410457
2025-11-26T18:40:10.458833Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.459307Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.459470Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.472657Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.472730Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.472800Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.472833Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.472878Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-11-26T18:40:10.472898Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.472921Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-26T18:40:10.472944Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.472965Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-26T18:40:10.473414Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.473433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.473446Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.473462Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.473474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.473507Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.473584Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.473729Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.474115Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1764182410442
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 6
    WriteTimeMs: 29
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.477570Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.478112Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092656:3825] destroyed
2025-11-26T18:40:10.478177Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092676:3836], now have 1 active actors on pipe
2025-11-26T18:40:10.478701Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.478730Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.478832Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|86cfedb7-3ef9baf4-73884583-310dff42_10 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:10.478866Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.478881Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.478901Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.478915Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.478933Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.478967Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.478979Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.478994Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.479045Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.479102Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.479308Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-11-26T18:40:10.479898Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092676:3836] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|86cfedb7-3ef9baf4-73884583-310dff42_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.482157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.482188Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.482201Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.482220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.482243Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|86cfedb7-3ef9baf4-73884583-310dff42_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.500062Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.500111Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.500127Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.500149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.500167Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.500445Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.501533Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092679:3838], now have 1 active actors on pipe
2025-11-26T18:40:10.506787Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.506841Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.507406Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.508252Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.508289Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.508321Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.508560Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.508619Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.508634Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.508659Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.508671Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.508688Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.508703Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.508723Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.508843Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-26T18:40:10.508879Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.508895Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-26T18:40:10.508909Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.508926Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-26T18:40:10.515374Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-26T18:40:10.515471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.515489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.515507Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.516381Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1764182410515
2025-11-26T18:40:10.517541Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.517687Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.531353Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.531438Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.531496Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.531527Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.531562Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.531613Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-26T18:40:10.531634Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.531657Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-26T18:40:10.531683Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.531709Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-26T18:40:10.532097Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.532120Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.532133Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.532149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.532162Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.532198Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.532274Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.532462Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.534454Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092679:3838] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1764182410508
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 22
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.540384Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.541626Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092685:3842], now have 1 active actors on pipe
2025-11-26T18:40:10.541920Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.541971Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.542096Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|329e3d83-176f6068-bd18a670-c300c7e5_10 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:10.542145Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.542161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.542184Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.542199Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.542219Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.542257Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.542269Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.542285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.542350Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.542404Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.543898Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092685:3842] destroyed
2025-11-26T18:40:10.542548Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|329e3d83-176f6068-bd18a670-c300c7e5_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|329e3d83-176f6068-bd18a670-c300c7e5_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.570371Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.571050Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092689:3843], now have 1 active actors on pipe
2025-11-26T18:40:10.575538Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.575596Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.576137Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.576646Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.576687Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.576720Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.577020Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.577081Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.577095Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.577121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.577132Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.577150Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.577162Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.577181Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.577430Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-26T18:40:10.577470Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.577488Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-26T18:40:10.577501Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.577527Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-26T18:40:10.581573Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-26T18:40:10.581672Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.581688Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.581708Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.582542Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1764182410581
2025-11-26T18:40:10.583691Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.583732Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.583752Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.583765Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.583784Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.583796Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.583830Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.600317Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.600392Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.600491Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.600520Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.600570Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-26T18:40:10.600589Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.600615Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-26T18:40:10.600640Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.600662Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-26T18:40:10.601116Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.601137Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.601152Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.601169Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.601181Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.601216Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.601321Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.601379Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.601393Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.601405Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.601422Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.601433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.602042Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1764182410569
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 8
    WriteTimeMs: 19
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.602292Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.606320Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.609802Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092694:3847], now have 1 active actors on pipe
2025-11-26T18:40:10.609871Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092689:3843] destroyed
2025-11-26T18:40:10.610716Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.610760Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.610886Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3b00fb96-356677ae-c1cff95e-8f8737e4_11 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:10.610920Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.610937Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.610958Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.610972Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.610991Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.611028Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.611040Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.611056Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.611103Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.611161Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
2025-11-26T18:40:10.611307Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3b00fb96-356677ae-c1cff95e-8f8737e4_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.613758Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092694:3847] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|3b00fb96-356677ae-c1cff95e-8f8737e4_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.633470Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.636250Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092697:3849], now have 1 active actors on pipe
2025-11-26T18:40:10.642907Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.642968Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.643499Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.643979Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.644017Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.644047Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.644309Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.644368Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.644382Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.644407Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.644418Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.644435Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.644447Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.644484Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.644612Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-26T18:40:10.644648Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.644665Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-26T18:40:10.644678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.644693Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-26T18:40:10.649064Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-26T18:40:10.649469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.649493Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.649514Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.650475Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1764182410650
2025-11-26T18:40:10.651554Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.651697Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.674100Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.674173Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.674254Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.674282Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.674339Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-26T18:40:10.674356Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.674379Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-26T18:40:10.674403Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.674424Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-26T18:40:10.674829Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.674848Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.674861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.674879Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.675361Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.674891Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.674932Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.675015Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.675173Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1764182410644
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 29
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.676900Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092697:3849] destroyed
2025-11-26T18:40:10.678258Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.678887Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092702:3853], now have 1 active actors on pipe
2025-11-26T18:40:10.678948Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.678976Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.679067Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|fe2055cf-48c616ba-13ab7058-dc41d383_11 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:10.679105Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.679125Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.679145Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.679158Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.679177Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.679213Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.679229Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.679244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.679296Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.679352Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.679555Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|fe2055cf-48c616ba-13ab7058-dc41d383_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.680153Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092702:3853] destroyed
2025-11-26T18:40:10.684202Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.684229Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.684242Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.684260Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.684285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|fe2055cf-48c616ba-13ab7058-dc41d383_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.698304Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.700430Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092704:3854], now have 1 active actors on pipe
2025-11-26T18:40:10.703052Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.703094Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.703473Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.703818Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.703853Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.703883Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.704073Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.704119Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.704131Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.704149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.704157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.704169Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.704178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.704194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.704283Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-26T18:40:10.704309Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.704320Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-26T18:40:10.704331Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.704345Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-26T18:40:10.710984Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-26T18:40:10.711077Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.711093Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.711111Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.711880Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1764182410711
2025-11-26T18:40:10.712783Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:10.712817Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.712936Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.725936Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.726004Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.726082Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.726079Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.726113Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.726157Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-26T18:40:10.726178Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.726202Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-26T18:40:10.726225Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.726246Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-26T18:40:10.726673Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.726699Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.726713Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.726729Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.726740Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.726778Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.726856Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.727389Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.728568Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092704:3854] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1764182410704
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 3
    WriteTimeMs: 21
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.731037Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.736054Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.733398Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092708:3857], now have 1 active actors on pipe
2025-11-26T18:40:10.733491Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.733520Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.733628Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|17156a37-ea4ce4f7-7159c31d-9e2d8879_12 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:10.733661Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.733677Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.733697Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.733710Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.733743Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.733778Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.733790Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.733806Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.733862Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.733917Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.737752Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092708:3857] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|17156a37-ea4ce4f7-7159c31d-9e2d8879_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|17156a37-ea4ce4f7-7159c31d-9e2d8879_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.764230Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.764848Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092711:3859], now have 1 active actors on pipe
2025-11-26T18:40:10.769033Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.769077Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.769555Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.770078Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.770116Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.770146Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.770409Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.770456Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.770467Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.770486Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.770494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.770505Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.770514Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.770533Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.770653Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-26T18:40:10.770688Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.770702Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-26T18:40:10.770715Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.770729Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-26T18:40:10.783014Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-26T18:40:10.783112Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.783129Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.783146Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.783879Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1764182410783
2025-11-26T18:40:10.784846Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.784990Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.785469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:10.798806Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.798879Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.798946Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.798971Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.799012Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-26T18:40:10.799026Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.799045Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-26T18:40:10.799068Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.799093Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-26T18:40:10.799472Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.799489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.799501Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.799516Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.799528Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.799574Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.799650Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.799791Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.800204Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1764182410765
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 32
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.810779Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
CallPersQueueGRPC response:
2025-11-26T18:40:10.814924Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.813787Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|234d1689-58388a09-504b6e62-c6e77719_12"
    Status: Active
    SeqNo: 0
  }
}
2025-11-26T18:40:10.813822Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.813835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.813857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.813869Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.813952Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092716:3863], now have 1 active actors on pipe
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.814003Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092711:3859] destroyed
2025-11-26T18:40:10.814316Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.814359Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.814501Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|234d1689-58388a09-504b6e62-c6e77719_12 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:10.814533Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.814547Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.814568Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.814581Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.814601Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.814636Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.814648Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.814664Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.814708Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.814763Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.816050Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092716:3863] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|234d1689-58388a09-504b6e62-c6e77719_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.834394Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.834971Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092719:3865], now have 1 active actors on pipe
2025-11-26T18:40:10.839425Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.839474Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.839954Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.840403Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.840447Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.840488Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.840703Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.840764Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.840784Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.840808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.840820Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.840838Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.840850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.840870Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.840964Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-26T18:40:10.840994Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.841008Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-26T18:40:10.841020Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.841035Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-26T18:40:10.850020Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-26T18:40:10.850116Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.850130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.850148Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.851032Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1764182410850
2025-11-26T18:40:10.852120Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.852273Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.872521Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:10.872590Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.872652Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.872677Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.872715Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-26T18:40:10.872730Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.872752Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-26T18:40:10.872772Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.872792Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-26T18:40:10.873165Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.873180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.873192Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.873208Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.873218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.873274Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.873350Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.873537Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.873950Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.874951Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092719:3865] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1764182410840
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 30
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.877709Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.879302Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092725:3869], now have 1 active actors on pipe
2025-11-26T18:40:10.879955Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.879989Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.880089Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|44235281-8109b3d8-abd9c570-203393de_13 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:10.880123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.880137Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.880156Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.880168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.880186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.880220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.880231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.880246Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.880298Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.880350Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.880839Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:10.881890Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092725:3869] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|44235281-8109b3d8-abd9c570-203393de_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:10.885815Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.885840Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.885850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.885863Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.885872Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|44235281-8109b3d8-abd9c570-203393de_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.914348Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.914381Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.914395Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.914414Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.914426Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.918665Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.927713Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105755621092728:3871], now have 1 active actors on pipe
2025-11-26T18:40:10.936277Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:10.936333Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:10.937108Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.937645Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.937680Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.937711Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.938121Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.938174Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.938189Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.938219Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.938231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.938248Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.938260Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.938279Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.938395Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-26T18:40:10.938430Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.938445Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-26T18:40:10.938459Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.938474Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-26T18:40:10.949986Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-26T18:40:10.950081Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.950097Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.950115Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.950909Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1764182410950
2025-11-26T18:40:10.951899Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:10.952035Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-26T18:40:10.961605Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:10.961693Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:10.961743Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:10.961762Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:10.961788Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.961833Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-26T18:40:10.961855Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.961879Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-26T18:40:10.961904Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:10.961924Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-26T18:40:10.962328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.962353Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.962365Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.962380Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.962392Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.962424Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:10.962496Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.962702Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1764182410938
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 23
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:10.964214Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105755621092728:3871] destroyed
2025-11-26T18:40:10.965402Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.965984Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092739:3878], now have 1 active actors on pipe
2025-11-26T18:40:10.966246Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.966278Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.966369Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6a0f07e5-4429cf97-1fedef10-e32ff672_13 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:10.966403Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.966422Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.966440Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:10.966449Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.966465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.966502Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:10.966519Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:10.966536Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.966586Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:10.966632Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:10.966778Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-11-26T18:40:10.967398Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092739:3878] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6a0f07e5-4429cf97-1fedef10-e32ff672_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|6a0f07e5-4429cf97-1fedef10-e32ff672_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:10.986476Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.986511Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.986526Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.986545Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:10.986557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:10.988449Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:10.989087Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105755621092741:3879], now have 1 active actors on pipe
2025-11-26T18:40:10.993621Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:10.993676Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:10.994218Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:10.994626Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:10.994667Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:10.994698Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:10.995032Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:10.995094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:10.995113Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.995137Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.995152Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:10.995169Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:10.995183Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:10.995205Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.995313Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-26T18:40:10.995351Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.995371Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-26T18:40:10.995384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:10.995401Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-26T18:40:10.999611Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-26T18:40:10.999697Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:10.999711Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:10.999730Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.000616Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1764182411000
2025-11-26T18:40:11.001922Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:11.002079Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-26T18:40:11.009537Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:11.009614Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:11.009658Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:11.009688Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:11.009726Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.009771Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-26T18:40:11.009792Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.009815Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-26T18:40:11.009838Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.009865Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-26T18:40:11.010714Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1764182410994
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:11.010314Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.010341Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.010354Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.010371Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.010384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.010417Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:11.010491Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.016194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.016239Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.016267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.016299Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.016320Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.016785Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.017640Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105759916060042:3883], now have 1 active actors on pipe
2025-11-26T18:40:11.018208Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:11.018260Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:11.018424Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|83c14f07-f6ed9b9d-43d834fb-c46c0565_14 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:11.018471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.018510Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.018548Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:11.018580Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.018611Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.018677Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:11.018716Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:11.018766Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.018850Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:11.018926Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.019127Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|83c14f07-f6ed9b9d-43d834fb-c46c0565_14"
    Status: Active
    SeqNo: 0
  }
}
2025-11-26T18:40:11.020135Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105759916060042:3883] destroyed
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:11.021483Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105755621092741:3879] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|83c14f07-f6ed9b9d-43d834fb-c46c0565_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:11.045216Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.045862Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105759916060044:3884], now have 1 active actors on pipe
2025-11-26T18:40:11.050346Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:11.050391Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:11.050795Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:11.051196Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:11.051228Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:11.051258Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:11.051505Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:11.051551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.051561Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.051578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.051585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.051598Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:11.051606Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.051620Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.051741Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-26T18:40:11.051778Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.051792Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-26T18:40:11.051800Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.051810Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-26T18:40:11.059956Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-26T18:40:11.060049Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:11.060063Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:11.060082Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.060948Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1764182411060
2025-11-26T18:40:11.062046Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:11.062193Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-26T18:40:11.070261Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:11.070339Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:11.070413Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:11.070442Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.070486Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-26T18:40:11.070506Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.070529Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-26T18:40:11.070553Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.070580Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-26T18:40:11.070953Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.070975Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.070987Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.071003Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.071014Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.071042Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:11.071113Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.071278Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:11.071318Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1764182411051
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 17
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:11.073749Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105759916060044:3884] destroyed
2025-11-26T18:40:11.074629Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.076914Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105759916060048:3887], now have 1 active actors on pipe
2025-11-26T18:40:11.076989Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:11.077017Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:11.077125Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|afc36d8-dc6516e-f21e6a5a-a8d78144_14 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:11.077158Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.077174Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.077194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:11.077208Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.077231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.077287Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:11.077302Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:11.077317Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.077379Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:11.077439Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.078086Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|afc36d8-dc6516e-f21e6a5a-a8d78144_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:11.078873Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105759916060048:3887] destroyed
2025-11-26T18:40:11.086623Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.086661Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.086688Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.086710Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.086724Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|afc36d8-dc6516e-f21e6a5a-a8d78144_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:11.103852Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105759916060050:3888], now have 1 active actors on pipe
2025-11-26T18:40:11.103146Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.108321Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:11.108371Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:11.108895Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:11.109391Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:11.109432Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:11.109462Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:11.109715Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:11.109776Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.109795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.109821Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.109833Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.109848Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:11.109860Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.109881Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.109998Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-26T18:40:11.110039Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.110059Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-26T18:40:11.110070Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.110083Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-26T18:40:11.116629Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-26T18:40:11.116700Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:11.116710Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:11.116723Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.117479Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1764182411117
2025-11-26T18:40:11.118555Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:11.118588Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:11.118716Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-26T18:40:11.128839Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:11.128919Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:11.128966Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:11.128991Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:11.129030Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.129076Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-26T18:40:11.129095Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.131098Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-26T18:40:11.131159Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.131190Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-26T18:40:11.131729Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.131752Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.131763Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.131777Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.131789Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.131827Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:11.131910Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.132170Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1764182411109
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 18
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:11.134621Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105759916060050:3888] destroyed
2025-11-26T18:40:11.137952Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.138703Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105759916060060:3895], now have 1 active actors on pipe
2025-11-26T18:40:11.139162Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:11.139198Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:11.139298Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|7f640858-fb6f2fc4-847d303f-2e0ecbe1_15 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-26T18:40:11.139337Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.139355Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.139375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:11.139388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.139407Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.139450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:11.139465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:11.139481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.139533Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:11.139588Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.139843Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|7f640858-fb6f2fc4-847d303f-2e0ecbe1_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:11.145585Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105759916060060:3895] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|7f640858-fb6f2fc4-847d303f-2e0ecbe1_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:11.172192Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.172989Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105759916060072:3902], now have 1 active actors on pipe
2025-11-26T18:40:11.177713Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:11.177761Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:11.178269Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:11.178770Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:11.178806Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:11.178833Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:11.179198Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:11.179248Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.179261Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.179286Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.179297Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.179313Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:11.179325Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.179343Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.179446Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-26T18:40:11.179474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.179489Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-26T18:40:11.179502Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.179517Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-26T18:40:11.183714Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-26T18:40:11.183791Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:11.183804Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:11.183821Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.184678Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1764182411184
2025-11-26T18:40:11.185942Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:11.186092Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-26T18:40:11.187630Z node 5 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:11.195040Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7577105732584858228:2374]
2025-11-26T18:40:11.195108Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:11.195177Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:11.195215Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.195257Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-26T18:40:11.195272Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.195295Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-26T18:40:11.195319Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.195342Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-26T18:40:11.195873Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.195890Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.195902Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.195918Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.195928Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.195961Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:11.196035Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.196550Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:11.196917Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1764182411179
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-26T18:40:11.204158Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.204771Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105759916060077:3905], now have 1 active actors on pipe
2025-11-26T18:40:11.205231Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:11.205285Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:11.205392Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d150d0fc-9548ffb6-3e291320-6dd91662_15 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-26T18:40:11.205430Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.205447Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.205469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:11.205481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.205500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.205535Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:11.205547Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:11.205562Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.205617Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:11.205669Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.206148Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d150d0fc-9548ffb6-3e291320-6dd91662_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13507
2025-11-26T18:40:11.209725Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105759916060077:3905] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|d150d0fc-9548ffb6-3e291320-6dd91662_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-26T18:40:11.223196Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.223225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.223237Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.223254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.223265Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.224231Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105759916060072:3902] destroyed
2025-11-26T18:40:11.225989Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037888 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 3] state 'Ready' dataSize 0 rowCount 0 cpuUsage 0.0885
2025-11-26T18:40:11.236774Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.237528Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105759916060081:3908], now have 1 active actors on pipe
2025-11-26T18:40:11.242251Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:11.242301Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:11.242852Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-26T18:40:11.243373Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-26T18:40:11.243415Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1975: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-26T18:40:11.243441Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-26T18:40:11.247767Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:11.247837Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.247850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.247875Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.247886Z node 5 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:11.247900Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-26T18:40:11.247924Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.247942Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.248055Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-26T18:40:11.248093Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.248109Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-26T18:40:11.248122Z node 5 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:11.248138Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-26T18:40:11.264645Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-26T18:40:11.264733Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-26T18:40:11.264745Z node 5 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-26T18:40:11.264759Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.265541Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1764182411265
2025-11-26T18:40:11.266742Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:11.266877Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-26T18:40:11.278957Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7577105741174792974:2396]
2025-11-26T18:40:11.279029Z node 5 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:11.279081Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-26T18:40:11.279094Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:11.279118Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.279161Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-26T18:40:11.279181Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.279206Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-26T18:40:11.279229Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:11.279257Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-26T18:40:11.279818Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.279843Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.279856Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.279872Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.279883Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.279915Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:11.279988Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
2025-11-26T18:40:11.280198Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1764182411243
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 35
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-11-26T18:40:11.283360Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.282186Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105759916060081:3908] destroyed
2025-11-26T18:40:11.284131Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [4:7577105759916060085:3911], now have 1 active actors on pipe
2025-11-26T18:40:11.284446Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:11.284489Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:11.286113Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-11-26T18:40:11.286446Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365511 count 9 last offset 0, current partition end offset: 16
2025-11-26T18:40:11.286464Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-26T18:40:11.286517Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365511 accessed 0 times before, last time 2025-11-26T18:40:10.000000Z
2025-11-26T18:40:11.286552Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-26T18:40:11.286631Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:11.288825Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-11-26T18:40:11.288940Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512171 from pos 0 cbcount 2
2025-11-26T18:40:11.289591Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.289615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.289627Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.289645Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.289655Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.289719Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1764182407880
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
CallPersQueueGRPC request to localhost:13507
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-11-26T18:40:11.291541Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [4:7577105759916060085:3911] destroyed
2025-11-26T18:40:11.290068Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:11.294808Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-26T18:40:11.295384Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037894] server connected, pipe [4:7577105759916060088:3913], now have 1 active actors on pipe
2025-11-26T18:40:11.295661Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-26T18:40:11.295710Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-26T18:40:11.297027Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037894][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic12' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-11-26T18:40:11.297279Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037894][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365511 count 9 last offset 0, current partition end offset: 16
2025-11-26T18:40:11.297305Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037894][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-26T18:40:11.297362Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365511 accessed 0 times before, last time 2025-11-26T18:40:10.000000Z
2025-11-26T18:40:11.297398Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-26T18:40:11.297482Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:11.297522Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-11-26T18:40:11.299302Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512171 from pos 0 cbcount 2
2025-11-26T18:40:11.299653Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:11.299944Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:11.300608Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037894] server disconnected, pipe [4:7577105759916060088:3913] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1764182407920
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
2025-11-26T18:40:11.322143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.322192Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.322218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.322241Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.322258Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.332707Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-11-26T18:40:11.332893Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 3 shard idx 72057594046644480:1 data size 0 row count 0
2025-11-26T18:40:11.332974Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037888 maps to shardIdx: 72057594046644480:1 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 3], pathId map=SourceIdMeta2, is column=0, is olap=0, RowCount 0, DataSize 0
2025-11-26T18:40:11.333088Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037888 SplitByLoadNotEnabledForTable
2025-11-26T18:40:11.333669Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-11-26T18:40:11.389701Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.389730Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.389742Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.389761Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.389773Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.423327Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.423369Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.423383Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.423401Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.423414Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.454421Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:11.492417Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.492465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.492478Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.492496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.492508Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.525470Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.525507Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.525521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.525541Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.525553Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.595972Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.596009Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.596024Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.596043Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.596055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:11.628324Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:11.628359Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.628370Z node 5 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:11.628388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:11.628399Z node 5 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037894][Partition][0][StateIdle] Try persist
