2025-11-10T10:34:39.760096Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7571043277854948748:2156];send_to=[0:7307199536658146131:7762515];
2025-11-10T10:34:39.760219Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-10T10:34:39.768883Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-10T10:34:39.771812Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7571043278333227489:2086];send_to=[0:7307199536658146131:7762515];
2025-11-10T10:34:39.773137Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-10T10:34:39.772720Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/fhvo/0016a8/r3tmp/tmp4qoBBF/pdisk_1.dat
2025-11-10T10:34:39.791519Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-10T10:34:39.797137Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-10T10:34:39.916236Z node 4 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-10T10:34:39.946702Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-10T10:34:39.946801Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-10T10:34:39.948754Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-10T10:34:39.948831Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-10T10:34:39.956236Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-10T10:34:39.961123Z node 4 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 5 Cookie 5
2025-11-10T10:34:39.963268Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 62571, node 4
2025-11-10T10:34:40.053165Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-10T10:34:40.085663Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-10T10:34:40.106321Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/fhvo/0016a8/r3tmp/yandexM12nQg.tmp
2025-11-10T10:34:40.106350Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/fhvo/0016a8/r3tmp/yandexM12nQg.tmp
2025-11-10T10:34:40.106473Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/fhvo/0016a8/r3tmp/yandexM12nQg.tmp
2025-11-10T10:34:40.106640Z node 4 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-10T10:34:40.143707Z INFO: TTestServer started on Port 18700 GrpcPort 62571
TClient is connected to server localhost:18700
PQClient connected to localhost:62571
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-10T10:34:40.335983Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-10T10:34:40.396275Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-11-10T10:34:40.764365Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-10T10:34:40.773726Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-10T10:34:43.258984Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7571043295513097059:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T10:34:43.259053Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7571043295513097040:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T10:34:43.259141Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T10:34:43.259655Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7571043295513097067:2308], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T10:34:43.259707Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-10T10:34:43.269257Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-10T10:34:43.295970Z node 5 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [5:7571043295513097066:2307], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-10T10:34:43.370927Z node 5 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [5:7571043295513097095:2184] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-10T10:34:43.397997Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [5:7571043295513097109:2312], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-10T10:34:43.398383Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7571043295034818961:2333], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-10T10:34:43.400101Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2520: SessionId: ydb://session/3?node_id=5&id=NWNhNzU3ZTEtZWJmNWU0YWQtZTk1ZmQwZDItNmFiNzViZTA=, ActorId: [5:7571043295513097034:2302], ActorState: ExecuteState, TraceId: 01k9pna4np4e3v6z6swqhak7gr, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-10T10:34:43.400399Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-10T10:34:43.400744Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2520: SessionId: ydb://session/3?node_id=4&id=NjllMjI2YzMtNTFmM2Y3M2YtOWU4NzQzMTItNDAxYmQ0MjU=, ActorId: [4:7571043295034818936:2327], ActorState: ExecuteState, TraceId: 01k9pna4sb2a1szxgxgc05fp18, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-10T10:34:43.401032Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-10T10:34:43.417871Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-10T10:34:43.480907Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-10T10:34:43.609267Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-10T10:34:43.878436Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01k9pna54g6z92wys04q9sacke, Database: , SessionId: ydb://session/3?node_id=4&id=OGMzZGU0N2QtZTY1ZjIxMzctMjczMjViZjQtOWE3YzI0ZDI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [4:7571043295034819399:3067] 
2025-11-10T10:34:44.760160Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7571043277854948748:2156];send_to=[0:7307199536658146131:7762515];
2025-11-10T10:34:44.760240Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-10T10:34:44.765216Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7571043278333227489:2086];send_to=[0:7307199536658146131:7762515];
2025-11-10T10:34:44.765296Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:62571
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-10T10:34:50.624660Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62571
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-10T10:34:50.668021Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [4:7571043325099590878:3300] connected; active server actors: 1
2025-11-10T10:34:50.668193Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-10T10:34:50.668871Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-10T10:34:50.669769Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-10T10:34:50.676852Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 5, Generation 1
2025-11-10T10:34:50.673846Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-10T10:34:50.676073Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-10T10:34:50.676267Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-10T10:34:50.676293Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-10T10:34:50.676326Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-10T10:34:50.676698Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043325099590902:2447], now have 1 active actors on pipe
2025-11-10T10:34:50.676728Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043325099590877:3299], now have 1 active actors on pipe
2025-11-10T10:34:50.677485Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.681100Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.695342Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043325099590933:3346], now have 1 active actors on pipe
2025-11-10T10:34:50.695563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.699183Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.699893Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-10T10:34:50.699933Z node 5 :PERSQUEUE DEBUG: partition.cpp:1313: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-10T10:34:50.700123Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-10T10:34:50.700263Z node 5 :PERSQUEUE INFO: partition_init.cpp:1102: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [5:7571043325577868438:2369]
2025-11-10T10:34:50.702669Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-10T10:34:50.702691Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-10T10:34:50.702706Z node 5 :PERSQUEUE INFO: partition.cpp:708: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [5:7571043325577868438:2369]
2025-11-10T10:34:50.702724Z node 5 :PERSQUEUE DEBUG: partition.cpp:728: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-10T10:34:50.702746Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-10T10:34:50.703597Z node 5 :PERSQUEUE DEBUG: partition.cpp:4403: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-10T10:34:50.703616Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.703631Z node 5 :PERSQUEUE DEBUG: partition.cpp:2397: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-10T10:34:50.703657Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.703667Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.703678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.703689Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.703711Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.703728Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.703738Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.703749Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.703760Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.703783Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-10T10:34:50.703804Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:70: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-10T10:34:50.703982Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.704069Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:50.710927Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.711090Z node 5 :PERSQUEUE DEBUG: partition.cpp:1425: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762770890734, TxId 281474976715670
2025-11-10T10:34:50.711154Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.711168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.711178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.711206Z node 5 :PERSQUEUE DEBUG: partition.cpp:2461: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-10T10:34:50.711245Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:50.711257Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:50.711272Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.711459Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:50.714714Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:50.714904Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-10T10:34:50.715002Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:50.715021Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.715033Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:50.715045Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.715059Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:50.715071Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.715104Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:50.715405Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-10T10:34:50.715484Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-10T10:34:50.715739Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.723260Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.723363Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.726833Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.804217Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.804256Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:50.804267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.804285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:50.804296Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.832173Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715671. Ctx: { TraceId: 01k9pnabyh2yy4s4s4smkfw9z4, Database: , SessionId: ydb://session/3?node_id=4&id=ZTVkNTI1NWUtZGRjNmQ5ZTAtZDBkN2FkNzItNGMwZGQyZDY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762770890734
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715670
    CreateStep: 1762770890734
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:62571
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
PQ Client: create topic: rt3.dc1--topic12 with 1 partitions
CallPersQueueGRPC request to localhost:62571
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-10T10:34:50.880683Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic12, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62571
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic12"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-10T10:34:50.886087Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715672
  SchemeShardTabletId: 72057594046644480
  PathId: 14
}
ErrorCode: OK
AddTopic: rt3.dc1--topic12
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic12, dc = dc1
2025-11-10T10:34:50.904601Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.904648Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:50.904662Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.904684Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:50.904705Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.922570Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037895][] pipe [4:7571043325099591084:3447] connected; active server actors: 1
2025-11-10T10:34:50.922767Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037895][rt3.dc1--topic12] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-10T10:34:50.923641Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037895][rt3.dc1--topic12] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037895
2025-11-10T10:34:50.924571Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037895][rt3.dc1--topic12] BALANCER INIT DONE for rt3.dc1--topic12: (0, 72075186224037894) 
2025-11-10T10:34:50.930836Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037894] Handle TEvInterconnect::TEvNodeInfo
2025-11-10T10:34:50.937862Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037894] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-10T10:34:50.938149Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037894] no config, start with empty partitions and default config
2025-11-10T10:34:50.938181Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-10T10:34:50.938219Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037894] doesn't have tx writes info
2025-11-10T10:34:50.938538Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043325099591083:3446], now have 1 active actors on pipe
2025-11-10T10:34:50.938563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043325099591104:2465], now have 1 active actors on pipe
2025-11-10T10:34:50.939365Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037895][rt3.dc1--topic12] TEvClientConnected TabletId 72075186224037894, NodeId 5, Generation 1
2025-11-10T10:34:50.942361Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.956563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.964706Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043325099591133:3489], now have 1 active actors on pipe
2025-11-10T10:34:50.965421Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.977099Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.978429Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitConfigStep
2025-11-10T10:34:50.978476Z node 5 :PERSQUEUE DEBUG: partition.cpp:1313: [72075186224037894][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-10T10:34:50.978694Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-10T10:34:50.978855Z node 5 :PERSQUEUE INFO: partition_init.cpp:1102: [72075186224037894][Partition][0][StateInit] bootstrapping 0 [5:7571043325577868530:2377]
2025-11-10T10:34:50.981579Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitFieldsStep
2025-11-10T10:34:50.981598Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic12:0:Initializer] Initializing completed.
2025-11-10T10:34:50.981618Z node 5 :PERSQUEUE INFO: partition.cpp:708: [72075186224037894][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic12' partition 0 generation 1 [5:7571043325577868530:2377]
2025-11-10T10:34:50.981641Z node 5 :PERSQUEUE DEBUG: partition.cpp:728: [72075186224037894][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic12 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-10T10:34:50.981668Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037894][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-10T10:34:50.982814Z node 5 :PERSQUEUE DEBUG: partition.cpp:4403: [72075186224037894][Partition][0][StateIdle] Process pending events. Count 1
2025-11-10T10:34:50.982849Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.982866Z node 5 :PERSQUEUE DEBUG: partition.cpp:2397: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-10T10:34:50.982904Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.982914Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.982928Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.982940Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.982969Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.982980Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.982990Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.983004Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.983015Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.983047Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-10T10:34:50.983076Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:70: [72075186224037894][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-10T10:34:50.983296Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.983437Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:50.987208Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.987317Z node 5 :PERSQUEUE DEBUG: partition.cpp:1425: [72075186224037894][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1762770891007, TxId 281474976715672
2025-11-10T10:34:50.987371Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.987388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:50.987399Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.987424Z node 5 :PERSQUEUE DEBUG: partition.cpp:2461: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-10T10:34:50.987460Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:50.987471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:50.987484Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.987641Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:50.990165Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:50.990342Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037894][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-10T10:34:50.990432Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:50.990452Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:50.990465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:50.990476Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:50.990492Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:50.990503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:50.990527Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:50.990843Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037894] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic12" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic12" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-10T10:34:50.990918Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-10T10:34:50.991146Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.995115Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:50.995192Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-10T10:34:50.997452Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-10T10:34:51.005446Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.005473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.005483Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.005500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.005513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.044236Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01k9pnac5ycb2qzm3dmdvd4pg7, Database: , SessionId: ydb://session/3?node_id=4&id=NjU3YzhkMWUtZDczNTJhZjItZDUyNTI1NGEtNmRhYjY3Zg==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic12
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 14
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762770891007
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 14
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 14
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715672
    CreateStep: 1762770891007
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 14
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037894
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037895
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 13
    PathsLimit: 10000
    ShardsInside: 8
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic12"
 name rt3.dc1--topic12 version1
CallPersQueueGRPC request to localhost:62571
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-10T10:34:51.074767Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic12"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic12"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.078713Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.081218Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558500:3531], now have 1 active actors on pipe
2025-11-10T10:34:51.081542Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.081575Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.081649Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|c8e1864-28da6ee2-de304613-ad18b298_0 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:51.081686Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.081711Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.081732Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.081747Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.081779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.081812Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.081823Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.081836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.081870Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.081929Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.082196Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.082761Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558500:3531] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|c8e1864-28da6ee2-de304613-ad18b298_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:51.083225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.083257Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.083268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|c8e1864-28da6ee2-de304613-ad18b298_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
  }
  MessageNo: 0
}
2025-11-10T10:34:51.083284Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.083306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.085179Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.086121Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558503:3532], now have 1 active actors on pipe
2025-11-10T10:34:51.086462Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.086491Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.086762Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-11-10T10:34:51.086805Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.086844Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.086860Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.086882Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.086893Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.086912Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.087002Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-10T10:34:51.087802Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-10T10:34:51.087843Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.087855Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.087870Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.088304Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1762770891087
2025-11-10T10:34:51.088435Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.088544Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-11-10T10:34:51.091432Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:51.091479Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.091527Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.091568Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.091606Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-10T10:34:51.091781Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-10T10:34:51.091808Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-10T10:34:51.091827Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.091839Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.091851Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.091865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.091877Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.091901Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.091943Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.092039Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-10T10:34:51.092042Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-10T10:34:51.092208Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-11-10T10:34:51.092230Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-10T10:34:51.092266Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:51.092291Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-10T10:34:51.092325Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T10:34:51.092430Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-11-10T10:34:51.092483Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1762770891086 queuesize 0 startOffset 0
2025-11-10T10:34:51.092583Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-10T10:34:51.092297Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1762770891086
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.094148Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558503:3532] destroyed
2025-11-10T10:34:51.094601Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.095514Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558507:3534], now have 1 active actors on pipe
2025-11-10T10:34:51.095861Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.095892Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.095963Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|64c15c9f-9022577b-dc5df919-a1facc2f_0 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:51.096007Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.096023Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.096041Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.096053Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.096089Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.096119Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.096131Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.096146Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.096179Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.096236Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.096406Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.096879Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558507:3534] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|64c15c9f-9022577b-dc5df919-a1facc2f_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|64c15c9f-9022577b-dc5df919-a1facc2f_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
  }
  MessageNo: 0
}
2025-11-10T10:34:51.098749Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.099659Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558510:3535], now have 1 active actors on pipe
2025-11-10T10:34:51.100178Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.100205Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.100483Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-11-10T10:34:51.100524Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.100559Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.100572Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.100597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.100608Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.100628Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.100707Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-10T10:34:51.109645Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.109687Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.109702Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.109727Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.109744Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.145358Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-10T10:34:51.145418Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.145431Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.145449Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.145881Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1762770891145
2025-11-10T10:34:51.146037Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.146130Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-11-10T10:34:51.148532Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:51.148582Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.148636Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.148663Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.148700Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-10T10:34:51.148867Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-10T10:34:51.148893Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-10T10:34:51.148911Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.148925Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.148939Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.148954Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.148966Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.148994Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.149026Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.149078Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-10T10:34:51.149160Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037894][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic12' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-10T10:34:51.149328Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037894][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-11-10T10:34:51.149345Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037894][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-10T10:34:51.149379Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:51.149405Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-10T10:34:51.149439Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T10:34:51.149536Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-11-10T10:34:51.149585Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp done, result 1762770891098 queuesize 0 startOffset 0
2025-11-10T10:34:51.149736Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1762770891098
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 46
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.151275Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-10T10:34:51.152279Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558510:3535] destroyed
2025-11-10T10:34:51.153133Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.158604Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558515:3538], now have 1 active actors on pipe
2025-11-10T10:34:51.159056Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.159086Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.159188Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|92778e5b-271b0aa2-b4aa9b32-c5f71578_1 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:51.159214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.159228Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.159245Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.159259Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.159276Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.159305Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.159318Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.159332Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.159368Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.159411Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.159891Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.160728Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558515:3538] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|92778e5b-271b0aa2-b4aa9b32-c5f71578_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|92778e5b-271b0aa2-b4aa9b32-c5f71578_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.185168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.185206Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.185219Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.185242Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.185256Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.187429Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.188716Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558518:3539], now have 1 active actors on pipe
2025-11-10T10:34:51.193715Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.193759Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.194228Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.194655Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.194760Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.194783Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.194978Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.195024Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.195037Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.195058Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.195069Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.195085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.195098Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.195119Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.195213Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-10T10:34:51.195240Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.195254Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-10T10:34:51.195266Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.195279Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-10T10:34:51.253042Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-10T10:34:51.253143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.253157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.253178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.253854Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1762770891253
2025-11-10T10:34:51.255041Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:51.255076Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.255183Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.281784Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:51.281856Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.281920Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.281947Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.281984Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-10T10:34:51.281998Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.282018Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-10T10:34:51.282037Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.282056Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-10T10:34:51.282421Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.282453Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.282466Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.282481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.282494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.282523Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.282586Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.282711Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:51.284964Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558518:3539] destroyed
2025-11-10T10:34:51.282943Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1762770891191
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 89
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.286428Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.286457Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.286469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.286487Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.286499Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.288239Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.289926Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558526:3544], now have 1 active actors on pipe
2025-11-10T10:34:51.290393Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.290442Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.290543Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3ceb69e8-682fc6f1-b96e18cb-614d7aca_1 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:51.290580Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.290597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.290616Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.290632Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.290652Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.290687Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.290710Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.290737Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.290781Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.290850Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.291222Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3ceb69e8-682fc6f1-b96e18cb-614d7aca_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:51.292127Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558526:3544] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|3ceb69e8-682fc6f1-b96e18cb-614d7aca_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.310397Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.313166Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558529:3545], now have 1 active actors on pipe
2025-11-10T10:34:51.315943Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.315988Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.316458Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.316911Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.316979Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.317005Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.317236Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.317295Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.317312Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.317335Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.317345Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.317361Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.317373Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.317396Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.317509Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-10T10:34:51.317548Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.317561Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-10T10:34:51.317574Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.317587Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-10T10:34:51.347418Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-10T10:34:51.347505Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.347520Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.347540Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.348261Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1762770891347
2025-11-10T10:34:51.349482Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.349607Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.355161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.355187Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.355200Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.355218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.355233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.357337Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:51.357389Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.357452Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.357477Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.357511Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-10T10:34:51.357523Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.357542Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-10T10:34:51.357560Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.357577Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-10T10:34:51.357919Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.357935Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.357948Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.357962Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.357975Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.358008Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.358065Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
2025-11-10T10:34:51.358512Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1762770891316
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 39
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-10T10:34:51.360208Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558529:3545] destroyed
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.358674Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.363387Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.369241Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558534:3548], now have 1 active actors on pipe
2025-11-10T10:34:51.369308Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.369332Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.369422Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|4b0f8ab7-881c3b59-d45f766c-306d542_2 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:51.369450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.369464Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.369482Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.369497Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.369515Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.369550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.369563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.369577Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.369623Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.369666Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.387821Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.387852Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.387866Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.387889Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.387904Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.394955Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|4b0f8ab7-881c3b59-d45f766c-306d542_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:51.395666Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558534:3548] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|4b0f8ab7-881c3b59-d45f766c-306d542_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.418208Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.419424Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558537:3549], now have 1 active actors on pipe
2025-11-10T10:34:51.423352Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.423402Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.423908Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.424368Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.424407Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.424432Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.424674Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.424725Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.424741Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.424764Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.424775Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.424793Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.424807Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.424830Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.424935Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-10T10:34:51.424968Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.424983Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-10T10:34:51.424995Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.425008Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-10T10:34:51.450369Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-10T10:34:51.450456Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.450469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.450489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.451173Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1762770891450
2025-11-10T10:34:51.452187Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.452313Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.455477Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:51.475214Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:51.475286Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.475340Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:51.475350Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.475376Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.475431Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-10T10:34:51.475444Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.475463Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-10T10:34:51.475486Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.475502Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-10T10:34:51.475870Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.475887Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.475900Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.475917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.475932Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.475965Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.476024Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.476822Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.478532Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558537:3549] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1762770891424
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 51
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.487943Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.487974Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.487988Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.488010Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.488024Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.489826Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.492166Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558543:3553], now have 1 active actors on pipe
2025-11-10T10:34:51.492471Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.492501Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.492594Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|c8d1407d-637eb99c-56e30143-73ce31d1_2 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:51.492624Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.492638Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.492658Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.492671Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.492689Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.492722Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.492735Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.492751Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.492794Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.492839Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.493313Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|c8d1407d-637eb99c-56e30143-73ce31d1_2"
    Status: Active
    SeqNo: 0
  }
}
2025-11-10T10:34:51.493991Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558543:3553] destroyed
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|c8d1407d-637eb99c-56e30143-73ce31d1_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.514067Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.515458Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558546:3554], now have 1 active actors on pipe
2025-11-10T10:34:51.519331Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.519380Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.519873Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.520551Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.520588Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.520613Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.520852Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.520910Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.520926Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.520949Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.520959Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.520973Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.520987Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.521009Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.521188Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-10T10:34:51.521233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.521247Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-10T10:34:51.521259Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.521270Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-10T10:34:51.543493Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-10T10:34:51.543577Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.543592Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.543612Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.544401Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1762770891543
2025-11-10T10:34:51.545822Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.545957Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.554190Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:51.554253Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.554318Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.554347Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.554385Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-10T10:34:51.554397Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.554418Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-10T10:34:51.554438Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.554456Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-10T10:34:51.554916Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.554934Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.554946Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.554963Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.554977Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.555011Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.555070Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.555182Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:51.555856Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.555881Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.555904Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.555360Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.555936Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.555960Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.556579Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558546:3554] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1762770891520
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 32
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.558870Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.560152Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558551:3557], now have 1 active actors on pipe
2025-11-10T10:34:51.560410Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.560444Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.560538Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e8e3887e-29706dd-5c2a0bc7-eb4971a5_3 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:51.560570Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.560589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.560607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.560620Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.560641Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.560679Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.560697Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.560713Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.560751Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.560799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.560992Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.561599Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558551:3557] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e8e3887e-29706dd-5c2a0bc7-eb4971a5_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e8e3887e-29706dd-5c2a0bc7-eb4971a5_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.589807Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.589855Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.589877Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.589901Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.589917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.594990Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.601485Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558554:3558], now have 1 active actors on pipe
2025-11-10T10:34:51.606575Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.606626Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.607272Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.607730Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.607775Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.607799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.608176Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.608224Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.608240Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.608262Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.608274Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.608291Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.608303Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.608325Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.608437Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-10T10:34:51.608473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.608487Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-10T10:34:51.608500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.608513Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-10T10:34:51.638966Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-10T10:34:51.639057Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.639070Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.639087Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.639756Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1762770891639
2025-11-10T10:34:51.640879Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.641003Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.656184Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:51.666170Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:51.666233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.666292Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.666314Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.666349Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-10T10:34:51.666360Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.666382Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-10T10:34:51.666401Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.666420Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-10T10:34:51.666944Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.666959Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.666972Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.666985Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.666998Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.667033Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.667093Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.667522Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:51.667690Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.669235Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558554:3558] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1762770891603
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 61
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.677631Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.679102Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558578:3572], now have 1 active actors on pipe
2025-11-10T10:34:51.680230Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.680255Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.680322Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|653b8e58-523a1579-4bddcb79-17b57b10_3 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:51.680342Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.680351Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.680365Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.680374Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.680387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.680410Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.680418Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.680429Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.680461Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.680490Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.680811Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.681321Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558578:3572] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|653b8e58-523a1579-4bddcb79-17b57b10_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:51.689940Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.689962Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.689971Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.689985Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.689995Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|653b8e58-523a1579-4bddcb79-17b57b10_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.711457Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.712545Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558581:3573], now have 1 active actors on pipe
2025-11-10T10:34:51.716401Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.716441Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.716913Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.717414Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.717457Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.717477Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.717863Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.717906Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.717918Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.717941Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.717951Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.717966Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.717976Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.717993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.718078Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-10T10:34:51.718106Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.718122Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-10T10:34:51.718134Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.718146Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-10T10:34:51.746289Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-10T10:34:51.746363Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.746376Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.746393Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.747047Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1762770891746
2025-11-10T10:34:51.748040Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.748149Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.757974Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:51.758025Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.758079Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.758098Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.758132Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-10T10:34:51.758144Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.758164Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-10T10:34:51.758183Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.758203Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-10T10:34:51.758693Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.758709Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.758721Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.758735Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.758746Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.758776Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.758828Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.758871Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.758883Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.758894Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.758908Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.758920Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.759631Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.759370Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:51.760970Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558581:3573] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1762770891717
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 36
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.765767Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.769495Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558589:3576], now have 1 active actors on pipe
2025-11-10T10:34:51.772097Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.772135Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.772233Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|49f8a19e-e5cb8665-1759ddc-fb2945db_4 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:51.772260Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.772273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.772291Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.772303Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.772321Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.772352Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.772364Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.772378Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.772419Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.772462Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|49f8a19e-e5cb8665-1759ddc-fb2945db_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:51.772748Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.775476Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558589:3576] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|49f8a19e-e5cb8665-1759ddc-fb2945db_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.790284Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.790312Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.790473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.790494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.790506Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.797887Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.801363Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558592:3577], now have 1 active actors on pipe
2025-11-10T10:34:51.805600Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.805753Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.806245Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.806768Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.806803Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.806824Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.807211Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.807254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.807267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.807287Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.807298Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.807311Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.807320Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.807336Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.807420Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-10T10:34:51.807448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.807460Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-10T10:34:51.807471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.807484Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-10T10:34:51.818750Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-10T10:34:51.818828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.818841Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.818856Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.819425Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1762770891818
2025-11-10T10:34:51.820426Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.820522Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.831376Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:51.831443Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.831516Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.831548Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.831586Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-10T10:34:51.831610Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.831628Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-10T10:34:51.831647Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.831666Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-10T10:34:51.832259Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.832284Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.832298Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.832313Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.832326Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.832376Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.832439Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.832555Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:51.832742Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.833798Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558592:3577] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1762770891807
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.836988Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.838354Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558597:3580], now have 1 active actors on pipe
2025-11-10T10:34:51.838561Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.838591Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.838696Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3747e36-f06ebb12-4d23fc3d-e2a38560_4 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:51.838731Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.838746Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.838765Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.838785Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.838804Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.838844Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.838863Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.838880Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.838927Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.838978Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.839289Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.839869Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558597:3580] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3747e36-f06ebb12-4d23fc3d-e2a38560_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|3747e36-f06ebb12-4d23fc3d-e2a38560_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.858934Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.858963Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.858973Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.858989Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.859012Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.863048Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.864402Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558600:3581], now have 1 active actors on pipe
2025-11-10T10:34:51.867759Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.867802Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.868290Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.868753Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.868784Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.868804Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.869221Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.869268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.869281Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.869303Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.869314Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.869329Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.869339Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.869356Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.869444Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-10T10:34:51.869474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.869489Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-10T10:34:51.869502Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.869516Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-10T10:34:51.879004Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-10T10:34:51.879070Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.879083Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.879100Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.879698Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1762770891879
2025-11-10T10:34:51.880741Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.880861Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.890688Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:51.895510Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:51.895570Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.895627Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.895650Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.895686Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-10T10:34:51.895699Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.895720Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-10T10:34:51.895750Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.895771Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-10T10:34:51.896286Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.896302Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.896313Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.896328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.896341Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.896372Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.896438Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.896606Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:51.896774Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.898728Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558600:3581] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1762770891865
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 29
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.909272Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.912238Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558606:3585], now have 1 active actors on pipe
2025-11-10T10:34:51.912315Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.912339Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.912427Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e8472644-54c97bf8-25c79609-d28e8d50_5 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:51.912458Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.912472Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.912492Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.912509Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.912525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.912556Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.912583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.912601Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.912642Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.912690Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.912833Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e8472644-54c97bf8-25c79609-d28e8d50_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:51.913951Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558606:3585] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e8472644-54c97bf8-25c79609-d28e8d50_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:51.942507Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.944343Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043329394558631:3595], now have 1 active actors on pipe
2025-11-10T10:34:51.948872Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:51.948916Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:51.949405Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:51.949822Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:51.949865Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:51.949888Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:51.950234Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:51.950282Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.950297Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.950319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.950330Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.950345Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:51.950355Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.950374Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.950462Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-10T10:34:51.950491Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.950505Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-10T10:34:51.950517Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.950530Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-10T10:34:51.958477Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-10T10:34:51.958553Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:51.958567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:51.958585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.959232Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1762770891959
2025-11-10T10:34:51.960233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:51.960253Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:51.960359Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-10T10:34:51.974549Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:51.974614Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:51.974673Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:51.974696Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.974747Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-10T10:34:51.974759Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.974780Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-10T10:34:51.974799Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:51.974819Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-10T10:34:51.975157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.975172Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.975183Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.975199Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.975211Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.975243Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:51.975305Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.975784Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:51.975968Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.977016Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043329394558631:3595] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1762770891949
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:51.979428Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:51.982206Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043329394558645:3601], now have 1 active actors on pipe
2025-11-10T10:34:51.982415Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:51.982446Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:51.982543Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5dd2c0b4-add7807d-b9131fe5-adc45f45_5 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:51.982570Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.982585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:51.982605Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:51.982617Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.982635Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:51.982666Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:51.982678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:51.982693Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:51.982731Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:51.982775Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:51.982947Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:51.983521Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043329394558645:3601] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5dd2c0b4-add7807d-b9131fe5-adc45f45_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:51.991062Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:51.991107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.991122Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:51.991144Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:51.991159Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|5dd2c0b4-add7807d-b9131fe5-adc45f45_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.006929Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.009412Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689525944:3602], now have 1 active actors on pipe
2025-11-10T10:34:52.013298Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.013346Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.013801Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.014235Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.014266Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.014291Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.014506Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.014552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.014567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.014589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.014600Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.014615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.014628Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.014648Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.014740Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-10T10:34:52.014769Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.014785Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-10T10:34:52.014799Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.014813Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-10T10:34:52.027503Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-10T10:34:52.027586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.027599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.027619Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.028310Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1762770892027
2025-11-10T10:34:52.029580Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.029704Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.044527Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.044599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.044648Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.044670Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.044692Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.044729Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-10T10:34:52.044749Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.044769Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-10T10:34:52.044787Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.044807Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-10T10:34:52.045130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.045186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.045204Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.045220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.045232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.045267Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.045335Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.047084Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1762770892014
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 29
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.048588Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689525944:3602] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.051383Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.058134Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689525951:3605], now have 1 active actors on pipe
2025-11-10T10:34:52.058569Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.058604Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.058702Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|57016fa4-70a4b39c-942acd52-b2a5b561_6 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:52.058734Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.058747Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.058765Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.058778Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.058797Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.058831Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.058849Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.058865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.058905Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.058952Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.059174Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.060396Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.060420Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.060432Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.060449Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.060462Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.060506Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689525951:3605] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|57016fa4-70a4b39c-942acd52-b2a5b561_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|57016fa4-70a4b39c-942acd52-b2a5b561_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.091494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.091531Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.091544Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.091567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.091583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.096853Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.098833Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689525955:3606], now have 1 active actors on pipe
2025-11-10T10:34:52.103519Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.103570Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.104069Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.104520Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.104552Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.104577Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.104795Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.104844Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.104859Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.104880Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.104893Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.104912Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.104925Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.104946Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.105042Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-10T10:34:52.105535Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.105563Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-10T10:34:52.105578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.105595Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-10T10:34:52.119932Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-10T10:34:52.120019Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.120032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.120051Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.120673Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1762770892120
2025-11-10T10:34:52.121839Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.121945Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.132295Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.132370Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.132435Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.132459Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.132509Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-10T10:34:52.132523Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.132546Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-10T10:34:52.132567Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.132586Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-10T10:34:52.132964Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.132989Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.133002Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.133019Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.133033Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.133084Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.133148Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.133267Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.133440Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.134333Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689525955:3606] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1762770892104
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 27
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.136635Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.138416Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689525962:3611], now have 1 active actors on pipe
2025-11-10T10:34:52.138680Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.138709Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.138800Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2240705b-5719e710-cc2c6320-bbbb6c04_6 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:52.138827Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.138841Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.138857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.138871Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.138903Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.138937Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.138951Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.138966Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.139007Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.139050Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.139148Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.139670Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689525962:3611] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2240705b-5719e710-cc2c6320-bbbb6c04_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|2240705b-5719e710-cc2c6320-bbbb6c04_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.157761Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.158847Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689525965:3612], now have 1 active actors on pipe
2025-11-10T10:34:52.160503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.160529Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.160542Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.160561Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.160578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.163175Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.163221Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.163688Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.164173Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.164203Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.164227Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.164446Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.164496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.164510Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.164529Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.164540Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.164557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.164570Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.164589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.164682Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-10T10:34:52.164716Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.164730Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-10T10:34:52.164742Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.164755Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-10T10:34:52.181445Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-10T10:34:52.181536Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.181552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.181572Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.182272Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1762770892182
2025-11-10T10:34:52.183301Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.183422Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.191661Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.191753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:52.191773Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.191775Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.191839Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.191863Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.191905Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-10T10:34:52.191917Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.191939Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-10T10:34:52.191962Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.191982Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-10T10:34:52.192323Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.192344Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.192358Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.192374Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.192388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.192419Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.192486Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.192665Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1762770892164
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 27
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.194334Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689525965:3612] destroyed
2025-11-10T10:34:52.195733Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.196879Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689525970:3615], now have 1 active actors on pipe
2025-11-10T10:34:52.197188Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.197218Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.197325Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a0ad0043-4a095af8-f79a93f8-77e5f335_7 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:52.197355Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.197372Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.197390Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.197403Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.197421Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.197456Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.197479Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.197499Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.197544Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.197594Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.197728Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a0ad0043-4a095af8-f79a93f8-77e5f335_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.203713Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689525970:3615] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|a0ad0043-4a095af8-f79a93f8-77e5f335_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.218038Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.219536Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689525973:3616], now have 1 active actors on pipe
2025-11-10T10:34:52.223095Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.223150Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.223628Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.224107Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.224146Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.224170Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.224511Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.224564Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.224579Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.224601Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.224618Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.224634Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.224646Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.224667Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.224762Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-10T10:34:52.224802Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.224824Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-10T10:34:52.224837Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.224852Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-10T10:34:52.241119Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-10T10:34:52.241194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.241208Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.241229Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.241876Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1762770892241
2025-11-10T10:34:52.242808Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.242924Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.249172Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.249231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.249288Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.249312Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.249349Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-10T10:34:52.249363Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.249384Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-10T10:34:52.249416Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.249438Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-10T10:34:52.249906Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.249922Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.249934Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.249950Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.249964Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.249994Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.250061Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.250139Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.250286Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1762770892224
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.251557Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689525973:3616] destroyed
2025-11-10T10:34:52.252842Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.253815Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689525978:3619], now have 1 active actors on pipe
2025-11-10T10:34:52.254059Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.254088Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.254174Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|7c3efa9-d8148ceb-bd13c098-4efd644_7 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:52.254204Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.254219Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.254236Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.254253Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.254271Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.254304Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.254317Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.254327Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.254356Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.254387Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.254625Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.255049Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689525978:3619] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|7c3efa9-d8148ceb-bd13c098-4efd644_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.260886Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.260917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.260930Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.260961Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.260975Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|7c3efa9-d8148ceb-bd13c098-4efd644_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.285946Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.287840Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689525984:3623], now have 1 active actors on pipe
2025-11-10T10:34:52.291836Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.291886Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.292356Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.292815Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.292844Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.292867Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.293155Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.293173Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.293184Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.293203Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.293215Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.293250Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.293299Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.293312Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.293335Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.293345Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.293360Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.293372Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.293389Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.293479Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-10T10:34:52.293514Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.293528Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-10T10:34:52.293540Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.293554Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-10T10:34:52.297144Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-10T10:34:52.297214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.297227Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.297247Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.297916Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1762770892296
2025-11-10T10:34:52.298898Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.299011Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.308315Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.308379Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.308438Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.308460Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.308497Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-10T10:34:52.308509Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.308529Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-10T10:34:52.308548Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.308583Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-10T10:34:52.308798Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.326547Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.326584Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.326599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.326616Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.326629Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.326669Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.326780Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.327425Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1762770892292
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 15
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.330064Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689525984:3623] destroyed
2025-11-10T10:34:52.333912Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.336179Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689525989:3626], now have 1 active actors on pipe
2025-11-10T10:34:52.336255Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.336281Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.336381Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|99ea2315-816beec5-504cd827-b4187dcf_8 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:52.336409Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.336423Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.336443Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.336455Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.336475Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.336507Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.336519Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.336533Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.336590Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.336636Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.336801Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|99ea2315-816beec5-504cd827-b4187dcf_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.345174Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689525989:3626] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|99ea2315-816beec5-504cd827-b4187dcf_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.361197Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.361229Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.361242Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.361263Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.361277Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.367000Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.368298Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689525992:3627], now have 1 active actors on pipe
2025-11-10T10:34:52.375448Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.375491Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.375865Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.376212Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.376235Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.376254Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.376414Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.376450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.376461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.376476Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.376484Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.376494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.376503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.376518Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.376592Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-10T10:34:52.376615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.376626Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-10T10:34:52.376635Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.376646Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-10T10:34:52.381302Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-10T10:34:52.381358Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.381369Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.381386Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.381950Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1762770892381
2025-11-10T10:34:52.382785Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.382885Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.395282Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.394206Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.394254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.394306Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.394326Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.394353Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-10T10:34:52.394362Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.394374Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-10T10:34:52.394388Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.394401Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-10T10:34:52.394691Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.394703Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.394712Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.394723Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.394733Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.394770Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-11-10T10:34:52.394780Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.394788Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.394798Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.394813Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.394823Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.394831Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.394841Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.394849Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.394863Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-11-10T10:34:52.394920Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.394958Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-11-10T10:34:52.394977Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-10T10:34:52.395032Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.395104Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-10T10:34:52.395250Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-10T10:34:52.395385Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-10T10:34:52.395481Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-10T10:34:52.395569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.395586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.395597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.395632Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.395653Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.395716Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-10T10:34:52.395861Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-10T10:34:52.395947Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-10T10:34:52.396001Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-10T10:34:52.396310Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 9 blobs for compaction
2025-11-10T10:34:52.396345Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689525992:3627] destroyed
2025-11-10T10:34:52.396375Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.396387Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.396412Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.396436Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.396462Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.396486Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.396510Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:52.396539Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:52.396565Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:52.396620Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-11-10T10:34:52.396705Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-10T10:34:52.396709Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-10T10:34:52.396741Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-10T10:34:52.396741Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.396754Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.396761Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.396776Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-11-10T10:34:52.396812Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.396817Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.0/1
2025-11-10T10:34:52.396855Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-10T10:34:52.396878Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.396916Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.396962Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.397021Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.397076Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1762770892372
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 18
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.400543Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.403271Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.402334Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689525997:3630], now have 1 active actors on pipe
2025-11-10T10:34:52.402715Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.402738Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.402827Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|12b323c0-63ea3966-5dfa83dc-821183cf_8 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:52.402852Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.402865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.402882Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.402895Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.402910Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.402949Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.402960Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.402973Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.403013Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.403055Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.404095Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689525997:3630] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|12b323c0-63ea3966-5dfa83dc-821183cf_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.409032Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-10T10:34:52.409255Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:0 appended
2025-11-10T10:34:52.409290Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-10T10:34:52.409302Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.409321Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-10T10:34:52.410291Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.0/3
2025-11-10T10:34:52.410324Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-10T10:34:52.410334Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:0 appended
2025-11-10T10:34:52.411091Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.1/3
2025-11-10T10:34:52.411120Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-10T10:34:52.411130Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:1 appended
2025-11-10T10:34:52.411242Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.2/3
2025-11-10T10:34:52.411261Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-10T10:34:52.414491Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048955 count 2 nextOffset 2 batches 3
2025-11-10T10:34:52.414542Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:2 appended
2025-11-10T10:34:52.414567Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-10T10:34:52.414578Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.414596Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-10T10:34:52.415523Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.0/3
2025-11-10T10:34:52.415543Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-10T10:34:52.415554Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:0 appended
2025-11-10T10:34:52.416489Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.1/3
2025-11-10T10:34:52.416517Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-10T10:34:52.416536Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:1 appended
2025-11-10T10:34:52.416754Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.2/3
2025-11-10T10:34:52.416774Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|12b323c0-63ea3966-5dfa83dc-821183cf_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.431388Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097711 count 3 nextOffset 3 batches 5
2025-11-10T10:34:52.431452Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:2 appended
2025-11-10T10:34:52.431485Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-10T10:34:52.431498Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.431517Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-10T10:34:52.432660Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.0/3
2025-11-10T10:34:52.432702Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-10T10:34:52.432717Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:0 appended
2025-11-10T10:34:52.433817Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.1/3
2025-11-10T10:34:52.433849Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-10T10:34:52.433863Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:1 appended
2025-11-10T10:34:52.434044Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.2/3
2025-11-10T10:34:52.434065Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-10T10:34:52.436775Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146467 count 4 nextOffset 4 batches 7
2025-11-10T10:34:52.436826Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:2 appended
2025-11-10T10:34:52.436853Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-10T10:34:52.436866Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.436883Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-11-10T10:34:52.439360Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.439673Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.0/3
2025-11-10T10:34:52.439716Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-10T10:34:52.439731Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:0 appended
2025-11-10T10:34:52.440833Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.1/3
2025-11-10T10:34:52.440864Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-10T10:34:52.440879Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:1 appended
2025-11-10T10:34:52.442806Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689526001:3632], now have 1 active actors on pipe
2025-11-10T10:34:52.453081Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.453132Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.453635Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.454060Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.454096Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.454120Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.454325Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.454379Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.454398Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.454419Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.454434Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.454450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.454461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.454481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.454574Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-10T10:34:52.454606Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.454621Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-10T10:34:52.454632Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.454645Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-10T10:34:52.459168Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.2/3
2025-11-10T10:34:52.459207Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-10T10:34:52.465686Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195223 count 5 nextOffset 5 batches 9
2025-11-10T10:34:52.465750Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:2 appended
2025-11-10T10:34:52.465780Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-10T10:34:52.465793Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.465813Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-10T10:34:52.466749Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.0/3
2025-11-10T10:34:52.466794Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-10T10:34:52.466809Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:0 appended
2025-11-10T10:34:52.467846Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.1/3
2025-11-10T10:34:52.467877Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-10T10:34:52.467892Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:1 appended
2025-11-10T10:34:52.468073Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.2/3
2025-11-10T10:34:52.468093Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-10T10:34:52.469333Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-10T10:34:52.469404Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.469420Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.469439Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.470160Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1762770892469
2025-11-10T10:34:52.471155Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.471268Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.479147Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243979 count 6 nextOffset 6 batches 11
2025-11-10T10:34:52.479209Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:2 appended
2025-11-10T10:34:52.479238Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-10T10:34:52.479251Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.479269Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-10T10:34:52.480121Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.0/3
2025-11-10T10:34:52.480152Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-10T10:34:52.480168Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:0 appended
2025-11-10T10:34:52.481075Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.1/3
2025-11-10T10:34:52.481096Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-10T10:34:52.481108Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:1 appended
2025-11-10T10:34:52.481218Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.2/3
2025-11-10T10:34:52.481234Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-10T10:34:52.484805Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292735 count 7 nextOffset 7 batches 13
2025-11-10T10:34:52.484853Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:2 appended
2025-11-10T10:34:52.484879Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-10T10:34:52.484891Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.484907Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-10T10:34:52.485769Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.0/3
2025-11-10T10:34:52.485797Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-10T10:34:52.485814Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:0 appended
2025-11-10T10:34:52.486767Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.1/3
2025-11-10T10:34:52.486788Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-10T10:34:52.486801Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:1 appended
2025-11-10T10:34:52.486908Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.2/3
2025-11-10T10:34:52.486924Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-10T10:34:52.494130Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341490 count 8 nextOffset 8 batches 15
2025-11-10T10:34:52.494192Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:2 appended
2025-11-10T10:34:52.494216Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-10T10:34:52.494228Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.494245Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-10T10:34:52.495102Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.0/3
2025-11-10T10:34:52.495131Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-10T10:34:52.495144Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:0 appended
2025-11-10T10:34:52.496079Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.1/3
2025-11-10T10:34:52.496100Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-10T10:34:52.496112Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:1 appended
2025-11-10T10:34:52.496234Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.2/3
2025-11-10T10:34:52.496251Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-10T10:34:52.497569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:52.500690Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.500754Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.500820Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.500821Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.500844Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.500882Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-10T10:34:52.500896Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.500918Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-10T10:34:52.500939Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.500961Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-10T10:34:52.501335Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.501351Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.501365Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.501382Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.501395Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.501430Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-11-10T10:34:52.501441Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.501453Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.501463Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.501858Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.501875Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.501887Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.501899Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.501911Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-10T10:34:52.501922Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037894][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-11-10T10:34:52.501991Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.502035Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037894][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-11-10T10:34:52.502049Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-10T10:34:52.502157Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-10T10:34:52.502306Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-10T10:34:52.502489Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-10T10:34:52.502598Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-10T10:34:52.502879Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-10T10:34:52.502956Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-10T10:34:52.503033Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-10T10:34:52.503098Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-10T10:34:52.503513Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037894][Partition][0][StateIdle] Request 9 blobs for compaction
2025-11-10T10:34:52.503554Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.503574Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.503591Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.503609Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.503626Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:51.000000Z
2025-11-10T10:34:52.503643Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:52.503661Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:52.503677Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:52.503694Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:52.503753Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-11-10T10:34:52.503824Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-10T10:34:52.503843Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037894][Partition][0][StateIdle] Continue blobs compaction
2025-11-10T10:34:52.503860Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.503869Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-10T10:34:52.503881Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.503883Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.503896Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-11-10T10:34:52.503904Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.503923Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 0.0/1
2025-11-10T10:34:52.503927Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.503944Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-10T10:34:52.503947Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.503969Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.503998Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.504022Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-11-10T10:34:52.505129Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1762770892454
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 45
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.525201Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.567944Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365509
2025-11-10T10:34:52.568037Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365509 WTime 1762770892567
2025-11-10T10:34:52.572010Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-10T10:34:52.572054Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 0:0 appended
2025-11-10T10:34:52.572079Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-10T10:34:52.572090Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.572106Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-10T10:34:52.573035Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.0/3
2025-11-10T10:34:52.576818Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-11-10T10:34:52.576867Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:2 appended
2025-11-10T10:34:52.577195Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-10T10:34:52.577217Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:0 appended
2025-11-10T10:34:52.578192Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.1/3
2025-11-10T10:34:52.578216Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-10T10:34:52.578230Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:1 appended
2025-11-10T10:34:52.578350Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.2/3
2025-11-10T10:34:52.578365Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-10T10:34:52.579914Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1762770892575
2025-11-10T10:34:52.580112Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.580128Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.580140Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.580157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.580170Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.580224Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689526007:3636], now have 1 active actors on pipe
2025-11-10T10:34:52.580285Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.580304Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.580340Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.580446Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365509
2025-11-10T10:34:52.580521Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-11-10T10:34:52.580614Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5e56ab5b-f76df822-935b160f-40ade05a_9 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:52.580635Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.580647Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.580666Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.580679Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.580697Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.580727Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.580739Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.580753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.580787Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.580910Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.581290Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.584733Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048956 count 2 nextOffset 2 batches 3
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5e56ab5b-f76df822-935b160f-40ade05a_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.589175Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689526007:3636] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|5e56ab5b-f76df822-935b160f-40ade05a_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.593177Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:2 appended
2025-11-10T10:34:52.593233Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-10T10:34:52.593247Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.593269Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-10T10:34:52.594164Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.0/3
2025-11-10T10:34:52.594206Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-10T10:34:52.594224Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:0 appended
2025-11-10T10:34:52.595230Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.1/3
2025-11-10T10:34:52.595253Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-10T10:34:52.595267Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:1 appended
2025-11-10T10:34:52.595389Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.2/3
2025-11-10T10:34:52.595406Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-10T10:34:52.612809Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097712 count 3 nextOffset 3 batches 5
2025-11-10T10:34:52.612882Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:2 appended
2025-11-10T10:34:52.612922Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-10T10:34:52.612936Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.612956Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-10T10:34:52.617624Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.0/3
2025-11-10T10:34:52.617674Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-10T10:34:52.617691Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:0 appended
2025-11-10T10:34:52.618752Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.1/3
2025-11-10T10:34:52.618774Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-10T10:34:52.618788Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:1 appended
2025-11-10T10:34:52.618950Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.2/3
2025-11-10T10:34:52.618964Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-10T10:34:52.631072Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.633192Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689526019:3643], now have 1 active actors on pipe
2025-11-10T10:34:52.633513Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146468 count 4 nextOffset 4 batches 7
2025-11-10T10:34:52.633557Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:2 appended
2025-11-10T10:34:52.633583Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-10T10:34:52.633595Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.633614Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-11-10T10:34:52.636353Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.0/3
2025-11-10T10:34:52.636397Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-10T10:34:52.636412Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:0 appended
2025-11-10T10:34:52.638731Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.1/3
2025-11-10T10:34:52.638757Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-10T10:34:52.638773Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:1 appended
2025-11-10T10:34:52.638892Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.2/3
2025-11-10T10:34:52.638909Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-10T10:34:52.650534Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.650590Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.651123Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.651586Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.651619Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.651643Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.651931Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.651978Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.651991Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.652013Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.652024Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.652040Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.652052Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.652075Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.652170Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-10T10:34:52.652200Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.652215Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-10T10:34:52.652228Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.652243Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-10T10:34:52.658961Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195224 count 5 nextOffset 5 batches 9
2025-11-10T10:34:52.659022Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:2 appended
2025-11-10T10:34:52.659055Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-10T10:34:52.659069Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.659086Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-10T10:34:52.665417Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.0/3
2025-11-10T10:34:52.665472Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-10T10:34:52.665489Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:0 appended
2025-11-10T10:34:52.666466Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.1/3
2025-11-10T10:34:52.666489Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-10T10:34:52.666502Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:1 appended
2025-11-10T10:34:52.666668Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.2/3
2025-11-10T10:34:52.666696Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-10T10:34:52.670644Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243980 count 6 nextOffset 6 batches 11
2025-11-10T10:34:52.670711Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:2 appended
2025-11-10T10:34:52.670749Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-10T10:34:52.670759Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.670781Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-10T10:34:52.672287Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.0/3
2025-11-10T10:34:52.672335Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-10T10:34:52.672350Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:0 appended
2025-11-10T10:34:52.673495Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.1/3
2025-11-10T10:34:52.673528Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-10T10:34:52.673543Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:1 appended
2025-11-10T10:34:52.673734Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.2/3
2025-11-10T10:34:52.673758Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-10T10:34:52.678642Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-10T10:34:52.678714Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.678730Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.678749Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.679448Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1762770892679
2025-11-10T10:34:52.680777Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:52.680812Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.680924Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.681582Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292736 count 7 nextOffset 7 batches 13
2025-11-10T10:34:52.681634Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:2 appended
2025-11-10T10:34:52.681660Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-10T10:34:52.681672Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.681687Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-10T10:34:52.683614Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365509 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.683653Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.683698Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.683991Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:52.684016Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.684111Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365509
2025-11-10T10:34:52.684134Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-10T10:34:52.684485Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.0/3
2025-11-10T10:34:52.684521Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-10T10:34:52.684536Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:0 appended
2025-11-10T10:34:52.685501Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.1/3
2025-11-10T10:34:52.685524Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-10T10:34:52.685536Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:1 appended
2025-11-10T10:34:52.685650Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.2/3
2025-11-10T10:34:52.685666Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-10T10:34:52.692750Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341492 count 8 nextOffset 8 batches 15
2025-11-10T10:34:52.693549Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:2 appended
2025-11-10T10:34:52.693595Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-10T10:34:52.693611Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-10T10:34:52.693631Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-10T10:34:52.696521Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.0/3
2025-11-10T10:34:52.696563Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-10T10:34:52.696577Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:0 appended
2025-11-10T10:34:52.697626Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.1/3
2025-11-10T10:34:52.697663Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-10T10:34:52.697677Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:1 appended
2025-11-10T10:34:52.697898Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.2/3
2025-11-10T10:34:52.697913Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-10T10:34:52.705555Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.705641Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.705709Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.705734Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.705776Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-11-10T10:34:52.705791Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.705814Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-10T10:34:52.705835Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.705861Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-10T10:34:52.706324Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.707406Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.707436Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.707449Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.707472Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.707495Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.707696Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.707790Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.707839Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.707868Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-11-10T10:34:52.707878Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-10T10:34:52.707889Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-10T10:34:52.707901Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-10T10:34:52.707911Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-11-10T10:34:52.707921Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-11-10T10:34:52.707930Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-10T10:34:52.707939Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-10T10:34:52.707947Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-10T10:34:52.711563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689526019:3643] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1762770892651
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 53
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.717567Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717625Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717661Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717690Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717723Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717751Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717781Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717809Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717840Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.717930Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.717982Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.718010Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.718026Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.718042Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.718059Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.718075Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.718109Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.709892Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.722199Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-10T10:34:52.722251Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.723591Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.726196Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.725276Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.725653Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.725971Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.726343Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.726538Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.726709Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.745023Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365511
2025-11-10T10:34:52.745360Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1103: [72075186224037894][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic12' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365511 WTime 1762770892743
2025-11-10T10:34:52.749359Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-11-10T10:34:52.749401Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:2 appended
2025-11-10T10:34:52.749894Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1762770892749
2025-11-10T10:34:52.750054Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689526001:3632] destroyed
2025-11-10T10:34:52.750089Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.750104Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.750114Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.750131Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.750144Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.750191Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689526027:3649], now have 1 active actors on pipe
2025-11-10T10:34:52.750248Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.750271Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.750307Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.750423Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365511
2025-11-10T10:34:52.750488Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-11-10T10:34:52.750578Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3e4af7bf-d75d785a-c0475fae-e143f1dd_9 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:52.750599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.750612Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.750630Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.750643Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.750663Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.750697Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.750709Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.750725Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.750760Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.750888Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.751339Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3e4af7bf-d75d785a-c0475fae-e143f1dd_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.753974Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689526027:3649] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|3e4af7bf-d75d785a-c0475fae-e143f1dd_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.776122Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.781628Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.781662Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.781675Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.781695Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.781711Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.789831Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689526036:3652], now have 1 active actors on pipe
2025-11-10T10:34:52.793627Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.793679Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.794174Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.794621Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.794655Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.794680Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.794949Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.794997Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.795012Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.795032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.795044Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.795058Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.795071Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.795092Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.795200Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-10T10:34:52.795231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.795246Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-10T10:34:52.795259Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.795273Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-10T10:34:52.800562Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-10T10:34:52.801099Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.801134Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.801156Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.801888Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1762770892800
2025-11-10T10:34:52.803276Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.803386Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.812935Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365511 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.812989Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.813048Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.813285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:52.813298Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.813809Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365511
2025-11-10T10:34:52.813839Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-10T10:34:52.822590Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.822649Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.822714Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.822749Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.822786Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-11-10T10:34:52.822801Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.822824Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-10T10:34:52.822849Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.822871Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-10T10:34:52.823329Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.823345Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.823359Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.823375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.823388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.824035Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1762770892791
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 30
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.823527Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.823602Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.823642Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.823663Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-11-10T10:34:52.823673Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-10T10:34:52.823682Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-10T10:34:52.823691Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-10T10:34:52.823702Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-11-10T10:34:52.823711Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-11-10T10:34:52.823721Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-10T10:34:52.823730Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-10T10:34:52.823739Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-10T10:34:52.823764Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.827145Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689526036:3652] destroyed
2025-11-10T10:34:52.827378Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827417Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827451Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827491Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827525Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827554Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827582Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827610Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827637Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.827698Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.827736Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.827773Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.827788Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.827799Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.827816Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.827828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.827858Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.827223Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.828325Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-10T10:34:52.828358Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.828546Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.828699Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.828860Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.829014Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.829201Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.829348Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.829526Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.830256Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689526043:3658], now have 1 active actors on pipe
2025-11-10T10:34:52.830480Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.830506Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.830588Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|122761e7-29fac9c6-b5e4a777-d1e3595f_10 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:52.830611Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.830623Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.830641Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.830655Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.830673Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.830706Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.830718Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.830733Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.830768Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.830806Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.831195Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:52.831954Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689526043:3658] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|122761e7-29fac9c6-b5e4a777-d1e3595f_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|122761e7-29fac9c6-b5e4a777-d1e3595f_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.850144Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.850169Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.850201Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.850214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.850233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.850248Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.851634Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689526047:3660], now have 1 active actors on pipe
2025-11-10T10:34:52.855286Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.855329Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.855795Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.856252Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.856281Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.856305Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.856609Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.856668Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.856683Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.856705Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.856715Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.856730Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.856742Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.856763Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.856863Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-10T10:34:52.856893Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.856906Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-10T10:34:52.856918Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.856931Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-10T10:34:52.862695Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-10T10:34:52.862766Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.862779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.862798Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.863419Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1762770892862
2025-11-10T10:34:52.864384Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.864490Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.874479Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:52.874552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.874598Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.874610Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.874632Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.874671Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-10T10:34:52.874684Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.874705Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-10T10:34:52.874724Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.874742Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-10T10:34:52.875101Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.875120Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.875131Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.875149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.875162Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.875196Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.875266Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.875849Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1762770892856
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 17
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.877936Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689526047:3660] destroyed
2025-11-10T10:34:52.880121Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.881808Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689526052:3663], now have 1 active actors on pipe
2025-11-10T10:34:52.881916Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.881930Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.881939Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.881952Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.881961Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.882105Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.882125Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.882184Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|39694e91-f55920b9-a994cf15-14b8fa99_10 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:52.882202Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.882212Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.882224Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.882232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.882247Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.882279Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.882292Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.882306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.882344Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.882387Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.882791Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|39694e91-f55920b9-a994cf15-14b8fa99_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.883993Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689526052:3663] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|39694e91-f55920b9-a994cf15-14b8fa99_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.904675Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.906312Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043333689526055:3664], now have 1 active actors on pipe
2025-11-10T10:34:52.910070Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:52.910120Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:52.910725Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.911165Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.911200Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.911224Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.911446Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.911493Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.911509Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.911532Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.911543Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.911565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.911579Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.911600Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.911698Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-10T10:34:52.911731Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.911763Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-10T10:34:52.911779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.911794Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-10T10:34:52.920681Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-10T10:34:52.920762Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:52.920776Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:52.920796Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.921957Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1762770892921
2025-11-10T10:34:52.923008Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:52.923123Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-10T10:34:52.933810Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:52.933880Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:52.933941Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:52.933962Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.933991Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-10T10:34:52.934005Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.934029Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-10T10:34:52.934048Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:52.934073Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-10T10:34:52.934315Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:52.934505Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.934529Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.934541Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.934565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.934580Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.934612Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:52.934674Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.934858Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1762770892911
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 22
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:52.936661Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043333689526055:3664] destroyed
2025-11-10T10:34:52.945723Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.946989Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689526062:3669], now have 1 active actors on pipe
2025-11-10T10:34:52.947369Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.947401Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.947509Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|88020bbd-2a54a95c-83548758-dc03cc39_11 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:52.947542Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.947557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.947576Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:52.947596Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.947617Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.947648Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:52.947665Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:52.947680Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.947724Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:52.947778Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:52.947919Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|88020bbd-2a54a95c-83548758-dc03cc39_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:52.948949Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689526062:3669] destroyed
2025-11-10T10:34:52.953210Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.953242Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.953255Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.953276Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.953290Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|88020bbd-2a54a95c-83548758-dc03cc39_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:52.981495Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:52.982267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.982310Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.982321Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.982340Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:52.982352Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:52.989738Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043333689526073:3676], now have 1 active actors on pipe
2025-11-10T10:34:52.995048Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:52.995081Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:52.995506Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:52.995922Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:52.995945Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:52.995962Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:52.996301Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:52.996339Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:52.996349Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.996366Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.996376Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:52.996387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:52.996394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:52.996407Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.996483Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-10T10:34:52.996506Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.996516Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-10T10:34:52.996524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:52.996534Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-10T10:34:53.008252Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-10T10:34:53.008767Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.008791Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.008810Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.009557Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1762770893007
2025-11-10T10:34:53.010620Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.010727Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.033987Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:53.034058Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.034110Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.034128Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.034151Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-10T10:34:53.034160Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.034228Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-10T10:34:53.034250Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.034269Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-10T10:34:53.034323Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.034789Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.034805Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.034817Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.034833Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.034846Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.034878Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.034946Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1762770892993
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 39
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.039495Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043333689526073:3676] destroyed
2025-11-10T10:34:53.036401Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.041691Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.050412Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493383:3684], now have 1 active actors on pipe
2025-11-10T10:34:53.050512Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.050539Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.050628Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|13a1d54a-8a89935c-f9fdba66-acbb8103_11 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:53.050662Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.050676Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.050694Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.050705Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.050724Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.050753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.050766Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.050780Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.050822Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.050863Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.051042Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.051647Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493383:3684] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|13a1d54a-8a89935c-f9fdba66-acbb8103_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:53.057182Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.057212Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.057222Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.057240Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.057252Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|13a1d54a-8a89935c-f9fdba66-acbb8103_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.085232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.085264Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.085276Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.085292Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.085306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.089236Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.097022Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493389:3685], now have 1 active actors on pipe
2025-11-10T10:34:53.099107Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.099145Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.099592Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.100056Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.100085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.100106Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.100513Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.100568Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.100582Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.100599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.100608Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.100624Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.100634Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.100650Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.100731Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-10T10:34:53.100761Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.100777Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-10T10:34:53.100787Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.100799Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-10T10:34:53.104026Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-10T10:34:53.104090Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.104101Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.104119Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.104733Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1762770893101
2025-11-10T10:34:53.109819Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.109932Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.149340Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:53.149405Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.149464Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.149485Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.149517Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-10T10:34:53.149530Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.149557Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-10T10:34:53.149575Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.149607Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-10T10:34:53.150097Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.150113Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.150125Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.150140Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.150151Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.150182Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.150241Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.153159Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.156442Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1762770893096
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 52
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.161185Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.161216Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.161227Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.161243Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.161255Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.161305Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493389:3685] destroyed
2025-11-10T10:34:53.169208Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.179713Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493394:3688], now have 1 active actors on pipe
2025-11-10T10:34:53.181319Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.181353Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.181439Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ffc8e78c-449ed106-bea7ad5b-acd9d79d_12 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:53.181467Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.181482Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.181500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.181512Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.181529Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.181561Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.181573Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.181586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.181627Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.181672Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.185242Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ffc8e78c-449ed106-bea7ad5b-acd9d79d_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:53.189306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.189334Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.189347Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.189365Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.189377Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.189437Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493394:3688] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|ffc8e78c-449ed106-bea7ad5b-acd9d79d_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.223083Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.229192Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493397:3689], now have 1 active actors on pipe
2025-11-10T10:34:53.230676Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.230704Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.231184Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.231672Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.231704Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.231727Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.232115Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.232171Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.232187Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.232208Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.232220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.232235Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.232248Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.232267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.232357Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-10T10:34:53.232388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.232403Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-10T10:34:53.232416Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.232431Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-10T10:34:53.242591Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-10T10:34:53.242668Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.242680Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.242696Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.243414Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1762770893243
2025-11-10T10:34:53.244420Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.244528Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.260698Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:53.260762Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.260787Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.260819Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.260839Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.260874Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-10T10:34:53.260886Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.260909Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-10T10:34:53.260928Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.260946Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-10T10:34:53.261508Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.261523Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.261536Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.261551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.261564Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.261595Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.261656Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.261798Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1762770893232
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 4
    WriteTimeMs: 26
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-10T10:34:53.262999Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493397:3689] destroyed
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.264266Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.264288Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.264299Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.264316Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.264327Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.265691Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.266678Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493402:3692], now have 1 active actors on pipe
2025-11-10T10:34:53.267942Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.267971Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.268054Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6ddda9e6-927a504f-78c0f6e9-84a167e0_12 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:53.268077Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.268091Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.268109Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.268121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.268139Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.268168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.268180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.268194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.268231Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.268273Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.273259Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.273962Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493402:3692] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6ddda9e6-927a504f-78c0f6e9-84a167e0_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|6ddda9e6-927a504f-78c0f6e9-84a167e0_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.289605Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.289635Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.289647Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.289666Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.289686Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.295301Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.297389Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493406:3694], now have 1 active actors on pipe
2025-11-10T10:34:53.302673Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.302724Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.303245Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.303708Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.303738Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.303774Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.310261Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.310321Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.310333Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.310355Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.310364Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.310378Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.310387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.310401Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.310485Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-10T10:34:53.310511Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.310525Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-10T10:34:53.310536Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.310549Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-10T10:34:53.313909Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-10T10:34:53.313974Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.313986Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.314002Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.314655Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1762770893312
2025-11-10T10:34:53.315619Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.315727Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.323983Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:53.324039Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.324070Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.324098Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.324123Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.324156Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-10T10:34:53.324175Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.324196Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-10T10:34:53.324215Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.324241Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-10T10:34:53.324682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.324700Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.324709Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.324721Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.324731Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.324755Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.324803Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.325984Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493406:3694] destroyed
2025-11-10T10:34:53.324979Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1762770893310
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 13
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.329814Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.330935Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493441:3708], now have 1 active actors on pipe
2025-11-10T10:34:53.331279Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.331311Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.331394Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d81bf30d-6449c89a-42de71c3-386239d2_13 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:53.331427Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.331444Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.331461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.331474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.331497Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.331530Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.331546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.331560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.331604Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.331654Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.331859Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-10T10:34:53.332549Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493441:3708] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d81bf30d-6449c89a-42de71c3-386239d2_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d81bf30d-6449c89a-42de71c3-386239d2_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.351307Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.353165Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493444:3709], now have 1 active actors on pipe
2025-11-10T10:34:53.358556Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.358609Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.359085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.359507Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.359536Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.359560Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.359801Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.359852Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.359866Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.359888Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.359899Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.359917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.359932Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.359954Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.360051Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-10T10:34:53.360081Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.360095Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-10T10:34:53.360107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.360121Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-10T10:34:53.365226Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.365262Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.365276Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.365299Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.365314Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.416824Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-10T10:34:53.416912Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.416925Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.416946Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.417850Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1762770893417
2025-11-10T10:34:53.418879Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:53.418905Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.419018Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.426875Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:53.426936Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.426994Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.427015Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.427051Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-10T10:34:53.427063Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.427085Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-10T10:34:53.427104Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.427126Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-10T10:34:53.427483Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.427500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.427512Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.427527Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.427541Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.427573Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.427634Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.428091Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.428282Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.429265Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493444:3709] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1762770893359
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 65
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.431685Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.432731Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493449:3712], now have 1 active actors on pipe
2025-11-10T10:34:53.432984Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.433015Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.433122Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|af29b583-fe730ded-eec35d8e-80501805_13 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:53.433153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.433168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.433188Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.433202Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.433220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.433250Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.433263Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.433279Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.433318Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.433362Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.433796Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.434386Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493449:3712] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|af29b583-fe730ded-eec35d8e-80501805_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|af29b583-fe730ded-eec35d8e-80501805_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.450746Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:571: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037889 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 10] state 'Ready' dataSize 824 rowCount 2 cpuUsage 0
2025-11-10T10:34:53.454551Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.455880Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493454:3714], now have 1 active actors on pipe
2025-11-10T10:34:53.459409Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.459459Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.459951Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.460407Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.460439Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.460474Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.460675Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.460722Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.460737Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.460758Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.460779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.460798Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.460809Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.460830Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.460933Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-10T10:34:53.460966Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.460981Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-10T10:34:53.460994Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.461009Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-10T10:34:53.468969Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-10T10:34:53.469048Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.469198Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.469223Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.469985Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1762770893469
2025-11-10T10:34:53.470959Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:53.470985Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.471117Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.486434Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:53.486505Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.486581Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.486604Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.486643Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-10T10:34:53.486657Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.486679Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-10T10:34:53.486698Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.486720Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-10T10:34:53.487048Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.487065Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.487078Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.487095Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.487109Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.487142Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.487212Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.487662Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.487865Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.489434Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493454:3714] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1762770893460
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 23
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.491720Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.493029Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493461:3719], now have 1 active actors on pipe
2025-11-10T10:34:53.493552Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.493596Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.493686Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|bb59ad52-71b7674c-c9b49bad-fbe7d2c4_14 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:53.493713Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.493728Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.493748Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.493760Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.493779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.493813Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.493827Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.493842Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.493883Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.493930Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.494396Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.495534Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493461:3719] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|bb59ad52-71b7674c-c9b49bad-fbe7d2c4_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|bb59ad52-71b7674c-c9b49bad-fbe7d2c4_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.521415Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.521453Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.521469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.521491Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.521506Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.522486Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:571: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037890 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 11] state 'Ready' dataSize 0 rowCount 0 cpuUsage 0
2025-11-10T10:34:53.525880Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.527310Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493465:3721], now have 1 active actors on pipe
2025-11-10T10:34:53.531549Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.531599Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.532120Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.532568Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.532605Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.532628Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.532861Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.532911Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.532927Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.532949Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.532962Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.532979Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.532992Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.533015Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.533141Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-10T10:34:53.533173Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.533190Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-10T10:34:53.533202Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.533217Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-10T10:34:53.554685Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:598: Started TEvPersistStats at tablet 72057594046644480, queue size# 2
2025-11-10T10:34:53.554847Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:263: PersistSingleStats for pathId 10 shard idx 72057594046644480:2 data size 824 row count 2
2025-11-10T10:34:53.554887Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:284: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037889 maps to shardIdx: 72057594046644480:2 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 10], pathId map=Cluster, is column=0, is olap=0, RowCount 2, DataSize 824
2025-11-10T10:34:53.554963Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:477: Do not want to split tablet 72075186224037889: SplitByLoadNotEnabledForTable
2025-11-10T10:34:53.554995Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:263: PersistSingleStats for pathId 11 shard idx 72057594046644480:3 data size 0 row count 0
2025-11-10T10:34:53.555017Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:284: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037890 maps to shardIdx: 72057594046644480:3 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 11], pathId map=Topics, is column=0, is olap=0, RowCount 0, DataSize 0
2025-11-10T10:34:53.555043Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:477: Do not want to split tablet 72075186224037890: SplitByLoadNotEnabledForTable
2025-11-10T10:34:53.555167Z node 4 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:598: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-11-10T10:34:53.573176Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.573212Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.573225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.573245Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.573260Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.574423Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-10T10:34:53.574497Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.574511Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.574530Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.575213Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1762770893573
2025-11-10T10:34:53.576262Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.576379Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.590900Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:53.590964Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.591037Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.591062Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.591101Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-10T10:34:53.591115Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.591138Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-10T10:34:53.591158Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.591182Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-10T10:34:53.591555Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.591573Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.591585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.591603Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.591616Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.591652Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.591724Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.592470Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.592287Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.593946Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493465:3721] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1762770893532
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 56
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.602442Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.610185Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493474:3724], now have 1 active actors on pipe
2025-11-10T10:34:53.610636Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.610659Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.610721Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|1aa74351-92c3a15e-cf221236-3eecd299_14 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:53.610746Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.610756Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.610769Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.610780Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.610796Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.610830Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.610841Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.610855Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.610887Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.610920Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.611249Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|1aa74351-92c3a15e-cf221236-3eecd299_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
2025-11-10T10:34:53.612028Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493474:3724] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|1aa74351-92c3a15e-cf221236-3eecd299_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.621809Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.621861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.621884Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.621923Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.621946Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.640704Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.642626Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493478:3728], now have 1 active actors on pipe
2025-11-10T10:34:53.646728Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.646779Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.647252Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.647700Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.647731Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.647754Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.647980Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.648029Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.648043Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.648065Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.648076Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.648090Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.648102Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.648124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.648213Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-10T10:34:53.648244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.648259Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-10T10:34:53.648274Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.648289Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-10T10:34:53.698657Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-10T10:34:53.698739Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.698752Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.698770Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.699410Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1762770893698
2025-11-10T10:34:53.700416Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:53.700440Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.700542Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.718728Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:53.718799Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.718866Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.718891Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.718931Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-10T10:34:53.718944Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.718966Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-10T10:34:53.718989Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.719010Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-10T10:34:53.719489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.719509Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.719524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.719542Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.719557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.719595Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.719659Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.719783Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.719973Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.721371Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493478:3728] destroyed
2025-11-10T10:34:53.722903Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.722930Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.722952Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.722977Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.722993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1762770893647
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 70
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.727496Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.728568Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493485:3733], now have 1 active actors on pipe
2025-11-10T10:34:53.728841Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.728875Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.728984Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|692bbd4e-307feb74-9ed7776b-a2d3d43c_15 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-10T10:34:53.729018Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.729033Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.729075Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.729089Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.729109Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.729153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.729168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.729186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.729239Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.729300Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.729510Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-10T10:34:53.730228Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493485:3733] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|692bbd4e-307feb74-9ed7776b-a2d3d43c_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|692bbd4e-307feb74-9ed7776b-a2d3d43c_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.753278Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.754640Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493491:3734], now have 1 active actors on pipe
2025-11-10T10:34:53.758491Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.758545Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.759058Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.759555Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.759599Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.759626Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.760039Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.760101Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.760123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.760149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.760167Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.760184Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.760198Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.760222Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.760332Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-10T10:34:53.760376Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.760395Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-10T10:34:53.760408Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.760421Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-10T10:34:53.797410Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-10T10:34:53.797499Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.797514Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.797535Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.798187Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1762770893797
2025-11-10T10:34:53.799185Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.799300Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.800415Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.800442Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.800455Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.800474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.800503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.814291Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.813127Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7571043325577868421:2369]
2025-11-10T10:34:53.813194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.813262Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.813283Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.813311Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-10T10:34:53.813321Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.813335Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-10T10:34:53.813350Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.813365Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-10T10:34:53.813883Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.813900Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.813915Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.813927Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.813938Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.813964Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.814015Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.814112Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.815194Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493491:3734] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1762770893757
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 53
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-10T10:34:53.823800Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.823828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.823839Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.823857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.823868Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.830239Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.832205Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493499:3739], now have 1 active actors on pipe
2025-11-10T10:34:53.832258Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.832280Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.832365Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ecb23548-a6aa735f-d1405b3c-2e6ad64_15 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-10T10:34:53.832396Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.832412Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.832433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-10T10:34:53.832448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.832469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.832506Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-10T10:34:53.832520Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-10T10:34:53.832537Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.832575Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-10T10:34:53.832608Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.832747Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-10T10:34:53.833442Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493499:3739] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ecb23548-a6aa735f-d1405b3c-2e6ad64_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|ecb23548-a6aa735f-d1405b3c-2e6ad64_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-10T10:34:53.869216Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.870987Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493502:3740], now have 1 active actors on pipe
2025-11-10T10:34:53.874781Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.874831Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.875330Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-10T10:34:53.875786Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-10T10:34:53.875826Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-10T10:34:53.875853Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-10T10:34:53.876230Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-10T10:34:53.876288Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.876304Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.876329Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.876342Z node 5 :PERSQUEUE DEBUG: partition.cpp:2404: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-10T10:34:53.876358Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-10T10:34:53.876375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.876396Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.876506Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-10T10:34:53.876540Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.876556Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-10T10:34:53.876569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2468: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-10T10:34:53.876582Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-10T10:34:53.891819Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-10T10:34:53.891907Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-10T10:34:53.891921Z node 5 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-10T10:34:53.891940Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.892678Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1762770893892
2025-11-10T10:34:53.893763Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-10T10:34:53.893894Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-10T10:34:53.900775Z node 5 :PERSQUEUE DEBUG: partition.cpp:2286: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-10T10:34:53.904401Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7571043325577868513:2377]
2025-11-10T10:34:53.904462Z node 5 :PERSQUEUE DEBUG: partition.cpp:2134: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-10T10:34:53.904501Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-10T10:34:53.904527Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-10T10:34:53.904550Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.904589Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-10T10:34:53.904607Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.904628Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-10T10:34:53.904651Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-10T10:34:53.904675Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-10T10:34:53.905181Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.905208Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.905222Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.905238Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.905252Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.905289Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-10T10:34:53.905354Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1762770893875
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 29
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-11-10T10:34:53.907829Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493502:3740] destroyed
2025-11-10T10:34:53.905536Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-10T10:34:53.909445Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.911394Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7571043337984493507:3743], now have 1 active actors on pipe
2025-11-10T10:34:53.911709Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-10T10:34:53.911741Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-10T10:34:53.913288Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-11-10T10:34:53.913624Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365509 count 9 last offset 0, current partition end offset: 16
2025-11-10T10:34:53.913653Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-10T10:34:53.913706Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365509 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:53.913745Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-10T10:34:53.913812Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-11-10T10:34:53.913822Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T10:34:53.915819Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512170 from pos 0 cbcount 2
2025-11-10T10:34:53.916133Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.916437Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1762770891086
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
CallPersQueueGRPC request to localhost:62571
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-11-10T10:34:53.918349Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7571043337984493507:3743] destroyed
2025-11-10T10:34:53.918963Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-10T10:34:53.921348Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7571043337984493510:3744], now have 1 active actors on pipe
2025-11-10T10:34:53.921444Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-10T10:34:53.921470Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-10T10:34:53.922718Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037894][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic12' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-11-10T10:34:53.922903Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037894][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365511 count 9 last offset 0, current partition end offset: 16
2025-11-10T10:34:53.922916Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037894][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-10T10:34:53.922951Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365511 accessed 0 times before, last time 2025-11-10T10:34:52.000000Z
2025-11-10T10:34:53.922984Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-10T10:34:53.923039Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-11-10T10:34:53.923054Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-10T10:34:53.924427Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:53.924449Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.924460Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:53.924479Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:53.924492Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:53.924746Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512171 from pos 0 cbcount 2
2025-11-10T10:34:53.925026Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-10T10:34:53.925701Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1762770891098
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
2025-11-10T10:34:53.926494Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7571043337984493510:3744] destroyed
2025-11-10T10:34:54.001333Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:54.001369Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:54.001383Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:54.001416Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:54.001431Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:54.024718Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:54.024766Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:54.024779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:54.024799Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:54.024813Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-10T10:34:54.101551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:54.101587Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:54.101602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:54.101627Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:54.101642Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-10T10:34:54.125047Z node 5 :PERSQUEUE DEBUG: partition.cpp:2310: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-10T10:34:54.125096Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:54.125111Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-10T10:34:54.125135Z node 5 :PERSQUEUE DEBUG: partition.cpp:2369: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-10T10:34:54.125151Z node 5 :PERSQUEUE DEBUG: partition.cpp:2328: [72075186224037892][Partition][0][StateIdle] Try persist
